-- Logs begin at Thu 2021-05-20 03:42:34 UTC, end at Thu 2021-05-20 04:46:23 UTC. --
May 20 04:13:13.697013 dv-cinder-790910-4-iscsi systemd[1]: Started Devstack devstack@q-svc.service.
May 20 04:13:16.119113 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.common.config [-] Logging enabled!
May 20 04:13:16.119736 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 18.1.0.dev214
May 20 04:13:16.119864 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=91581) setup_logging /opt/stack/neutron/neutron/common/config.py:112}}
May 20 04:13:16.123182 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.common.config [-] Logging enabled!
May 20 04:13:16.123413 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 18.1.0.dev214
May 20 04:13:16.123711 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=91581) setup_logging /opt/stack/neutron/neutron/common/config.py:112}}
May 20 04:13:16.124650 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}}
May 20 04:13:16.124878 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] Configuration options gathered from: {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}}
May 20 04:13:16.125272 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}}
May 20 04:13:16.125517 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}}
May 20 04:13:16.125736 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] ================================================================================ {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}}
May 20 04:13:16.126128 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] allow_bulk                     = True {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.126419 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] allow_overlapping_ips          = True {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.126708 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] api_extensions_path            =  {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.126969 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] api_paste_config               = api-paste.ini {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.127212 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] api_workers                    = 2 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.127507 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] auth_strategy                  = keystone {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.127779 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] backlog                        = 4096 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.128063 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] base_mac                       = fa:16:3e:00:00:00 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.128351 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] bind_host                      = 0.0.0.0 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.128665 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] bind_port                      = 9696 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.128936 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] client_socket_timeout          = 900 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.129401 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] config_dir                     = [] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.129600 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] config_file                    = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.129910 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] config_source                  = [] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.130190 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] control_exchange               = neutron {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.130476 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] core_plugin                    = ml2 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.130734 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] debug                          = True {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.130956 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] default_availability_zones     = [] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.131371 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.131815 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] dhcp_agent_notification        = True {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.132091 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] dhcp_lease_duration            = 86400 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.132367 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] dns_domain                     = openstacklocal {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.132641 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] enable_traditional_dhcp        = True {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.132899 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] external_dns_driver            = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.133177 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] filter_validation              = True {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.133456 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] global_physnet_mtu             = 1500 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.133782 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] host                           = dv-cinder-790910-4-iscsi {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.134053 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] http_retries                   = 3 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.134353 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] instance_format                = [instance: %(uuid)s]  {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.134619 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.134902 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] ipam_driver                    = internal {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.135172 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] ipv6_pd_enabled                = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.135444 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] log_config_append              = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.135726 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.135993 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] log_dir                        = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.136259 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] log_file                       = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.136531 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] log_rotate_interval            = 1 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.136815 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] log_rotate_interval_type       = days {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.137125 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] log_rotation_type              = none {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.137411 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.137631 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.137848 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.138131 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.138413 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] logging_user_identity_format   = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.138685 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] max_dns_nameservers            = 5 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.138955 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] max_header_line                = 16384 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.139225 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] max_logfile_count              = 30 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.139493 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] max_logfile_size_mb            = 200 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.139761 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] max_subnet_host_routes         = 20 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.140023 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] network_link_prefix            = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.140294 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] notify_nova_on_port_data_changes = True {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.140579 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] notify_nova_on_port_status_changes = True {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.140857 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] pagination_max_limit           = -1 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.141157 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] periodic_fuzzy_delay           = 5 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.141427 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] periodic_interval              = 40 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.141774 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] publish_errors                 = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.142048 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] rate_limit_burst               = 0 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.142339 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] rate_limit_except_level        = CRITICAL {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.142601 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] rate_limit_interval            = 0 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.142870 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] retry_until_window             = 30 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.143140 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] rpc_response_max_timeout       = 600 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.143424 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] rpc_state_report_workers       = 0 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.143686 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] rpc_workers                    = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.143954 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] send_events_interval           = 2 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.144248 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] service_plugins                = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.144527 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] setproctitle                   = on {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.144803 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] state_path                     = /opt/stack/data/neutron {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.145263 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] syslog_log_facility            = LOG_USER {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.145542 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] tcp_keepidle                   = 600 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.145821 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] transport_url                  = **** {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.146094 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] use_eventlog                   = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.146359 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] use_journal                    = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.146625 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] use_json                       = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.146890 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] use_ssl                        = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.147154 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] use_stderr                     = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.147430 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] use_syslog                     = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.147695 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] vlan_transparent               = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.147961 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] watch_log_file                 = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.148227 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] wsgi_default_pool_size         = 100 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.148493 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] wsgi_keep_alive                = True {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.148769 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] wsgi_log_format                = %(client_ip)s "%(request_line)s" status: %(status_code)s  len: %(body_length)s time: %(wall_seconds).7f {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:16.149083 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] oslo_concurrency.disable_process_locking = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.149375 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] oslo_concurrency.lock_path     = /opt/stack/data/neutron/lock {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.149668 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] profiler.connection_string     = messaging:// {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.149942 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] profiler.enabled               = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.150228 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] profiler.es_doc_type           = notification {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.150503 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] profiler.es_scroll_size        = 10000 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.150787 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] profiler.es_scroll_time        = 2m {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.151057 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] profiler.filter_error_trace    = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.151339 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] profiler.hmac_keys             = SECRET_KEY {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.151622 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] profiler.sentinel_service_name = mymaster {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.151904 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] profiler.socket_timeout        = 0.1 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.152172 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] profiler.trace_sqlalchemy      = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.152459 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] oslo_policy.enforce_new_defaults = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.152730 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] oslo_policy.enforce_scope      = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.153113 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] oslo_policy.policy_default_rule = default {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.153419 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.153708 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] oslo_policy.policy_file        = /etc/neutron/policy.json {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.153997 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.154269 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.154540 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.154809 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.155082 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.155364 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] nova.auth_section              = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.155655 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] nova.auth_type                 = password {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.155939 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] nova.cafile                    = /opt/stack/data/ca-bundle.pem {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.156209 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] nova.certfile                  = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.156488 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] nova.collect_timing            = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.156776 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] nova.endpoint_type             = public {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.157082 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] nova.insecure                  = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.157379 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] nova.keyfile                   = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.157654 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] nova.live_migration_events     = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.157937 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] nova.region_name               = RegionOne {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.158210 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] nova.split_loggers             = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.158476 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] nova.timeout                   = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.158752 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] placement.auth_section         = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.159026 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] placement.auth_type            = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.159291 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] placement.cafile               = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.159556 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] placement.certfile             = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.159828 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] placement.collect_timing       = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.160112 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] placement.endpoint_type        = public {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.160531 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] placement.insecure             = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.160801 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] placement.keyfile              = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.161094 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] placement.region_name          = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.161368 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] placement.split_loggers        = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.161637 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] placement.timeout              = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.161918 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] ironic.auth_section            = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.162187 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] ironic.auth_type               = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.162456 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] ironic.cafile                  = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.162722 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] ironic.certfile                = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.162996 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] ironic.collect_timing          = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.163264 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] ironic.connect_retries         = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.163531 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] ironic.connect_retry_delay     = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.163801 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] ironic.enable_notifications    = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.164067 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] ironic.endpoint_override       = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.164340 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] ironic.insecure                = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.164609 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] ironic.interface               = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.164878 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] ironic.keyfile                 = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.165172 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] ironic.max_version             = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.165442 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] ironic.min_version             = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.165712 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] ironic.region_name             = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.165979 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] ironic.service_name            = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.166247 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] ironic.service_type            = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.166522 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] ironic.split_loggers           = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.166789 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] ironic.status_code_retries     = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.167414 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] ironic.status_code_retry_delay = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.167681 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] ironic.timeout                 = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.167946 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] ironic.valid_interfaces        = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.168210 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] ironic.version                 = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.168494 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] service_providers.service_provider = [] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.168789 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.169094 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.169374 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.169651 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.169923 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.170198 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.170472 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.170746 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.171022 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.171288 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.171574 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.171854 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.172140 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.172420 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.172691 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.173052 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.173330 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.173611 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.173885 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.174162 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.174447 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.174726 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl      = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.175017 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.175309 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.175603 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_key_file =  {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.175891 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_version =  {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.176178 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] oslo_messaging_notifications.driver = [] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.176458 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] oslo_messaging_notifications.retry = -1 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.176766 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.177064 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] oslo_messaging_notifications.transport_url = **** {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:16.177281 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}}
May 20 04:13:16.177526 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo.service.wsgi [-] Loading app neutron from /etc/neutron/api-paste.ini {{(pid=91581) load_app /usr/local/lib/python3.8/dist-packages/oslo_service/wsgi.py:349}}
May 20 04:13:16.527462 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=91581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:13:16.527718 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" released by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.001s {{(pid=91581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:13:16.528000 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=91581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:13:16.528329 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.manager [-] Loading core plugin: ml2
May 20 04:13:16.843734 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.securitygroup.SecurityGroup'>> rbac-policy before_create 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:16.843961 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.securitygroup.SecurityGroup'>> rbac-policy before_update 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:16.844166 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.securitygroup.SecurityGroup'>> rbac-policy before_delete 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:16.845500 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_group.AddressGroup'>> rbac-policy before_create 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:16.845768 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_group.AddressGroup'>> rbac-policy before_update 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:16.846029 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_group.AddressGroup'>> rbac-policy before_delete 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:16.971947 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.network.Network'>> rbac-policy before_create 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:16.972231 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.network.Network'>> rbac-policy before_update 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:16.972465 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.network.Network'>> rbac-policy before_delete 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:16.986186 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.qos.policy.QosPolicy'>> rbac-policy before_create 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:16.986453 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.qos.policy.QosPolicy'>> rbac-policy before_update 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:16.986710 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.qos.policy.QosPolicy'>> rbac-policy before_delete 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:17.016327 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.subnetpool.SubnetPool'>> rbac-policy before_create 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:17.016618 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.subnetpool.SubnetPool'>> rbac-policy before_update 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:17.016926 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.subnetpool.SubnetPool'>> rbac-policy before_delete 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:17.057390 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_scope.AddressScope'>> rbac-policy before_create 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:17.057616 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_scope.AddressScope'>> rbac-policy before_update 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:17.057891 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_scope.AddressScope'>> rbac-policy before_delete 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:17.300019 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _update_segment_host_mapping_for_agent at 0x7fced30d5dc0> agent after_create 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:17.300715 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _update_segment_host_mapping_for_agent at 0x7fced30d5dc0> agent after_update 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:17.300715 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _add_segment_host_mapping_for_segment at 0x7fced30d5ca0> segment precommit_create 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:17.300874 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _delete_segments_for_network at 0x7fced30c8820> network precommit_delete 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:17.301797 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _prevent_segment_delete_with_port_bound at 0x7fced30f08b0> segment before_delete 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:17.428419 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._before_network_delete_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fced39d99a0>> network before_delete 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:17.428714 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function DVRDbMixin._delete_mac_associated_with_agent at 0x7fced3026280> agent before_delete 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:17.429000 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupDbMixin._ensure_default_security_group_handler_net of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fced39d99a0>> network before_create 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:17.429294 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupDbMixin._ensure_default_security_group_handler_port of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fced39d99a0>> port before_create 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:17.429557 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupDbMixin._ensure_default_security_group_handler_port of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fced39d99a0>> port before_update 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:17.429857 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fced39d99a0>> segment precommit_create 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:17.430110 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fced39d99a0>> segment precommit_delete 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:17.430359 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fced39d99a0>> segment after_create 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:17.430604 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fced39d99a0>> segment after_delete 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:17.430876 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._network_delete_after_delete_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fced39d99a0>> network after_delete 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:17.431130 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._network_delete_precommit_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fced39d99a0>> network precommit_delete 0 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:17.431374 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._port_provisioned of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fced39d99a0>> port provisioning_complete 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:17.431624 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._process_ext_policy_create of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fced39d99a0>> rbac-policy before_create 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:17.431867 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._process_ext_policy_delete of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fced39d99a0>> rbac-policy after_delete 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:17.432457 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._retry_binding_revived_agents of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fced39d99a0>> agent after_update 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:17.432739 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._subnet_delete_after_delete_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fced39d99a0>> subnet after_delete 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:17.433020 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._subnet_delete_precommit_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fced39d99a0>> subnet precommit_delete 0 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:17.433450 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._validate_ext_not_in_use_by_tenant of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fced39d99a0>> rbac-policy before_update 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:17.433704 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._validate_ext_not_in_use_by_tenant of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fced39d99a0>> rbac-policy before_delete 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:17.433980 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method DhcpAgentSchedulerDbMixin.auto_schedule_new_network_segments of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fced39d99a0>> segment_host_mapping after_create 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:17.434331 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fced39d99a0>> port after_create 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:17.434577 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fced39d99a0>> port after_update 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:17.434824 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fced39d99a0>> port after_delete 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:17.435102 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fced39d99a0>> rbac-policy before_create 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:17.435349 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fced39d99a0>> rbac-policy before_update 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:17.435602 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fced39d99a0>> rbac-policy before_delete 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:17.435994 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=91581) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
May 20 04:13:17.436232 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=91581) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
May 20 04:13:17.436462 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=91581) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
May 20 04:13:17.436678 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=91581) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
May 20 04:13:17.436908 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=91581) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
May 20 04:13:17.437167 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=91581) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
May 20 04:13:17.437529 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve']
May 20 04:13:17.440990 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['physnet1']
May 20 04:13:17.444857 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete
May 20 04:13:17.448711 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict([('physnet1', [(850, 899)])])
May 20 04:13:17.450344 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan']
May 20 04:13:17.450803 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan'])
May 20 04:13:17.451125 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.plugins.ml2.managers [-] Tenant network_types: ['vlan']
May 20 04:13:17.451511 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security']
May 20 04:13:17.454539 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security']
May 20 04:13:17.454789 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security']
May 20 04:13:17.455132 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['openvswitch', 'hyperv']
May 20 04:13:17.486236 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.plugins.ml2.drivers.openvswitch.mech_driver.mech_openvswitch [-] Open vSwitch agent's supported_vnic_types: ['normal', 'direct', 'smart-nic', 'vdpa']
May 20 04:13:17.486698 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method DriverBase._register of <neutron.services.qos.drivers.openvswitch.driver.OVSDriver object at 0x7fced30aa910>> qos_plugin after_init 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:17.486987 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.services.qos.drivers.openvswitch.driver [-] Open vSwitch QoS driver registered {{(pid=91581) register /opt/stack/neutron/neutron/services/qos/drivers/openvswitch/driver.py:82}}
May 20 04:13:17.487351 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method DriverBase._register of <neutron.services.logapi.drivers.openvswitch.driver.OVSDriver object at 0x7fced30aa370>> logging-plugin after_init 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:17.488746 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.services.logapi.drivers.openvswitch.driver [-] Open vSwitch logging driver registered {{(pid=91581) register /opt/stack/neutron/neutron/services/logapi/drivers/openvswitch/driver.py:69}}
May 20 04:13:17.489068 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['openvswitch', 'hyperv']
May 20 04:13:17.489312 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['openvswitch', 'hyperv']
May 20 04:13:17.492690 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Notifier._send_nova_notification of <neutron.notifiers.nova.Notifier object at 0x7fced31c6f70>> floatingip before_response 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:17.493098 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Notifier._send_nova_notification of <neutron.notifiers.nova.Notifier object at 0x7fced31c6f70>> port before_response 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:17.557607 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat'
May 20 04:13:17.557808 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete
May 20 04:13:17.557976 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve'
May 20 04:13:17.558367 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 1000)]
May 20 04:13:17.590972 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_db.sqlalchemy.engines [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91581) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
May 20 04:13:17.927518 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.plugins.ml2.managers [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Initializing driver for type 'gre'
May 20 04:13:17.928197 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] gre ID ranges: [(1, 1000)]
May 20 04:13:17.985551 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.plugins.ml2.managers [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Initializing driver for type 'local'
May 20 04:13:17.985935 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.plugins.ml2.managers [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Initializing driver for type 'vlan'
May 20 04:13:17.997886 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] VlanTypeDriver initialization complete
May 20 04:13:17.998437 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.plugins.ml2.managers [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Initializing driver for type 'vxlan'
May 20 04:13:17.998931 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] vxlan ID ranges: [(1, 1000)]
May 20 04:13:18.060875 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.plugins.ml2.managers [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Initializing extension driver 'port_security'
May 20 04:13:18.061279 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.plugins.ml2.extensions.port_security [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] PortSecurityExtensionDriver initialization complete
May 20 04:13:18.061687 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.plugins.ml2.managers [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Initializing mechanism driver 'openvswitch'
May 20 04:13:18.062057 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.plugins.ml2.managers [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Initializing mechanism driver 'hyperv'
May 20 04:13:18.068944 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.plugins.ml2.plugin [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=91581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:13:18.069746 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fced2e92d30>> port after_create 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.070125 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fced2e92d30>> port after_update 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.070478 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fced2e92d30>> port after_delete 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.070878 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fced31ed0d0>> subnet after_create 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.071236 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fced31ed0d0>> subnet after_update 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.071587 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fced31ed0d0>> subnet after_delete 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.071970 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <bound method _ObjectChangeHandler.handle_payload_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fced2a4ff10>> network after_create 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.072319 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <bound method _ObjectChangeHandler.handle_payload_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fced2a4ff10>> network after_update 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.072662 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <bound method _ObjectChangeHandler.handle_payload_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fced2a4ff10>> network after_delete 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.073073 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fced2a4ffa0>> security_group after_create 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.073420 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fced2a4ffa0>> security_group after_update 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.073761 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fced2a4ffa0>> security_group after_delete 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.074143 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fced2a55430>> security_group_rule after_create 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.074489 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fced2a55430>> security_group_rule after_update 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.074832 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fced2a55430>> security_group_rule after_delete 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.075209 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fced2a556a0>> address_group after_create 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.075551 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fced2a556a0>> address_group after_update 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.075889 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fced2a556a0>> address_group after_delete 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.076226 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] ML2 OVO RPC backend initialized. {{(pid=91581) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:160}}
May 20 04:13:18.076968 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <bound method DhcpAgentNotifyAPI._after_router_interface_created of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fced2a55a90>> router_interface after_create 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.077330 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <bound method DhcpAgentNotifyAPI._after_router_interface_deleted of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fced2a55a90>> router_interface after_delete 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.077746 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fced2a55a90>> network before_response 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.078091 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fced2a55a90>> networks before_response 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.078434 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fced2a55a90>> port before_response 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.078774 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fced2a55a90>> ports before_response 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.079126 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fced2a55a90>> subnet before_response 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.079572 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fced2a55a90>> subnets before_response 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.079924 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fced2a55a90>> network after_create 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.080263 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fced2a55a90>> network after_update 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.080645 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fced2a55a90>> network after_delete 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.081006 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fced2a55a90>> port after_create 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.081349 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fced2a55a90>> port after_update 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.081687 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fced2a55a90>> port after_delete 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.082028 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fced2a55a90>> subnet after_create 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.082366 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fced2a55a90>> subnet after_update 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.082703 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fced2a55a90>> subnet after_delete 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.083307 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.plugins.ml2.plugin [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Modular L2 Plugin initialization complete
May 20 04:13:18.083648 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading services supported by the core plugin {{(pid=91581) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:168}}
May 20 04:13:18.083975 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.plugins.ml2.managers [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Got port-security extension from driver 'port_security'
May 20 04:13:18.084442 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.extensions.vlantransparent [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Disabled vlantransparent extension.
May 20 04:13:18.084939 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading service plugins: ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=91581) _load_service_plugins /opt/stack/neutron/neutron/manager.py:194}}
May 20 04:13:18.085275 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading Plugin: router
May 20 04:13:18.123158 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <bound method DVRResourceOperationHandler._add_csnat_on_interface_create of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fced2a55bb0>> router_interface before_create 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.123556 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._after_router_create of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fced2a55bb0>> router after_create 55549900 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.123935 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._before_router_create of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fced2a55bb0>> router before_create 55549900 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.124309 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <bound method DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fced2a55bb0>> router_interface before_delete 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.124679 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <bound method DVRResourceOperationHandler._cleanup_after_interface_removal of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fced2a55bb0>> router_interface after_delete 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.125045 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._cleanup_ha_network of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fced2a55bb0>> router after_delete 55549900 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.125408 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <bound method DVRResourceOperationHandler._create_dvr_floating_gw_port of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fced2a55bb0>> floatingip after_update 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.125773 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <bound method DVRResourceOperationHandler._create_snat_interfaces_after_change of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fced2a55bb0>> router after_create 55549900 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.126173 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <bound method DVRResourceOperationHandler._create_snat_interfaces_after_change of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fced2a55bb0>> router after_update 55549900 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.126534 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <bound method DVRResourceOperationHandler._delete_distributed_port_bindings_after_change of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fced2a55bb0>> router after_update 55549900 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.126885 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <bound method DVRResourceOperationHandler._delete_dvr_internal_ports of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fced2a55bb0>> router_gateway after_delete 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.127248 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <bound method DVRResourceOperationHandler._delete_snat_interfaces_after_change of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fced2a55bb0>> router after_update 55549900 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.127662 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <bound method DVRResourceOperationHandler._handle_distributed_migration of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fced2a55bb0>> router precommit_update 55549900 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.128031 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <function L3RpcNotifierMixin._notify_gateway_port_ip_changed at 0x7fced305daf0> port after_update 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.128371 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <function L3RpcNotifierMixin._notify_routers_callback at 0x7fced305db80> port after_delete 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.128707 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <function L3RpcNotifierMixin._notify_subnet_gateway_ip_update at 0x7fced305da60> subnet after_update 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.129070 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <function L3RpcNotifierMixin._notify_subnetpool_address_scope_update at 0x7fced305d700> subnetpool_address_scope after_update 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.129405 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <bound method L3_NAT_dbonly_mixin._precommit_delete_port_callback of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fced2a55bb0>> port precommit_delete 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.129759 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._precommit_router_create of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fced2a55bb0>> router precommit_create 55549900 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.130103 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <function L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback at 0x7fced3054670> port before_delete 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.130452 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <bound method RouterAvailabilityZoneMixin._process_az_request of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fced2a55bb0>> router precommit_create 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.130881 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._reconfigure_ha_resources of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fced2a55bb0>> router after_update 55549900 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.131147 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._release_router_vr_id of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fced2a55bb0>> router precommit_delete 55549900 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.131492 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <bound method DVRResourceOperationHandler._set_distributed_flag of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fced2a55bb0>> router precommit_create 55549900 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.131855 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <bound method DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fced2a55bb0>> router_interface after_create 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.132200 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._validate_migration of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fced2a55bb0>> router precommit_update 55549900 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.132580 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <bound method DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fced2a55bb0>> network after_delete 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.133568 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.quota.resource_registry [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Tracking information for resource: router configured {{(pid=91581) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
May 20 04:13:18.133898 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.quota.resource_registry [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Tracking information for resource: floatingip configured {{(pid=91581) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
May 20 04:13:18.139354 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.db.l3_agentschedulers_db [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Skipping period L3 agent status check because automatic router rescheduling is disabled.
May 20 04:13:18.139962 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <function _notify_l3_agent_port_update at 0x7fced2a0c0d0> port after_update 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.140330 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <function _notify_l3_agent_new_port at 0x7fced2a01f70> port after_create 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.140687 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <function _notify_port_delete at 0x7fced2a0c040> port after_delete 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.141039 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <function _notify_l3_agent_ha_port_update at 0x7fced2a0c3a0> port after_update 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.141950 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <bound method DriverController._check_router_request of <neutron.services.l3_router.service_providers.driver_controller.DriverController object at 0x7fced2a383a0>> router before_create 55550100 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.142322 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <bound method DriverController._clear_router_provider of <neutron.services.l3_router.service_providers.driver_controller.DriverController object at 0x7fced2a383a0>> router precommit_delete 55550100 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.142684 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <bound method DriverController._set_router_provider of <neutron.services.l3_router.service_providers.driver_controller.DriverController object at 0x7fced2a383a0>> router precommit_create 55550100 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.143040 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <bound method DriverController._update_router_provider of <neutron.services.l3_router.service_providers.driver_controller.DriverController object at 0x7fced2a383a0>> router precommit_update 55550100 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.147700 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.services.provider_configuration [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Service providers = [] {{(pid=91581) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:171}}
May 20 04:13:18.148072 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.db.servicetype_db [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=91581) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:42}}
May 20 04:13:18.151245 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.services.service_base [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded 'neutron.services.l3_router.service_providers.dvrha.DvrHaDriver' provider for service L3_ROUTER_NAT {{(pid=91581) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}}
May 20 04:13:18.151623 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.services.service_base [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded 'neutron.services.l3_router.service_providers.dvr.DvrDriver' provider for service L3_ROUTER_NAT {{(pid=91581) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}}
May 20 04:13:18.151969 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.services.service_base [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded 'neutron.services.l3_router.service_providers.ha.HaDriver' provider for service L3_ROUTER_NAT {{(pid=91581) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}}
May 20 04:13:18.152862 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.services.service_base [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded 'neutron.services.l3_router.service_providers.single_node.SingleNodeDriver' provider for service L3_ROUTER_NAT {{(pid=91581) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}}
May 20 04:13:18.153269 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.services.service_base [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Default provider is not specified for service type L3_ROUTER_NAT
May 20 04:13:18.153883 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding between (L2) Neutron networks and access to external networks via a NAT gateway. {{(pid=91581) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
May 20 04:13:18.154205 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading Plugin: neutron.services.metering.metering_plugin.MeteringPlugin
May 20 04:13:18.165465 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Successfully loaded METERING plugin. Description: METERING {{(pid=91581) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
May 20 04:13:18.165773 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading Plugin: auto_allocate
May 20 04:13:18.172252 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <function _ensure_external_network_default_value_callback at 0x7fced29cd700> network precommit_update 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.172633 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <function _ensure_external_network_default_value_callback at 0x7fced29cd700> network precommit_create 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.173265 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=91581) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
May 20 04:13:18.173591 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading Plugin: tag
May 20 04:13:18.180828 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=91581) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
May 20 04:13:18.181203 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading Plugin: timestamp
May 20 04:13:18.185321 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=91581) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
May 20 04:13:18.185659 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading Plugin: network_ip_availability
May 20 04:13:18.191412 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7fced29cb9d0>> rbac-policy before_create 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.191789 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7fced29cb9d0>> rbac-policy before_update 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.192121 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7fced29cb9d0>> rbac-policy before_delete 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.192942 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=91581) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
May 20 04:13:18.193309 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading Plugin: flavors
May 20 04:13:18.198609 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=91581) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
May 20 04:13:18.198944 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading Plugin: revisions
May 20 04:13:18.203433 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=91581) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
May 20 04:13:18.203832 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_concurrency.lockutils [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Lock "manager" released by "neutron.manager.NeutronManager._create_instance" :: held 1.676s {{(pid=91581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:13:18.204665 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] get_extension_paths = OrderedDict([('/opt/stack/neutron/neutron/extensions', 1)]) {{(pid=91581) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:635}}
May 20 04:13:18.204990 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Initializing extension manager.
May 20 04:13:18.205505 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: __init__.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.205847 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: __pycache__ {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.206184 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: _standard_attr_segment_lib.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.206522 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: address_group.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.207351 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Address group" alias="address-group" description="Support address group" updated="2020-07-15T10:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.207960 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: address-group
May 20 04:13:18.208285 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: address_scope.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.209048 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.209578 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: address-scope
May 20 04:13:18.209901 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: admin_state_down_before_update.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.210929 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is DOWN (admin_state_up=False) before updating the distributed attribute" updated="2019-07-02T15:56:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.211436 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: router-admin-state-down-before-update
May 20 04:13:18.211760 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: agent.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.212479 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.212999 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: agent
May 20 04:13:18.213344 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: agent_resources_synced.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.214298 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.214800 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: agent-resources-synced
May 20 04:13:18.215123 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: allowedaddresspairs.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.216995 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.217529 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: allowed-address-pairs
May 20 04:13:18.217856 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: auto_allocated_topology.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.218956 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.219479 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: auto-allocated-topology
May 20 04:13:18.219834 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: availability_zone.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.220577 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.221132 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: availability_zone
May 20 04:13:18.221455 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: availability_zone_filter.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.222371 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.222877 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: availability_zone_filter
May 20 04:13:18.223199 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: data_plane_status.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.224095 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.224599 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extension data-plane-status not supported by any of loaded plugins
May 20 04:13:18.224923 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: default_subnetpools.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.225871 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.226367 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: default-subnetpools
May 20 04:13:18.226692 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: dhcpagentscheduler.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.227530 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.228041 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: dhcp_agent_scheduler
May 20 04:13:18.228366 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: dns.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.229303 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.229802 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extension dns-integration not supported by any of loaded plugins
May 20 04:13:18.230127 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: dns_domain_ports.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.231025 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.231529 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extension dns-domain-ports not supported by any of loaded plugins
May 20 04:13:18.231851 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: dvr.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.232518 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.233047 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: dvr
May 20 04:13:18.233387 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: empty_string_filtering.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.234274 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.234774 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: empty-string-filtering
May 20 04:13:18.235093 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.236020 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.236521 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins
May 20 04:13:18.236839 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.237779 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.238276 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins
May 20 04:13:18.238595 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: external_net.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.239493 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.240070 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: external-net
May 20 04:13:18.240312 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: extra_dhcp_opt.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.241250 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.241752 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: extra_dhcp_opt
May 20 04:13:18.242083 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: extraroute.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.242968 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.243484 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: extraroute
May 20 04:13:18.243803 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: extraroute_atomic.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.244843 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.245396 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: extraroute-atomic
May 20 04:13:18.245720 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: filter_validation.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.246386 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-07-04T10:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.246901 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: filter-validation
May 20 04:13:18.247219 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: fip_pf_description.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.248358 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.248882 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins
May 20 04:13:18.249233 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: fip_port_details.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.250149 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.250668 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: fip-port-details
May 20 04:13:18.250984 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: flavors.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.252298 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.252814 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: flavors
May 20 04:13:18.253172 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.254857 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.255384 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins
May 20 04:13:18.255711 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: floatingip_pools.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.256434 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.256925 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: floatingip-pools
May 20 04:13:18.257288 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: ip_allocation.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.258197 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.258702 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extension ip_allocation not supported by any of loaded plugins
May 20 04:13:18.259031 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: ip_substring_port_filtering.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.259942 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.260445 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: ip-substring-filtering
May 20 04:13:18.260767 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: l2_adjacency.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.261718 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.262222 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extension l2_adjacency not supported by any of loaded plugins
May 20 04:13:18.262544 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: l3.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.263558 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.264076 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: router
May 20 04:13:18.264393 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: l3_conntrack_helper.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.266793 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.267324 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extension l3-conntrack-helper not supported by any of loaded plugins
May 20 04:13:18.267662 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: l3_ext_gw_mode.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.268594 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.269147 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: ext-gw-mode
May 20 04:13:18.269480 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: l3_ext_ha_mode.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.270388 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.270898 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: l3-ha
May 20 04:13:18.271226 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: l3_flavors.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.272132 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.272637 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: l3-flavors
May 20 04:13:18.272995 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.273922 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.274430 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: l3-port-ip-change-not-allowed
May 20 04:13:18.274755 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: l3agentscheduler.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.275820 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.276344 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: l3_agent_scheduler
May 20 04:13:18.276677 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: logging.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.278234 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.278749 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extension logging not supported by any of loaded plugins
May 20 04:13:18.279085 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: metering.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.279843 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.280418 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: metering
May 20 04:13:18.280745 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: metering_source_and_destination_fields.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.281870 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Neutron Metering with source and destination filtering" alias="metering_source_and_destination_fields" description="Neutron Metering extension that enables the use of source and destination IP prefixes to create metering label rules." updated="2020-08-21T08:12:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.282461 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: metering_source_and_destination_fields
May 20 04:13:18.282787 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: multiprovidernet.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.283857 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.284364 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: multi-provider
May 20 04:13:18.284686 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: netmtu.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.285626 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.286149 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: net-mtu
May 20 04:13:18.286456 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: netmtu_writable.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.287358 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.287858 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: net-mtu-writable
May 20 04:13:18.288179 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: network_availability_zone.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.288853 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.289386 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: network_availability_zone
May 20 04:13:18.289704 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: network_ip_availability.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.290803 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.291312 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: network-ip-availability
May 20 04:13:18.291636 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: network_segment_range.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.292799 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.293341 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extension network-segment-range not supported by any of loaded plugins
May 20 04:13:18.293663 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: pagination.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.294686 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.295007 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: pagination
May 20 04:13:18.295326 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: port_device_profile.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.296235 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Port device profile" alias="port-device-profile" description="Expose the port device profile (Cyborg)" updated="2020-12-17T10:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.296756 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: port-device-profile
May 20 04:13:18.297193 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: port_mac_address_regenerate.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.298251 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.298766 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: port-mac-address-regenerate
May 20 04:13:18.299092 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: port_numa_affinity_policy.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.300012 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Port NUMA affinity policy" alias="port-numa-affinity-policy" description="Expose the port NUMA affinity policy" updated="2020-07-08T10:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.300523 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: port-numa-affinity-policy
May 20 04:13:18.301459 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: port_resource_request.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.301756 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.302261 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extension port-resource-request not supported by any of loaded plugins
May 20 04:13:18.302578 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: portbindings.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.303506 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.304013 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: binding
May 20 04:13:18.304330 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: portbindings_extended.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.305667 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.306176 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: binding-extended
May 20 04:13:18.306502 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: portsecurity.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.307421 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.307923 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: port-security
May 20 04:13:18.308246 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: project_id.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.309255 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.309653 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: project-id
May 20 04:13:18.309975 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: providernet.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.310909 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.311425 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: provider
May 20 04:13:18.311750 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: qos.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.315466 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.315996 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extension qos not supported by any of loaded plugins
May 20 04:13:18.316332 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: qos_bw_limit_direction.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.317660 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.318175 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extension qos-bw-limit-direction not supported by any of loaded plugins
May 20 04:13:18.318505 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.319419 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.319930 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins
May 20 04:13:18.320258 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: qos_default.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.321185 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.321697 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extension qos-default not supported by any of loaded plugins
May 20 04:13:18.322026 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: qos_fip.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.322682 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.323186 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extension qos-fip not supported by any of loaded plugins
May 20 04:13:18.323507 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: qos_gateway_ip.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.324427 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.324937 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extension qos-gateway-ip not supported by any of loaded plugins
May 20 04:13:18.325285 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: qos_port_network_policy.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.326198 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.326704 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extension qos-port-network-policy not supported by any of loaded plugins
May 20 04:13:18.327031 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: qos_rule_type_details.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.327937 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.328445 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extension qos-rule-type-details not supported by any of loaded plugins
May 20 04:13:18.328770 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: qos_rules_alias.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.329895 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.330405 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extension qos-rules-alias not supported by any of loaded plugins
May 20 04:13:18.330732 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: quotasv2.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.331873 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per tenant" updated="2012-07-29T10:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.332210 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: quotas
May 20 04:13:18.332539 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: quotasv2_detail.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.334229 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.334576 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: quota_details
May 20 04:13:18.334912 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: rbac.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.335988 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control tenant access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.336532 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: rbac-policies
May 20 04:13:18.336864 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: rbac_address_group.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.337835 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Add address_group type to RBAC" alias="rbac-address-group" description="Add address_group type to network RBAC" updated="2021-01-20T00:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.338362 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: rbac-address-group
May 20 04:13:18.338683 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: rbac_address_scope.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.339635 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.340155 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: rbac-address-scope
May 20 04:13:18.340485 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: rbac_security_groups.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.341465 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.341986 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: rbac-security-groups
May 20 04:13:18.342313 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: rbac_subnetpool.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.343273 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.343796 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: rbac-subnetpool
May 20 04:13:18.344119 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: revisionifmatch.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.345174 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.345706 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: revision-if-match
May 20 04:13:18.346031 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: revisions.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.347253 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.347792 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: standard-attr-revisions
May 20 04:13:18.348117 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: router_availability_zone.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.348862 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.349412 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: router_availability_zone
May 20 04:13:18.349736 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: routerservicetype.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.350740 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.351264 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extension router-service-type not supported by any of loaded plugins
May 20 04:13:18.351589 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: security_groups_normalized_cidr.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.352546 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Normalized CIDR field for security group rules" alias="security-groups-normalized-cidr" description="Add new field with normalized remote_ip_prefix cidr in SG rule" updated="2020-07-28T10:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.353106 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: security-groups-normalized-cidr
May 20 04:13:18.353433 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: security_groups_port_filtering.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.354398 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.354923 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: port-security-groups-filtering
May 20 04:13:18.355244 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: security_groups_remote_address_group.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.356200 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Remote address group id field for security group rules" alias="security-groups-remote-address-group" description="Add new field of remote address group id in SG rules" updated="2020-08-25T10:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.356733 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: security-groups-remote-address-group
May 20 04:13:18.357105 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: securitygroup.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.367606 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.368197 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: security-group
May 20 04:13:18.368538 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: segment.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.369534 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.370069 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extension segment not supported by any of loaded plugins
May 20 04:13:18.370409 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.371495 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.372034 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins
May 20 04:13:18.372366 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: servicetype.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.373636 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.374171 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: service-type
May 20 04:13:18.374502 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: sorting.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.375547 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.375881 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: sorting
May 20 04:13:18.376288 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: standard_attr_segment.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.377277 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.377828 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extension standard-attr-segment not supported by any of loaded plugins
May 20 04:13:18.378184 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: standardattrdescription.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.378848 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.379368 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: standard-attr-description
May 20 04:13:18.379675 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: stateful_security_group.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.380629 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.381247 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: stateful-security-group
May 20 04:13:18.381501 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: stdattrs_common.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.382091 dv-cinder-790910-4-iscsi neutron-server[91581]: WARNING neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py
May 20 04:13:18.382409 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.383423 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.383952 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extension subnet-dns-publish-fixed-ip not supported by any of loaded plugins
May 20 04:13:18.384276 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: subnet_onboard.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.385422 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.385937 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: subnet_onboard
May 20 04:13:18.386270 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: subnet_segmentid_writable.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.387182 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.387690 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extension subnet-segmentid-writable not supported by any of loaded plugins
May 20 04:13:18.388014 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: subnet_service_types.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.388946 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.389478 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: subnet-service-types
May 20 04:13:18.389803 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: subnetallocation.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.390884 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.391394 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: subnet_allocation
May 20 04:13:18.391785 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.392461 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.393008 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: subnetpool-prefix-ops
May 20 04:13:18.393400 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.394333 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.394839 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins
May 20 04:13:18.395187 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: tagging.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.396285 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, security_group, router, floatingip, policy, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.396814 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: standard-attr-tag
May 20 04:13:18.397168 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: timestamp.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.398398 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.398923 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loaded extension: standard-attr-timestamp
May 20 04:13:18.399258 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: trunk.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.400303 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.400828 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extension trunk not supported by any of loaded plugins
May 20 04:13:18.401184 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: trunk_details.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.402098 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.402617 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extension trunk-details not supported by any of loaded plugins
May 20 04:13:18.402950 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: uplink_status_propagation.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.403857 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.404374 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extension uplink-status-propagation not supported by any of loaded plugins
May 20 04:13:18.404696 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Loading extension file: vlantransparent.py {{(pid=91581) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 20 04:13:18.405399 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=91581) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 20 04:13:18.405905 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extension vlan-transparent not supported by any of loaded plugins
May 20 04:13:18.408705 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.quota.resource_registry [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Creating instance of TrackedResource for resource:network
May 20 04:13:18.409513 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.quota.resource_registry [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Creating instance of TrackedResource for resource:subnet
May 20 04:13:18.410333 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.quota.resource_registry [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Creating instance of TrackedResource for resource:subnetpool
May 20 04:13:18.410944 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.quota.resource_registry [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Creating instance of TrackedResource for resource:port
May 20 04:13:18.412288 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.v2.resource_helper [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=91581) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 20 04:13:18.412745 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.v2.resource_helper [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Service FLAVORS assigned prefix:  {{(pid=91581) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 20 04:13:18.413436 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.v2.resource_helper [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=91581) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 20 04:13:18.413838 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.v2.resource_helper [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=91581) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 20 04:13:18.414170 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.quota.resource_registry [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Creating instance of TrackedResource for resource:router
May 20 04:13:18.414861 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.quota.resource_registry [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Creating instance of TrackedResource for resource:floatingip
May 20 04:13:18.415570 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.v2.resource_helper [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Service METERING assigned prefix: /metering {{(pid=91581) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 20 04:13:18.417461 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7fced28e5f40>> rbac-policy before_create 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.417842 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7fced28e5f40>> rbac-policy before_update 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.418192 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7fced28e5f40>> rbac-policy before_delete 55550000 {{(pid=91581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:13:18.419404 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.quota.resource_registry [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Creating instance of CountableResource for resource:rbac_policy
May 20 04:13:18.419871 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.quota.resource_registry [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Creating instance of TrackedResource for resource:security_group
May 20 04:13:18.420548 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.quota.resource_registry [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Creating instance of TrackedResource for resource:security_group_rule
May 20 04:13:18.421336 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.v2.resource_helper [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Service CORE assigned prefix:  {{(pid=91581) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 20 04:13:18.421670 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.quota.resource_registry [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Creating instance of TrackedResource for resource:subnetpool
May 20 04:13:18.422011 dv-cinder-790910-4-iscsi neutron-server[91581]: WARNING neutron.quota.resource_registry [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] subnetpool is already registered
May 20 04:13:18.422611 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.v2.resource_helper [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Service CORE assigned prefix:  {{(pid=91581) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 20 04:13:18.422991 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.quota.resource_registry [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Creating instance of TrackedResource for resource:subnetpool
May 20 04:13:18.423346 dv-cinder-790910-4-iscsi neutron-server[91581]: WARNING neutron.quota.resource_registry [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] subnetpool is already registered
May 20 04:13:18.427262 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.v2.resource_helper [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=91581) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 20 04:13:18.427708 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.v2.resource_helper [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Service FLAVORS assigned prefix:  {{(pid=91581) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 20 04:13:18.428302 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.v2.resource_helper [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=91581) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 20 04:13:18.428727 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.v2.resource_helper [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=91581) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 20 04:13:18.429139 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.quota.resource_registry [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Creating instance of TrackedResource for resource:router
May 20 04:13:18.429445 dv-cinder-790910-4-iscsi neutron-server[91581]: WARNING neutron.quota.resource_registry [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] router is already registered
May 20 04:13:18.430130 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.quota.resource_registry [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Creating instance of TrackedResource for resource:floatingip
May 20 04:13:18.430462 dv-cinder-790910-4-iscsi neutron-server[91581]: WARNING neutron.quota.resource_registry [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] floatingip is already registered
May 20 04:13:18.431099 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.v2.resource_helper [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Service METERING assigned prefix: /metering {{(pid=91581) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 20 04:13:18.431796 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.quota.resource_registry [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Creating instance of CountableResource for resource:rbac_policy
May 20 04:13:18.432132 dv-cinder-790910-4-iscsi neutron-server[91581]: WARNING neutron.quota.resource_registry [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] rbac_policy is already registered
May 20 04:13:18.432698 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.quota.resource_registry [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Creating instance of TrackedResource for resource:security_group
May 20 04:13:18.433068 dv-cinder-790910-4-iscsi neutron-server[91581]: WARNING neutron.quota.resource_registry [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] security_group is already registered
May 20 04:13:18.433677 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.quota.resource_registry [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Creating instance of TrackedResource for resource:security_group_rule
May 20 04:13:18.433992 dv-cinder-790910-4-iscsi neutron-server[91581]: WARNING neutron.quota.resource_registry [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] security_group_rule is already registered
May 20 04:13:18.434672 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.v2.resource_helper [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Service CORE assigned prefix:  {{(pid=91581) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 20 04:13:18.435002 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.quota.resource_registry [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Creating instance of TrackedResource for resource:subnetpool
May 20 04:13:18.435327 dv-cinder-790910-4-iscsi neutron-server[91581]: WARNING neutron.quota.resource_registry [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] subnetpool is already registered
May 20 04:13:18.435944 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.v2.resource_helper [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Service CORE assigned prefix:  {{(pid=91581) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 20 04:13:18.436267 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.quota.resource_registry [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Creating instance of TrackedResource for resource:subnetpool
May 20 04:13:18.436589 dv-cinder-790910-4-iscsi neutron-server[91581]: WARNING neutron.quota.resource_registry [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] subnetpool is already registered
May 20 04:13:18.437303 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extended resource: extensions {{(pid=91581) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 04:13:18.438871 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extended resource: address-groups {{(pid=91581) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 04:13:18.440509 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extended resource: address-scopes {{(pid=91581) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 04:13:18.441776 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extended resource: agents {{(pid=91581) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 04:13:18.442987 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extended resource: auto-allocated-topology {{(pid=91581) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 04:13:18.444261 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extended resource: availability_zones {{(pid=91581) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 04:13:18.445641 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extended resource: dhcp-networks {{(pid=91581) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 04:13:18.447114 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extended resource: dhcp-agents {{(pid=91581) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 04:13:18.448562 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extended resource: routers {{(pid=91581) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 04:13:18.450525 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extended resource: flavors {{(pid=91581) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 04:13:18.451717 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extended resource: service_profiles {{(pid=91581) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 04:13:18.452927 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extended resource: next_providers {{(pid=91581) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 04:13:18.454605 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extended resource: service_profiles {{(pid=91581) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 04:13:18.456082 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extended resource: floatingip-pools {{(pid=91581) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 04:13:18.457496 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extended resource: routers {{(pid=91581) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 04:13:18.459369 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extended resource: floatingips {{(pid=91581) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 04:13:18.460583 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extended resource: l3-routers {{(pid=91581) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 04:13:18.462042 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extended resource: l3-agents {{(pid=91581) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 04:13:18.463487 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extended resource: metering-labels {{(pid=91581) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 04:13:18.464888 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extended resource: metering-label-rules {{(pid=91581) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 04:13:18.466216 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extended resource: network-ip-availabilities {{(pid=91581) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 04:13:18.467488 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extended resource: bindings {{(pid=91581) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 04:13:18.469261 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extended resource: quotas {{(pid=91581) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 04:13:18.470750 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extended resource: quotas {{(pid=91581) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 04:13:18.472242 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extended resource: rbac-policies {{(pid=91581) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 04:13:18.473561 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extended resource: security-groups {{(pid=91581) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 04:13:18.474798 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extended resource: security-group-rules {{(pid=91581) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 04:13:18.476064 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extended resource: service-providers {{(pid=91581) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 04:13:18.477351 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extended resource: subnetpools {{(pid=91581) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 04:13:18.478773 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extended resource: subnetpools {{(pid=91581) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 04:13:18.480273 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extended resource: tags {{(pid=91581) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 04:13:18.482088 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extended resource: tags {{(pid=91581) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 04:13:18.483934 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extended resource: tags {{(pid=91581) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 04:13:18.485844 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extended resource: tags {{(pid=91581) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 04:13:18.489105 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extended resource: tags {{(pid=91581) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 04:13:18.491055 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extended resource: tags {{(pid=91581) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 04:13:18.492787 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extended resource: tags {{(pid=91581) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 04:13:18.612766 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extended resource: tags {{(pid=91581) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 04:13:18.614613 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extended resource: tags {{(pid=91581) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 04:13:18.616469 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron.api.extensions [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Extended resource: tags {{(pid=91581) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 20 04:13:18.622580 dv-cinder-790910-4-iscsi neutron-server[91581]: WARNING keystonemiddleware.auth_token [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True.
May 20 04:13:18.627504 dv-cinder-790910-4-iscsi neutron-server[91581]: WARNING keystonemiddleware.auth_token [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
May 20 04:13:18.636303 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_concurrency.lockutils [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Acquired lock "singleton_lock" {{(pid=91581) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}}
May 20 04:13:18.636722 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_concurrency.lockutils [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Releasing lock "singleton_lock" {{(pid=91581) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}}
May 20 04:13:18.637439 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO oslo_service.service [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Starting 2 workers
May 20 04:13:18.642213 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Started child 91686 {{(pid=91581) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}}
May 20 04:13:18.646781 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Started child 91687 {{(pid=91581) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}}
May 20 04:13:18.648363 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO neutron.service [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Neutron service started, listening on 0.0.0.0:9696
May 20 04:13:18.648700 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:13:18.649795 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Notify callbacks [] for process, before_spawn {{(pid=91581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:13:18.650873 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [-] (91686) wsgi starting up on http://0.0.0.0:9696
May 20 04:13:18.651551 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO oslo_service.service [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Starting 1 workers
May 20 04:13:18.653238 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:13:18.654713 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [-] (91687) wsgi starting up on http://0.0.0.0:9696
May 20 04:13:18.656622 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Started child 91688 {{(pid=91581) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}}
May 20 04:13:18.657293 dv-cinder-790910-4-iscsi neutron-server[91581]: INFO oslo_service.service [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Starting 1 workers
May 20 04:13:18.661705 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Started child 91689 {{(pid=91581) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}}
May 20 04:13:18.662485 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG neutron_lib.callbacks.manager [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] Notify callbacks [] for process, after_spawn {{(pid=91581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:13:18.662903 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.service [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] calling RpcWorker wait() {{(pid=91688) _wait /opt/stack/neutron/neutron/service.py:128}}
May 20 04:13:18.663728 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.service [None req-b8733282-c981-4115-82d5-7c8a3db3cf70 None None] returning from RpcWorker wait() {{(pid=91688) _wait /opt/stack/neutron/neutron/service.py:135}}
May 20 04:13:18.664351 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=91581) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:650}}
May 20 04:13:18.664557 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}}
May 20 04:13:18.664923 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}}
May 20 04:13:18.665151 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}}
May 20 04:13:18.665417 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:13:18.665621 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}}
May 20 04:13:18.665945 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}}
May 20 04:13:18.666100 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [-] neutron.plugins.ml2.plugin.Ml2Plugin method start_rpc_listeners called with arguments () {} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:13:18.666446 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] agent_down_time                = 75 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.666722 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover  = True {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.667344 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.667610 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] allow_bulk                     = True {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.667904 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] allow_overlapping_ips          = True {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.668483 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] allowed_conntrack_helpers      = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.668739 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] api_extensions_path            =  {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.669015 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] api_paste_config               = api-paste.ini {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.669297 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] api_workers                    = 2 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.669553 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] auth_strategy                  = keystone {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.669745 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] backdoor_port                  = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.669938 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=91689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:13:18.670858 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] backdoor_socket                = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.670858 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] backlog                        = 4096 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.670858 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] base_mac                       = fa:16:3e:00:00:00 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.670858 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] bind_host                      = 0.0.0.0 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.671629 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] bind_port                      = 9696 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.671629 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] client_socket_timeout          = 900 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.671629 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] config_dir                     = [] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.671629 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] config_file                    = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.672442 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] config_source                  = [] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.672442 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] control_exchange               = neutron {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.672442 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] core_plugin                    = ml2 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.673151 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] debug                          = True {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.673151 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] default_availability_zones     = [] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.673521 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.673727 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] dhcp_agent_notification        = True {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.673914 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] dhcp_agents_per_network        = 1 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.674098 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] dhcp_lease_duration            = 86400 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.674555 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] dhcp_load_type                 = networks {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.674555 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] dns_domain                     = openstacklocal {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.674934 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] dvr_base_mac                   = fa:16:3f:00:00:00 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.675122 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] enable_dvr                     = True {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.675308 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] enable_new_agents              = True {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.675495 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.675758 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] enable_snat_by_default         = True {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.675986 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] enable_traditional_dhcp        = True {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.676201 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] external_dns_driver            = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.676402 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] filter_validation              = True {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.676663 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] global_physnet_mtu             = 1500 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.676905 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] graceful_shutdown_timeout      = 60 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.677400 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] host                           = dv-cinder-790910-4-iscsi {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.677616 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] host_dvr_for_dhcp              = True {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.677807 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] http_retries                   = 3 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.678061 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] instance_format                = [instance: %(uuid)s]  {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.678304 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.678561 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ipam_driver                    = internal {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.678795 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ipv6_pd_enabled                = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.679046 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] l3_ha                          = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.679288 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] l3_ha_net_cidr                 = 169.254.192.0/18 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.679542 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] l3_ha_network_physical_name    =  {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.679768 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] l3_ha_network_type             =  {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.680036 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] log_config_append              = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.680279 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.680509 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] log_dir                        = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.680749 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] log_file                       = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.680940 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] log_options                    = True {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.681156 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] log_rotate_interval            = 1 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.681440 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] log_rotate_interval_type       = days {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.681705 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] log_rotation_type              = none {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.681922 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.682116 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.682307 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.682495 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.682677 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] logging_user_identity_format   = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.682875 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] max_allowed_address_pair       = 10 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.683060 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] max_dns_nameservers            = 5 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.683272 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] max_header_line                = 16384 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.683526 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] max_l3_agents_per_router       = 3 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.683714 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] max_logfile_count              = 30 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.683924 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] max_logfile_size_mb            = 200 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.684181 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] max_routes                     = 30 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.684422 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] max_subnet_host_routes         = 20 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.684927 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] network_auto_schedule          = True {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.684927 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] network_link_prefix            = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.685327 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] network_scheduler_driver       = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.685510 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.685699 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.685883 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] pagination_max_limit           = -1 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.686290 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] periodic_fuzzy_delay           = 5 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.686527 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] periodic_interval              = 40 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.686874 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] publish_errors                 = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.687124 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] rate_limit_burst               = 0 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.687364 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] rate_limit_except_level        = CRITICAL {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.687581 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] rate_limit_interval            = 0 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.687799 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] retry_until_window             = 30 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.688088 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] router_auto_schedule           = True {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.688278 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] router_distributed             = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.689036 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] router_scheduler_driver        = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.689444 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] rpc_response_max_timeout       = 600 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.689444 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] rpc_response_timeout           = 60 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.689881 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] rpc_state_report_workers       = 0 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.689881 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] rpc_workers                    = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.690257 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] send_events_interval           = 2 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.690440 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] service_plugins                = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.690635 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] setproctitle                   = on {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.690905 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] state_path                     = /opt/stack/data/neutron {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.691186 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] syslog_log_facility            = LOG_USER {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.691424 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] tcp_keepidle                   = 600 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.691609 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] transport_url                  = **** {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.691793 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] use_eventlog                   = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.692025 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] use_journal                    = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.692330 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] use_json                       = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.692526 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] use_ssl                        = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.692755 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] use_stderr                     = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.692947 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] use_syslog                     = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.693166 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] vlan_transparent               = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.693456 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] watch_log_file                 = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.693645 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] wsgi_default_pool_size         = 100 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.693853 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] wsgi_keep_alive                = True {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.694044 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] wsgi_log_format                = %(client_ip)s "%(request_line)s" status: %(status_code)s  len: %(body_length)s time: %(wall_seconds).7f {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.694457 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.695128 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path     = /opt/stack/data/neutron/lock {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.695128 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] profiler.connection_string     = messaging:// {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.695471 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] profiler.enabled               = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.695649 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] profiler.es_doc_type           = notification {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.695827 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] profiler.es_scroll_size        = 10000 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.696008 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] profiler.es_scroll_time        = 2m {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.696173 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] profiler.filter_error_trace    = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.696421 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] profiler.hmac_keys             = SECRET_KEY {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.696713 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.697060 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] profiler.socket_timeout        = 0.1 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.697288 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy      = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.697688 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.697879 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope      = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.698117 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.698458 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.698705 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_policy.policy_file        = /etc/neutron/policy.json {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.699047 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.699265 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.699477 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.699748 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.699952 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.700267 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] nova.auth_section              = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.700599 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] nova.auth_type                 = password {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.700814 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] nova.auth_url                  = http://10.222.0.71/identity {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.701088 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] nova.cafile                    = /opt/stack/data/ca-bundle.pem {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.701347 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] nova.certfile                  = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.701703 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] nova.collect_timing            = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.701908 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] nova.default_domain_id         = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.702088 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] nova.default_domain_name       = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.702265 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] nova.domain_id                 = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.702444 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] nova.domain_name               = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.702888 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] nova.endpoint_type             = public {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.703111 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] nova.insecure                  = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.703389 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] nova.keyfile                   = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.703389 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] nova.live_migration_events     = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.703695 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] nova.password                  = **** {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.703833 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] nova.project_domain_id         = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.704128 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] nova.project_domain_name       = Default {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.704520 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] nova.project_id                = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.704718 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] nova.project_name              = service {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.704904 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] nova.region_name               = RegionOne {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.705407 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] nova.split_loggers             = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.705407 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] nova.system_scope              = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.705831 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] nova.timeout                   = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.705831 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] nova.trust_id                  = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.706200 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] nova.user_domain_id            = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.706200 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] nova.user_domain_name          = Default {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.706590 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] nova.user_id                   = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.706767 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] nova.username                  = nova {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.706958 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] placement.auth_section         = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.707135 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] placement.auth_type            = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.707311 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] placement.cafile               = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.707525 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] placement.certfile             = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.707741 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] placement.collect_timing       = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.708040 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] placement.endpoint_type        = public {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.708235 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] placement.insecure             = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.708415 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] placement.keyfile              = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.708590 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] placement.region_name          = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.708921 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] placement.split_loggers        = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.709172 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] placement.timeout              = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.709422 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ironic.auth_section            = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.709635 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ironic.auth_type               = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.709911 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ironic.cafile                  = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.709911 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ironic.certfile                = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.710402 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ironic.collect_timing          = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.710402 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ironic.connect_retries         = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.710809 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ironic.connect_retry_delay     = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.710809 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ironic.enable_notifications    = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.711222 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ironic.endpoint_override       = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.712040 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ironic.insecure                = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.712276 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ironic.interface               = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.712490 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ironic.keyfile                 = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.712703 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ironic.max_version             = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.712932 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ironic.min_version             = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.713158 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ironic.region_name             = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.713326 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ironic.service_name            = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.713496 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ironic.service_type            = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.713700 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ironic.split_loggers           = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.713949 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ironic.status_code_retries     = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.714110 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.714325 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ironic.timeout                 = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.714570 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ironic.valid_interfaces        = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.714791 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ironic.version                 = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.715074 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.715961 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.715961 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.715961 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.716415 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.716415 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.716705 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.716862 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.717054 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.717253 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.717497 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.717769 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.718127 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.718307 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.718464 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.718674 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.718915 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.719150 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.719517 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.719746 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.719925 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.720075 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:13:18.720230 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.720461 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl      = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.720719 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.721041 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.721242 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file =  {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.721498 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version =  {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.721773 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.722025 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.722300 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.722533 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.722787 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.723091 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] QUOTAS.default_quota           = -1 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.723456 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] QUOTAS.quota_driver            = neutron.db.quota.driver.DbQuotaDriver {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.723643 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip        = 50 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.723871 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] QUOTAS.quota_network           = 100 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.724103 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] QUOTAS.quota_port              = 500 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.724356 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy       = 10 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.724605 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] QUOTAS.quota_router            = 100 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.724867 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group    = 100 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.725155 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.725331 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet            = 100 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.725788 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage       = True {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.725986 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.726159 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] healthcheck.backends           = ['disable_by_file'] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.726338 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] healthcheck.detailed           = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.726744 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.726744 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] healthcheck.path               = /healthcheck {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.727078 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.727253 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.727438 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.727670 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user  = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.727922 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix =  {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.728177 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.728566 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port   = 35357 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.729506 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.729753 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.730021 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type   = password {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.730277 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri    = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.730542 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url    = http://10.222.0.71/identity {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.730773 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.731003 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.cache       = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.732332 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.732557 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.certfile    = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.732993 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.733240 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.733461 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.733678 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id   = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.733904 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.734142 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.734392 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.734633 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.734857 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.735068 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.737593 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.insecure    = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.737887 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.interface   = public {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.739126 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile     = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.740853 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.740853 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.740853 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.741403 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.741403 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.741656 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.741817 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.742067 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.742326 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.742595 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.password    = **** {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.742833 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.743086 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.743315 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.project_id  = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.743578 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.743797 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.744101 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.744350 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.744858 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.744858 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.745249 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.746162 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id    = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.746480 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.746935 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.747245 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.user_id     = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.747676 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.username    = neutron {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.748124 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.748673 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] cache.backend                  = dogpile.cache.null {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.749161 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] cache.backend_argument         = **** {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.749607 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] cache.config_prefix            = cache.oslo {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.749996 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] cache.debug_cache_backend      = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.750372 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] cache.enabled                  = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.750734 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] cache.expiration_time          = 600 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.751191 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] cache.memcache_dead_retry      = 300 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.751595 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.751990 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.752392 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize    = 10 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.752782 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.753285 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] cache.memcache_servers         = ['localhost:11211'] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.753700 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout  = 1.0 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.754114 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] cache.proxies                  = [] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.756986 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers      = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.756986 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] cache.tls_cafile               = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.756986 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] cache.tls_certfile             = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.756986 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] cache.tls_enabled              = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.756986 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] cache.tls_keyfile              = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.756986 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] privsep.capabilities           = [21, 12, 1, 2, 19] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.756986 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] privsep.group                  = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.758429 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] privsep.helper_command         = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.758853 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] privsep.thread_pool_size       = 4 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.759244 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] privsep.user                   = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.759668 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.760035 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] privsep_dhcp_release.group     = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.763042 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.763042 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.763042 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] privsep_dhcp_release.user      = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.763042 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.763042 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group        = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.763042 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.763042 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.763042 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user         = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.763918 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.763918 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] privsep_namespace.group        = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.764095 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.764463 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.764851 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] privsep_namespace.user         = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.765309 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.765694 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] privsep_conntrack.group        = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.766066 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.766463 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.766889 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] privsep_conntrack.user         = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.767407 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] AGENT.root_helper              = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.767824 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon       = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.768222 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read   = True {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.768705 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset     = True {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.769129 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.769519 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver  = openvswitch {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.769958 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.770483 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ml2.extension_drivers          = ['port_security'] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.770944 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ml2.external_network_type      = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.771372 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ml2.mechanism_drivers          = ['openvswitch', 'hyperv'] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.771748 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ml2.overlay_ip_version         = 4 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.772168 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ml2.path_mtu                   = 0 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.772573 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ml2.physical_network_mtus      = [] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.773145 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ml2.tenant_network_types       = ['vlan'] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.773923 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ml2.type_drivers               = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.774672 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks    = ['physnet1'] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.775362 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.776043 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges     = ['1:1000'] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.776561 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges  = ['1:1000'] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.777086 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:850:899'] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.777379 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges      = ['1:1000'] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.777745 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group     = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.778219 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.778713 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] database.backend               = sqlalchemy {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.779336 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] database.connection            = **** {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.779679 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] database.connection_debug      = 0 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.780066 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] database.connection_parameters =  {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.780527 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.780925 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] database.connection_trace      = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.781358 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.781760 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] database.db_max_retries        = 20 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.782236 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.782667 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] database.db_retry_interval     = 1 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.783096 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] database.max_overflow          = 50 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.783497 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] database.max_pool_size         = 50 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.783892 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] database.max_retries           = 10 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.784277 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] database.mysql_enable_ndb      = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.784676 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] database.mysql_sql_mode        = TRADITIONAL {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.785664 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] database.pool_timeout          = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.785664 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] database.retry_interval        = 10 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.785865 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] database.slave_connection      = **** {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.786266 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] database.sqlite_synchronous    = True {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.786641 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] database.use_db_reconnect      = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.786925 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}}
May 20 04:13:18.787814 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=91581) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:650}}
May 20 04:13:18.788367 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}}
May 20 04:13:18.788636 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}}
May 20 04:13:18.788923 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}}
May 20 04:13:18.789244 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}}
May 20 04:13:18.789529 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}}
May 20 04:13:18.790030 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] agent_down_time                = 75 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.790466 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover  = True {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.790896 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.791318 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] allow_bulk                     = True {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.791884 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] allow_overlapping_ips          = True {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.792471 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] allowed_conntrack_helpers      = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.792724 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] api_extensions_path            =  {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.793033 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] api_paste_config               = api-paste.ini {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.793327 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] api_workers                    = 2 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.793596 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] auth_strategy                  = keystone {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.793880 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] backdoor_port                  = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.794153 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] backdoor_socket                = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.794429 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] backlog                        = 4096 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.794693 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] base_mac                       = fa:16:3e:00:00:00 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.794950 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] bind_host                      = 0.0.0.0 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.795420 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] bind_port                      = 9696 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.795920 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] client_socket_timeout          = 900 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.796424 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] config_dir                     = [] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.796708 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] config_file                    = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.796994 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] config_source                  = [] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.797271 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] control_exchange               = neutron {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.797566 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] core_plugin                    = ml2 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.798369 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] debug                          = True {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.799517 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] default_availability_zones     = [] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.799872 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.800100 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] dhcp_agent_notification        = True {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.800586 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] dhcp_agents_per_network        = 1 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.800881 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] dhcp_lease_duration            = 86400 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.801223 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] dhcp_load_type                 = networks {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.801524 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] dns_domain                     = openstacklocal {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.801819 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] dvr_base_mac                   = fa:16:3f:00:00:00 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.802111 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] enable_dvr                     = True {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.802399 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] enable_new_agents              = True {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.802673 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.802946 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] enable_snat_by_default         = True {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.803224 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] enable_traditional_dhcp        = True {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.803500 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] external_dns_driver            = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.803798 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] filter_validation              = True {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.804067 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] global_physnet_mtu             = 1500 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.804349 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] graceful_shutdown_timeout      = 60 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.804623 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] host                           = dv-cinder-790910-4-iscsi {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.804896 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] host_dvr_for_dhcp              = True {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.805217 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] http_retries                   = 3 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.805505 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] instance_format                = [instance: %(uuid)s]  {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.805799 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.806081 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ipam_driver                    = internal {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.806363 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ipv6_pd_enabled                = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.806660 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] l3_ha                          = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.806974 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] l3_ha_net_cidr                 = 169.254.192.0/18 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.807223 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] l3_ha_network_physical_name    =  {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.807514 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] l3_ha_network_type             =  {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.807790 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] log_config_append              = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.808081 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.808375 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] log_dir                        = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.808658 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] log_file                       = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.808938 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] log_options                    = True {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.809254 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] log_rotate_interval            = 1 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.809538 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] log_rotate_interval_type       = days {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.809827 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] log_rotation_type              = none {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.810140 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.810439 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.810721 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.811005 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.811277 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] logging_user_identity_format   = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.811546 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] max_allowed_address_pair       = 10 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.811818 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] max_dns_nameservers            = 5 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.812106 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] max_header_line                = 16384 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.812383 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] max_l3_agents_per_router       = 3 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.812651 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] max_logfile_count              = 30 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.812924 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] max_logfile_size_mb            = 200 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.813227 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] max_routes                     = 30 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.813548 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] max_subnet_host_routes         = 20 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.813855 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] network_auto_schedule          = True {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.814130 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] network_link_prefix            = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.814400 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] network_scheduler_driver       = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.814679 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.814959 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.815239 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] pagination_max_limit           = -1 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.815509 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] periodic_fuzzy_delay           = 5 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.815789 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] periodic_interval              = 40 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.816070 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] publish_errors                 = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.816353 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] rate_limit_burst               = 0 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.816647 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] rate_limit_except_level        = CRITICAL {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.816935 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] rate_limit_interval            = 0 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.817260 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] retry_until_window             = 30 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.817536 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] router_auto_schedule           = True {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.817777 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] router_distributed             = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.818077 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] router_scheduler_driver        = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.818302 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] rpc_response_max_timeout       = 600 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.818566 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] rpc_response_timeout           = 60 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.818848 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] rpc_state_report_workers       = 0 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.819119 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] rpc_workers                    = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.819392 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] send_events_interval           = 2 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.819670 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] service_plugins                = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.819951 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] setproctitle                   = on {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.820227 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] state_path                     = /opt/stack/data/neutron {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.820504 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] syslog_log_facility            = LOG_USER {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.820775 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] tcp_keepidle                   = 600 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.821087 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] transport_url                  = **** {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.821359 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] use_eventlog                   = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.821630 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] use_journal                    = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.822008 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] use_json                       = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.822287 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] use_ssl                        = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.822553 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] use_stderr                     = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.823010 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] use_syslog                     = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.823292 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] vlan_transparent               = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.823567 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] watch_log_file                 = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.823841 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] wsgi_default_pool_size         = 100 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.824113 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] wsgi_keep_alive                = True {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.824393 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] wsgi_log_format                = %(client_ip)s "%(request_line)s" status: %(status_code)s  len: %(body_length)s time: %(wall_seconds).7f {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 20 04:13:18.824706 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.825018 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path     = /opt/stack/data/neutron/lock {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.825313 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] profiler.connection_string     = messaging:// {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.825595 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] profiler.enabled               = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.825886 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] profiler.es_doc_type           = notification {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.826162 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] profiler.es_scroll_size        = 10000 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.826429 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] profiler.es_scroll_time        = 2m {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.826707 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] profiler.filter_error_trace    = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.826996 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] profiler.hmac_keys             = SECRET_KEY {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.827286 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.827542 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] profiler.socket_timeout        = 0.1 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.827834 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy      = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.828347 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.828622 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope      = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.828900 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.829255 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.829532 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_policy.policy_file        = /etc/neutron/policy.json {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.829824 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.830110 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.830392 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.830665 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.831016 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.831265 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] nova.auth_section              = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.831541 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] nova.auth_type                 = password {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.831830 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] nova.auth_url                  = http://10.222.0.71/identity {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.832106 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] nova.cafile                    = /opt/stack/data/ca-bundle.pem {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.832397 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] nova.certfile                  = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.832684 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] nova.collect_timing            = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.833051 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] nova.default_domain_id         = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.833292 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] nova.default_domain_name       = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.833553 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] nova.domain_id                 = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.833825 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] nova.domain_name               = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.834101 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] nova.endpoint_type             = public {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.834378 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] nova.insecure                  = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.834886 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] nova.keyfile                   = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.835170 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] nova.live_migration_events     = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.835442 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] nova.password                  = **** {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.835717 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] nova.project_domain_id         = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.835994 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] nova.project_domain_name       = Default {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.836274 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] nova.project_id                = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.836563 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] nova.project_name              = service {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.836834 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] nova.region_name               = RegionOne {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.837144 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] nova.split_loggers             = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.837423 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] nova.system_scope              = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.837703 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] nova.timeout                   = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.837978 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] nova.trust_id                  = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.838339 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] nova.user_domain_id            = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.838580 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] nova.user_domain_name          = Default {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.839193 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] nova.user_id                   = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.839193 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] nova.username                  = nova {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.839448 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] placement.auth_section         = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.839596 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] placement.auth_type            = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.840133 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] placement.cafile               = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.840265 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] placement.certfile             = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.840474 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] placement.collect_timing       = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.840747 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] placement.endpoint_type        = public {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.841203 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] placement.insecure             = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.841485 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] placement.keyfile              = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.841755 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] placement.region_name          = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.842008 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] placement.split_loggers        = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.842277 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] placement.timeout              = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.842601 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ironic.auth_section            = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.842875 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ironic.auth_type               = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.843145 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ironic.cafile                  = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.843423 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ironic.certfile                = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.843706 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ironic.collect_timing          = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.843974 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ironic.connect_retries         = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.844259 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ironic.connect_retry_delay     = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.844543 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ironic.enable_notifications    = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.844896 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ironic.endpoint_override       = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.845218 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ironic.insecure                = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.845508 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ironic.interface               = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.845779 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ironic.keyfile                 = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.846066 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ironic.max_version             = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.846346 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ironic.min_version             = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.846799 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ironic.region_name             = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.846997 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ironic.service_name            = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.847183 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ironic.service_type            = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.847448 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ironic.split_loggers           = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.847734 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ironic.status_code_retries     = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.848004 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.848267 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ironic.timeout                 = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.848602 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ironic.valid_interfaces        = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.848806 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:13:18.849202 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ironic.version                 = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.849202 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.849555 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.849742 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.849972 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.850264 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.850551 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.850835 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.851127 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.851489 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.851680 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.851944 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.852211 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.852493 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.852786 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.853167 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.853356 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.853640 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.853912 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.854201 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.854492 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.854783 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.855064 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.855355 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl      = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.855636 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.855929 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.856217 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file =  {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.856504 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version =  {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.856813 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.857117 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.857401 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.857690 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.857992 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.858291 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] QUOTAS.default_quota           = -1 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.858559 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] QUOTAS.quota_driver            = neutron.db.quota.driver.DbQuotaDriver {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.858834 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip        = 50 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.859107 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] QUOTAS.quota_network           = 100 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.859378 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] QUOTAS.quota_port              = 500 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.859668 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy       = 10 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.859968 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] QUOTAS.quota_router            = 100 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.860264 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group    = 100 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.860590 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.860876 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet            = 100 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.861184 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage       = True {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.861472 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.861782 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] healthcheck.backends           = ['disable_by_file'] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.862065 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] healthcheck.detailed           = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.862342 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.862618 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] healthcheck.path               = /healthcheck {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.862937 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.863222 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.865085 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.865085 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user  = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.865085 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix =  {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.865085 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.865085 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port   = 35357 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.865085 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.866579 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.866579 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type   = password {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.866579 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri    = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.866579 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url    = http://10.222.0.71/identity {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.866579 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.866579 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.cache       = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.867913 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.867913 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.certfile    = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.867913 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.867913 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.867913 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.869557 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id   = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.869557 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.869557 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.869557 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.869557 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.869557 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.870791 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.870791 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.insecure    = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.870791 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.interface   = public {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.870791 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile     = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.870791 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.872028 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.872028 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.872028 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.872622 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.872622 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.873044 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.873044 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.873457 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.873696 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.password    = **** {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.873933 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.874150 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.874321 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.project_id  = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.874591 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.874870 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.875169 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.875558 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.875843 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.876180 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.877020 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.877020 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id    = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.877195 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.877266 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 33412) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:13:18.877341 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.877618 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.user_id     = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.877905 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.username    = neutron {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.878187 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.878482 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] cache.backend                  = dogpile.cache.null {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.878774 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] cache.backend_argument         = **** {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.879061 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] cache.config_prefix            = cache.oslo {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.879520 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] cache.debug_cache_backend      = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.879968 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] cache.enabled                  = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.880419 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] cache.expiration_time          = 600 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.880865 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] cache.memcache_dead_retry      = 300 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.881355 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.881859 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.882345 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize    = 10 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.882649 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.882942 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] cache.memcache_servers         = ['localhost:11211'] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.883227 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout  = 1.0 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.884503 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] cache.proxies                  = [] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.884503 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers      = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.884503 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] cache.tls_cafile               = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.884503 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] cache.tls_certfile             = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.885346 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] cache.tls_enabled              = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.885346 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] cache.tls_keyfile              = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.885346 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] privsep.capabilities           = [21, 12, 1, 2, 19] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.886040 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] privsep.group                  = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.886040 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] privsep.helper_command         = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.886040 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] privsep.thread_pool_size       = 4 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.886717 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] privsep.user                   = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.886717 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.887127 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] privsep_dhcp_release.group     = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.887127 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.887523 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.887523 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] privsep_dhcp_release.user      = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.887913 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.888122 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group        = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.888326 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.888550 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.888827 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user         = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.889151 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.889437 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] privsep_namespace.group        = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.889719 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.890007 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.890288 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] privsep_namespace.user         = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.890577 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.890852 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] privsep_conntrack.group        = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.891428 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.891428 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.892022 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] privsep_conntrack.user         = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.892022 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] AGENT.root_helper              = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.892428 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon       = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.892730 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read   = True {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.892995 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset     = True {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.893231 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.893438 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver  = openvswitch {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.893762 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.893974 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ml2.extension_drivers          = ['port_security'] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.894188 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [-] 10.222.0.71 "GET / HTTP/1.1" status: 200  len: 253 time: 0.0141048
May 20 04:13:18.894697 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ml2.external_network_type      = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.894959 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ml2.mechanism_drivers          = ['openvswitch', 'hyperv'] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.895225 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ml2.overlay_ip_version         = 4 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.895500 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ml2.path_mtu                   = 0 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.895749 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ml2.physical_network_mtus      = [] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.896005 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ml2.tenant_network_types       = ['vlan'] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.897012 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ml2.type_drivers               = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.897012 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks    = ['physnet1'] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.897012 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.897460 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges     = ['1:1000'] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.897460 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges  = ['1:1000'] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.897687 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:850:899'] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.897941 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges      = ['1:1000'] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.898212 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group     = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.898506 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.898929 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] database.backend               = sqlalchemy {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.899080 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] database.connection            = **** {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.900804 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] database.connection_debug      = 0 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.901195 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] database.connection_parameters =  {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.901518 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.902810 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] database.connection_trace      = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.903344 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.903655 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] database.db_max_retries        = 20 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.903952 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.904249 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] database.db_retry_interval     = 1 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.904548 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] database.max_overflow          = 50 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.904817 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] database.max_pool_size         = 50 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.905246 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] database.max_retries           = 10 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.905537 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] database.mysql_enable_ndb      = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.905821 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] database.mysql_sql_mode        = TRADITIONAL {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.906834 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] database.pool_timeout          = None {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.907016 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] database.retry_interval        = 10 {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.907220 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] database.slave_connection      = **** {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.907428 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] database.sqlite_synchronous    = True {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.907605 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] database.use_db_reconnect      = False {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 20 04:13:18.907772 dv-cinder-790910-4-iscsi neutron-server[91581]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=91581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}}
May 20 04:13:29.899366 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1d002fda-7730-4708-83c7-740630929c67 None None] get_active_networks_info from dv-cinder-790910-4-iscsi {{(pid=91688) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}}
May 20 04:13:30.048251 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1d002fda-7730-4708-83c7-740630929c67 None None] No non-hosted networks {{(pid=91688) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:60}}
May 20 04:13:30.055755 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.agentschedulers_db [None req-1d002fda-7730-4708-83c7-740630929c67 None None] DHCP Agent not found on host dv-cinder-790910-4-iscsi {{(pid=91688) list_active_networks_on_active_dhcp_agent /opt/stack/neutron/neutron/db/agentschedulers_db.py:455}}
May 20 04:13:30.102055 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-fb4dca10-2573-41b6-a7df-db49c7dd9f71 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692'] for agent, after_create {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:13:32.542923 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692'] for agent, after_create {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:13:32.542923 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:13:32.542923 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:13:32.542923 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:13:32.543975 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:13:32.543975 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:13:32.543975 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:13:32.544230 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:13:32.544455 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:13:32.546900 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:13:32.547766 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:13:32.548721 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:13:32.549591 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:13:32.551254 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServersRpcApi method report_agent_resource_versions called with arguments (<neutron_lib.context.Context object at 0x7fced1ceaa90>, 'Open vSwitch agent', 'dv-cinder-790910-4-iscsi', {'QosPolicy': '1.8', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}) {} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:13:32.560164 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServerRpcCallback method report_agent_resource_versions called with arguments (<neutron_lib.context.Context object at 0x7fced258e040>,) {'agent_type': 'Open vSwitch agent', 'agent_host': 'dv-cinder-790910-4-iscsi', 'version_map': {'QosPolicy': '1.8', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:13:32.650375 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-0e73d8b9-7a21-42fb-bd3d-5f14e9f3b0d8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692'] for agent, after_create {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:13:32.684274 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-dedec229-de8f-4fa1-bd21-6b28fa9f4e2c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:13:33.313101 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ea4803bd-878f-47d5-9084-1ec41953c9db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692'] for agent, after_create {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:13:35.142894 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f21320cc-6a25-4ec1-8a32-8b119b35fd55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692'] for agent, after_create {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:13:35.650779 dv-cinder-790910-4-iscsi neutron-server[91688]: INFO neutron.db.l3_hamode_db [None req-11d2b0b5-a929-4124-bf97-e168678a66dc None None] Number of active agents lower than max_l3_agents_per_router. L3 agents available: 1
May 20 04:13:35.740596 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-11d2b0b5-a929-4124-bf97-e168678a66dc None None] Routers set() bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91688) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:13:35.740976 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-11d2b0b5-a929-4124-bf97-e168678a66dc None None] Router IDs set() for agent in host dv-cinder-790910-4-iscsi {{(pid=91688) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:464}}
May 20 04:13:36.878697 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 33506) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:13:37.475228 dv-cinder-790910-4-iscsi neutron-server[91686]: WARNING oslo_policy.policy [None req-b92f9c36-493d-4a51-8c33-7f5aba96a75e admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
May 20 04:13:37.475805 dv-cinder-790910-4-iscsi neutron-server[91686]: WARNING oslo_policy.policy [None req-b92f9c36-493d-4a51-8c33-7f5aba96a75e admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
May 20 04:13:37.694796 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [None req-b92f9c36-493d-4a51-8c33-7f5aba96a75e admin admin] http://10.222.0.71:9696/v2.0/extensions returned with HTTP 200 {{(pid=91686) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 20 04:13:37.695888 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-b92f9c36-493d-4a51-8c33-7f5aba96a75e admin admin] 10.222.0.71 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.8190207
May 20 04:13:40.060034 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 33520) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:13:40.450840 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.v2.base [None req-6cf4ec59-dd85-4140-b6de-e338f824100f admin admin] Request body: {'subnetpool': {'name': 'shared-default-subnetpool-v4', 'prefixes': ['172.20.0.0/16'], 'default_prefixlen': 26, 'shared': True, 'is_default': True}} {{(pid=91686) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:13:40.548134 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.policy [None req-6cf4ec59-dd85-4140-b6de-e338f824100f admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=91686) register_rules /opt/stack/neutron/neutron/policy.py:73}}
May 20 04:13:40.593051 dv-cinder-790910-4-iscsi neutron-server[91686]: WARNING oslo_policy.policy [None req-6cf4ec59-dd85-4140-b6de-e338f824100f admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
May 20 04:13:40.593432 dv-cinder-790910-4-iscsi neutron-server[91686]: WARNING oslo_policy.policy [None req-6cf4ec59-dd85-4140-b6de-e338f824100f admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
May 20 04:13:40.602210 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.quota [None req-6cf4ec59-dd85-4140-b6de-e338f824100f admin admin] Loaded quota_driver: <neutron.db.quota.driver.DbQuotaDriver object at 0x7fced2304790>.
May 20 04:13:40.617704 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-6cf4ec59-dd85-4140-b6de-e338f824100f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:13:40.681975 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-6cf4ec59-dd85-4140-b6de-e338f824100f admin admin] Notify callbacks ['neutron.objects.securitygroup.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8782897441106', 'neutron.objects.address_group.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8782897441541', 'neutron.objects.network.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8782897386765', 'neutron.objects.qos.policy.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8782897390193', 'neutron.objects.subnetpool.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8782897400828', 'neutron.objects.address_scope.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8782897409269', 'neutron.plugins.ml2.plugin.External_net_db_mixin._process_ext_policy_create-593110', 'neutron.plugins.ml2.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-652183', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-1696144', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-1626105'] for rbac-policy, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:13:40.752174 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-6cf4ec59-dd85-4140-b6de-e338f824100f admin admin] Notify callbacks [] for subnetpool, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:13:40.753713 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-6cf4ec59-dd85-4140-b6de-e338f824100f admin admin] 10.222.0.71 "POST /v2.0/subnetpools HTTP/1.1" status: 201  len: 739 time: 0.6928012
May 20 04:13:43.379814 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 33534) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:13:43.749449 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.v2.base [None req-dee514c0-066e-4977-bb63-a45584852a56 admin admin] Request body: {'network': {'tenant_id': '84d940a99e0247a0a7c7642fac9b3b56', 'name': 'private', 'admin_state_up': True, 'project_id': '84d940a99e0247a0a7c7642fac9b3b56'}} {{(pid=91686) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:13:43.754833 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-dee514c0-066e-4977-bb63-a45584852a56 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:13:43.759555 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-dee514c0-066e-4977-bb63-a45584852a56 admin admin] Usage tracker for resource:network and tenant:84d940a99e0247a0a7c7642fac9b3b56 is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:13:43.764530 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-dee514c0-066e-4977-bb63-a45584852a56 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:13:43.771386 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-dee514c0-066e-4977-bb63-a45584852a56 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:13:43.782275 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dee514c0-066e-4977-bb63-a45584852a56 admin admin] Made reservation on behalf of 84d940a99e0247a0a7c7642fac9b3b56 for: {'network': 1} {{(pid=91686) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 04:13:43.785198 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-dee514c0-066e-4977-bb63-a45584852a56 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-578118'] for network, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:13:43.803623 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-dee514c0-066e-4977-bb63-a45584852a56 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:13:43.818611 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-dee514c0-066e-4977-bb63-a45584852a56 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:13:43.822654 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-dee514c0-066e-4977-bb63-a45584852a56 admin admin] Usage tracker for resource:security_group_rule and tenant:84d940a99e0247a0a7c7642fac9b3b56 is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:13:43.827978 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-dee514c0-066e-4977-bb63-a45584852a56 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:13:43.834029 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-dee514c0-066e-4977-bb63-a45584852a56 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:13:43.939861 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-dee514c0-066e-4977-bb63-a45584852a56 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:13:43.944881 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-dee514c0-066e-4977-bb63-a45584852a56 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:13:43.949316 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:13:43.969277 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-dee514c0-066e-4977-bb63-a45584852a56 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 852}  {{(pid=91686) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 20 04:13:43.999061 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-dee514c0-066e-4977-bb63-a45584852a56 admin admin] Notify callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8782892553674', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1501910'] for segment, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:13:43.999669 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-dee514c0-066e-4977-bb63-a45584852a56 admin admin] Unsubscribe: <function _add_segment_host_mapping_for_segment at 0x7fced30d5ca0> segment precommit_create {{(pid=91686) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}}
May 20 04:13:44.000130 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.db.segments_db [None req-dee514c0-066e-4977-bb63-a45584852a56 admin admin] Added segment 0bc260c1-bc85-4b55-a596-f08aa798037e of type vlan for network 88cea6a9-3544-48bc-afe9-c0c966884538
May 20 04:13:44.048636 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dee514c0-066e-4977-bb63-a45584852a56 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e9545dec-ee1d-419d-be18-ac927e8fd694,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:13:44.065239 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dee514c0-066e-4977-bb63-a45584852a56 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:13:44.065588 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dee514c0-066e-4977-bb63-a45584852a56 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:13:44.065915 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dee514c0-066e-4977-bb63-a45584852a56 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:13:44.066235 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dee514c0-066e-4977-bb63-a45584852a56 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:13:44.066552 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dee514c0-066e-4977-bb63-a45584852a56 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:13:44.066887 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dee514c0-066e-4977-bb63-a45584852a56 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:13:44.067208 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dee514c0-066e-4977-bb63-a45584852a56 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:13:44.067515 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dee514c0-066e-4977-bb63-a45584852a56 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:13:44.067850 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dee514c0-066e-4977-bb63-a45584852a56 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:13:44.068166 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dee514c0-066e-4977-bb63-a45584852a56 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:13:44.068473 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dee514c0-066e-4977-bb63-a45584852a56 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:13:44.068780 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dee514c0-066e-4977-bb63-a45584852a56 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:13:44.069909 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dee514c0-066e-4977-bb63-a45584852a56 admin admin] Tracked resource versions report:
May 20 04:13:44.069909 dv-cinder-790910-4-iscsi neutron-server[91686]: pushed versions:
May 20 04:13:44.069909 dv-cinder-790910-4-iscsi neutron-server[91686]: {   'AddressGroup': {'1.2'},
May 20 04:13:44.069909 dv-cinder-790910-4-iscsi neutron-server[91686]:     'ConntrackHelper': {'1.0'},
May 20 04:13:44.069909 dv-cinder-790910-4-iscsi neutron-server[91686]:     'Log': {'1.0'},
May 20 04:13:44.069909 dv-cinder-790910-4-iscsi neutron-server[91686]:     'Network': {'1.1'},
May 20 04:13:44.069909 dv-cinder-790910-4-iscsi neutron-server[91686]:     'Port': {'1.7'},
May 20 04:13:44.069909 dv-cinder-790910-4-iscsi neutron-server[91686]:     'PortForwarding': {'1.2'},
May 20 04:13:44.069909 dv-cinder-790910-4-iscsi neutron-server[91686]:     'QosPolicy': {'1.8'},
May 20 04:13:44.069909 dv-cinder-790910-4-iscsi neutron-server[91686]:     'SecurityGroup': {'1.4'},
May 20 04:13:44.069909 dv-cinder-790910-4-iscsi neutron-server[91686]:     'SecurityGroupRule': {'1.2'},
May 20 04:13:44.069909 dv-cinder-790910-4-iscsi neutron-server[91686]:     'SubPort': {'1.0'},
May 20 04:13:44.069909 dv-cinder-790910-4-iscsi neutron-server[91686]:     'Subnet': {'1.1'},
May 20 04:13:44.069909 dv-cinder-790910-4-iscsi neutron-server[91686]:     'Trunk': {'1.1'}}
May 20 04:13:44.069909 dv-cinder-790910-4-iscsi neutron-server[91686]: consumer versions:
May 20 04:13:44.069909 dv-cinder-790910-4-iscsi neutron-server[91686]: {   DHCP agent@dv-cinder-790910-4-iscsi: {},
May 20 04:13:44.069909 dv-cinder-790910-4-iscsi neutron-server[91686]:     L3 agent@dv-cinder-790910-4-iscsi: {},
May 20 04:13:44.069909 dv-cinder-790910-4-iscsi neutron-server[91686]:     Metadata agent@dv-cinder-790910-4-iscsi: {},
May 20 04:13:44.069909 dv-cinder-790910-4-iscsi neutron-server[91686]:     Metering agent@dv-cinder-790910-4-iscsi: {},
May 20 04:13:44.069909 dv-cinder-790910-4-iscsi neutron-server[91686]:     Open vSwitch agent@dv-cinder-790910-4-iscsi: {   'AddressGroup': '1.2',
May 20 04:13:44.069909 dv-cinder-790910-4-iscsi neutron-server[91686]:                                                      'ConntrackHelper': '1.0',
May 20 04:13:44.069909 dv-cinder-790910-4-iscsi neutron-server[91686]:                                                      'Log': '1.0',
May 20 04:13:44.069909 dv-cinder-790910-4-iscsi neutron-server[91686]:                                                      'Network': '1.1',
May 20 04:13:44.069909 dv-cinder-790910-4-iscsi neutron-server[91686]:                                                      'Port': '1.7',
May 20 04:13:44.069909 dv-cinder-790910-4-iscsi neutron-server[91686]:                                                      'PortForwarding': '1.2',
May 20 04:13:44.069909 dv-cinder-790910-4-iscsi neutron-server[91686]:                                                      'QosPolicy': '1.8',
May 20 04:13:44.069909 dv-cinder-790910-4-iscsi neutron-server[91686]:                                                      'SecurityGroup': '1.4',
May 20 04:13:44.069909 dv-cinder-790910-4-iscsi neutron-server[91686]:                                                      'SecurityGroupRule': '1.2',
May 20 04:13:44.069909 dv-cinder-790910-4-iscsi neutron-server[91686]:                                                      'SubPort': '1.0',
May 20 04:13:44.069909 dv-cinder-790910-4-iscsi neutron-server[91686]:                                                      'Subnet': '1.1',
May 20 04:13:44.069909 dv-cinder-790910-4-iscsi neutron-server[91686]:                                                      'Trunk': '1.1'}}
May 20 04:13:44.069909 dv-cinder-790910-4-iscsi neutron-server[91686]:  {{(pid=91686) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
May 20 04:13:44.124987 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-dee514c0-066e-4977-bb63-a45584852a56 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.176s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:13:44.126960 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-dee514c0-066e-4977-bb63-a45584852a56 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8782892092784'] for network, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:13:44.173382 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-dee514c0-066e-4977-bb63-a45584852a56 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1590664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1781430'] for network, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:13:44.175051 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dee514c0-066e-4977-bb63-a45584852a56 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:13:44.175686 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-dee514c0-066e-4977-bb63-a45584852a56 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for network, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:13:44.179348 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:13:44.288408 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-dee514c0-066e-4977-bb63-a45584852a56 admin admin] 10.222.0.71 "POST /v2.0/networks HTTP/1.1" status: 201  len: 849 time: 0.9075060
May 20 04:13:44.288939 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dee514c0-066e-4977-bb63-a45584852a56 admin admin] Pushing event updated for resources: {'Network': ['ID=88cea6a9-3544-48bc-afe9-c0c966884538,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:13:44.315635 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-dee514c0-066e-4977-bb63-a45584852a56 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.135s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:13:44.323536 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Network 88cea6a9-3544-48bc-afe9-c0c966884538 details requested by agent ovs-agent-dv-cinder-790910-4-iscsi with host dv-cinder-790910-4-iscsi {{(pid=91688) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 20 04:13:46.997476 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 33550) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:13:47.475509 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f964838c-bb68-476c-b81c-dee2ac3aa8d8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:13:47.476847 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-f964838c-bb68-476c-b81c-dee2ac3aa8d8 admin admin] 10.222.0.71 "GET /v2.0/networks/88cea6a9-3544-48bc-afe9-c0c966884538 HTTP/1.1" status: 200  len: 825 time: 0.4783225
May 20 04:13:47.504062 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-8f2294e7-31ad-4004-afed-b247421a4995 admin admin] 10.222.0.71 "GET /v2.0/subnetpools/2d16963f-5971-47f3-a207-088f45406783 HTTP/1.1" status: 200  len: 734 time: 0.0216911
May 20 04:13:47.513725 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.v2.base [None req-c75ec4a4-0774-4efc-873b-169952deddca admin admin] Request body: {'subnet': {'subnetpool_id': '2d16963f-5971-47f3-a207-088f45406783', 'ip_version': 4, 'network_id': '88cea6a9-3544-48bc-afe9-c0c966884538', 'tenant_id': '84d940a99e0247a0a7c7642fac9b3b56', 'name': 'private-subnet', 'gateway_ip': '172.20.0.1'}} {{(pid=91686) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:13:47.518417 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-c75ec4a4-0774-4efc-873b-169952deddca admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:13:47.522228 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-c75ec4a4-0774-4efc-873b-169952deddca admin admin] Usage tracker for resource:subnet and tenant:84d940a99e0247a0a7c7642fac9b3b56 is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:13:47.525167 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-c75ec4a4-0774-4efc-873b-169952deddca admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:13:47.530842 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-c75ec4a4-0774-4efc-873b-169952deddca admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:13:47.542516 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c75ec4a4-0774-4efc-873b-169952deddca admin admin] Made reservation on behalf of 84d940a99e0247a0a7c7642fac9b3b56 for: {'subnet': 1} {{(pid=91686) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 04:13:47.544820 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-c75ec4a4-0774-4efc-873b-169952deddca admin admin] Notify callbacks [] for subnet, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:13:48.041458 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-c75ec4a4-0774-4efc-873b-169952deddca admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-255887', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377'] for subnet, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:13:48.045966 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:13:48.125451 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c75ec4a4-0774-4efc-873b-169952deddca admin admin] Pushing event updated for resources: {'Subnet': ['ID=d0bf3a89-57e8-4fe7-9bf6-24daf5a96d70,revision_number=0']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:13:48.132022 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-c75ec4a4-0774-4efc-873b-169952deddca admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:13:48.132885 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c75ec4a4-0774-4efc-873b-169952deddca admin admin] Checking segment: {'id': '0bc260c1-bc85-4b55-a596-f08aa798037e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': '88cea6a9-3544-48bc-afe9-c0c966884538'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91686) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:13:48.133272 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c75ec4a4-0774-4efc-873b-169952deddca admin admin] Network hostable DHCP agents. Network: 88cea6a9-3544-48bc-afe9-c0c966884538, hostable agents: ['36d27813-c368-4fd7-ae26-0f662e0a96fd'], hosted agents: [] {{(pid=91686) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 20 04:13:48.154651 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c75ec4a4-0774-4efc-873b-169952deddca admin admin] Network 88cea6a9-3544-48bc-afe9-c0c966884538 is scheduled to be hosted by DHCP agent 36d27813-c368-4fd7-ae26-0f662e0a96fd with binding_index 1 {{(pid=91686) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 20 04:13:48.165356 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.base_scheduler [None req-c75ec4a4-0774-4efc-873b-169952deddca admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-790910-4-iscsi, 88cea6a9-3544-48bc-afe9-c0c966884538) {{(pid=91686) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:13:48.170762 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c75ec4a4-0774-4efc-873b-169952deddca admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:13:48.171259 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-c75ec4a4-0774-4efc-873b-169952deddca admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for subnet, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:13:48.176085 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3a8273b7-aa10-4232-8c7c-979cf67aab96 None None] Network 88cea6a9-3544-48bc-afe9-c0c966884538 requested from dv-cinder-790910-4-iscsi {{(pid=91688) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 04:13:48.196206 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-c75ec4a4-0774-4efc-873b-169952deddca admin admin] 10.222.0.71 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 854 time: 0.6858923
May 20 04:13:48.498186 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1825ba06-1501-401c-80f2-26fe87f31ac4 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpfbdc8e9b-5136-5478-8aa8-b0b6b9be0f90-88cea6a9-3544-48bc-afe9-c0c966884538', 'network_id': '88cea6a9-3544-48bc-afe9-c0c966884538', 'tenant_id': '84d940a99e0247a0a7c7642fac9b3b56', 'fixed_ips': [{'subnet_id': 'd0bf3a89-57e8-4fe7-9bf6-24daf5a96d70'}]}} from dv-cinder-790910-4-iscsi. {{(pid=91688) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 20 04:13:48.499387 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1825ba06-1501-401c-80f2-26fe87f31ac4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_create {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:13:48.690595 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.db_base_plugin_common [None req-1825ba06-1501-401c-80f2-26fe87f31ac4 None None] Allocated IP 172.20.0.2 (88cea6a9-3544-48bc-afe9-c0c966884538/d0bf3a89-57e8-4fe7-9bf6-24daf5a96d70/69ea2d25-dbaa-4b41-99c9-58934f28541e) {{(pid=91688) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 04:13:48.945645 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1825ba06-1501-401c-80f2-26fe87f31ac4 None None] Notify callbacks [] for port, precommit_create {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:13:48.959867 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-1825ba06-1501-401c-80f2-26fe87f31ac4 None None] Transition to ACTIVE for port object 69ea2d25-dbaa-4b41-99c9-58934f28541e will not be triggered until provisioned by entity L2. {{(pid=91688) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:13:48.981540 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-1825ba06-1501-401c-80f2-26fe87f31ac4 None None] Transition to ACTIVE for port object 69ea2d25-dbaa-4b41-99c9-58934f28541e will not be triggered until provisioned by entity DHCP. {{(pid=91688) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:13:48.990626 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1825ba06-1501-401c-80f2-26fe87f31ac4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8782892106231'] for port, after_create {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:13:48.995482 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:13:49.057286 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1825ba06-1501-401c-80f2-26fe87f31ac4 None None] Network 88cea6a9-3544-48bc-afe9-c0c966884538 is already hosted by enough agents. {{(pid=91688) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:13:49.060155 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.scheduler.base_scheduler [None req-1825ba06-1501-401c-80f2-26fe87f31ac4 None None] Resources bound (agent type, host, resource id):  {{(pid=91688) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:13:49.067164 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1825ba06-1501-401c-80f2-26fe87f31ac4 None None] Received port after_create {{(pid=91688) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 04:13:49.069656 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1825ba06-1501-401c-80f2-26fe87f31ac4 None None] Pushing event updated for resources: {'Port': ['ID=69ea2d25-dbaa-4b41-99c9-58934f28541e,revision_number=1']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:13:49.105928 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1825ba06-1501-401c-80f2-26fe87f31ac4 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:13:49.106253 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1825ba06-1501-401c-80f2-26fe87f31ac4 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:13:49.106579 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1825ba06-1501-401c-80f2-26fe87f31ac4 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:13:49.106895 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1825ba06-1501-401c-80f2-26fe87f31ac4 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:13:49.107222 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1825ba06-1501-401c-80f2-26fe87f31ac4 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:13:49.107703 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1825ba06-1501-401c-80f2-26fe87f31ac4 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:13:49.107822 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1825ba06-1501-401c-80f2-26fe87f31ac4 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:13:49.108113 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1825ba06-1501-401c-80f2-26fe87f31ac4 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:13:49.108457 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1825ba06-1501-401c-80f2-26fe87f31ac4 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:13:49.108747 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1825ba06-1501-401c-80f2-26fe87f31ac4 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:13:49.109080 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1825ba06-1501-401c-80f2-26fe87f31ac4 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:13:49.109387 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1825ba06-1501-401c-80f2-26fe87f31ac4 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:13:49.110586 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1825ba06-1501-401c-80f2-26fe87f31ac4 None None] Tracked resource versions report:
May 20 04:13:49.110586 dv-cinder-790910-4-iscsi neutron-server[91688]: pushed versions:
May 20 04:13:49.110586 dv-cinder-790910-4-iscsi neutron-server[91688]: {   'AddressGroup': {'1.2'},
May 20 04:13:49.110586 dv-cinder-790910-4-iscsi neutron-server[91688]:     'ConntrackHelper': {'1.0'},
May 20 04:13:49.110586 dv-cinder-790910-4-iscsi neutron-server[91688]:     'Log': {'1.0'},
May 20 04:13:49.110586 dv-cinder-790910-4-iscsi neutron-server[91688]:     'Network': {'1.1'},
May 20 04:13:49.110586 dv-cinder-790910-4-iscsi neutron-server[91688]:     'Port': {'1.7'},
May 20 04:13:49.110586 dv-cinder-790910-4-iscsi neutron-server[91688]:     'PortForwarding': {'1.2'},
May 20 04:13:49.110586 dv-cinder-790910-4-iscsi neutron-server[91688]:     'QosPolicy': {'1.8'},
May 20 04:13:49.110586 dv-cinder-790910-4-iscsi neutron-server[91688]:     'SecurityGroup': {'1.4'},
May 20 04:13:49.110586 dv-cinder-790910-4-iscsi neutron-server[91688]:     'SecurityGroupRule': {'1.2'},
May 20 04:13:49.110586 dv-cinder-790910-4-iscsi neutron-server[91688]:     'SubPort': {'1.0'},
May 20 04:13:49.110586 dv-cinder-790910-4-iscsi neutron-server[91688]:     'Subnet': {'1.1'},
May 20 04:13:49.110586 dv-cinder-790910-4-iscsi neutron-server[91688]:     'Trunk': {'1.1'}}
May 20 04:13:49.110586 dv-cinder-790910-4-iscsi neutron-server[91688]: consumer versions:
May 20 04:13:49.110586 dv-cinder-790910-4-iscsi neutron-server[91688]: {   DHCP agent@dv-cinder-790910-4-iscsi: {},
May 20 04:13:49.110586 dv-cinder-790910-4-iscsi neutron-server[91688]:     L3 agent@dv-cinder-790910-4-iscsi: {},
May 20 04:13:49.110586 dv-cinder-790910-4-iscsi neutron-server[91688]:     Metadata agent@dv-cinder-790910-4-iscsi: {},
May 20 04:13:49.110586 dv-cinder-790910-4-iscsi neutron-server[91688]:     Metering agent@dv-cinder-790910-4-iscsi: {},
May 20 04:13:49.110586 dv-cinder-790910-4-iscsi neutron-server[91688]:     Open vSwitch agent@dv-cinder-790910-4-iscsi: {   'AddressGroup': '1.2',
May 20 04:13:49.110586 dv-cinder-790910-4-iscsi neutron-server[91688]:                                                      'ConntrackHelper': '1.0',
May 20 04:13:49.110586 dv-cinder-790910-4-iscsi neutron-server[91688]:                                                      'Log': '1.0',
May 20 04:13:49.110586 dv-cinder-790910-4-iscsi neutron-server[91688]:                                                      'Network': '1.1',
May 20 04:13:49.110586 dv-cinder-790910-4-iscsi neutron-server[91688]:                                                      'Port': '1.7',
May 20 04:13:49.110586 dv-cinder-790910-4-iscsi neutron-server[91688]:                                                      'PortForwarding': '1.2',
May 20 04:13:49.110586 dv-cinder-790910-4-iscsi neutron-server[91688]:                                                      'QosPolicy': '1.8',
May 20 04:13:49.110586 dv-cinder-790910-4-iscsi neutron-server[91688]:                                                      'SecurityGroup': '1.4',
May 20 04:13:49.110586 dv-cinder-790910-4-iscsi neutron-server[91688]:                                                      'SecurityGroupRule': '1.2',
May 20 04:13:49.110586 dv-cinder-790910-4-iscsi neutron-server[91688]:                                                      'SubPort': '1.0',
May 20 04:13:49.110586 dv-cinder-790910-4-iscsi neutron-server[91688]:                                                      'Subnet': '1.1',
May 20 04:13:49.110586 dv-cinder-790910-4-iscsi neutron-server[91688]:                                                      'Trunk': '1.1'}}
May 20 04:13:49.110586 dv-cinder-790910-4-iscsi neutron-server[91688]:  {{(pid=91688) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
May 20 04:13:49.119156 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1825ba06-1501-401c-80f2-26fe87f31ac4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:13:49.176656 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.managers [None req-1825ba06-1501-401c-80f2-26fe87f31ac4 None None] Attempting to bind port 69ea2d25-dbaa-4b41-99c9-58934f28541e on host dv-cinder-790910-4-iscsi for vnic_type normal with profile  {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 04:13:49.177464 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.managers [None req-1825ba06-1501-401c-80f2-26fe87f31ac4 None None] Attempting to bind port 69ea2d25-dbaa-4b41-99c9-58934f28541e by drivers openvswitch,hyperv on host dv-cinder-790910-4-iscsi at level 0 using segments [{'id': '0bc260c1-bc85-4b55-a596-f08aa798037e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': '88cea6a9-3544-48bc-afe9-c0c966884538'}] {{(pid=91688) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 04:13:49.177464 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1825ba06-1501-401c-80f2-26fe87f31ac4 None None] Attempting to bind port 69ea2d25-dbaa-4b41-99c9-58934f28541e on network 88cea6a9-3544-48bc-afe9-c0c966884538 {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:13:49.183482 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1825ba06-1501-401c-80f2-26fe87f31ac4 None None] Checking agent: {'id': '333121d4-1023-4a33-a54c-f4dd052e1612', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-790910-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 4, 13, 33), 'started_at': datetime.datetime(2021, 5, 20, 4, 13, 33), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 4, 13, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-790910-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 04:13:49.183894 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1825ba06-1501-401c-80f2-26fe87f31ac4 None None] Checking segment: {'id': '0bc260c1-bc85-4b55-a596-f08aa798037e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': '88cea6a9-3544-48bc-afe9-c0c966884538'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91688) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:13:49.184385 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1825ba06-1501-401c-80f2-26fe87f31ac4 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:13:49.184780 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1825ba06-1501-401c-80f2-26fe87f31ac4 None None] Bound using segment: {'id': '0bc260c1-bc85-4b55-a596-f08aa798037e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': '88cea6a9-3544-48bc-afe9-c0c966884538'} {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 04:13:49.185289 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.managers [None req-1825ba06-1501-401c-80f2-26fe87f31ac4 None None] Bound port: 69ea2d25-dbaa-4b41-99c9-58934f28541e, host: dv-cinder-790910-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0bc260c1-bc85-4b55-a596-f08aa798037e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': '88cea6a9-3544-48bc-afe9-c0c966884538'}}] {{(pid=91688) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 04:13:49.185667 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1825ba06-1501-401c-80f2-26fe87f31ac4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:13:49.280522 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1825ba06-1501-401c-80f2-26fe87f31ac4 None None] For port 69ea2d25-dbaa-4b41-99c9-58934f28541e, host dv-cinder-790910-4-iscsi, cleared binding levels {{(pid=91688) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 04:13:49.285396 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1825ba06-1501-401c-80f2-26fe87f31ac4 None None] For port 69ea2d25-dbaa-4b41-99c9-58934f28541e, host dv-cinder-790910-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=69ea2d25-dbaa-4b41-99c9-58934f28541e,segment=NetworkSegment(0bc260c1-bc85-4b55-a596-f08aa798037e),segment_id=0bc260c1-bc85-4b55-a596-f08aa798037e)] {{(pid=91688) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 04:13:49.291144 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1825ba06-1501-401c-80f2-26fe87f31ac4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:13:49.295526 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1825ba06-1501-401c-80f2-26fe87f31ac4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:13:49.380015 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1825ba06-1501-401c-80f2-26fe87f31ac4 None None] Pushing event updated for resources: {'Port': ['ID=69ea2d25-dbaa-4b41-99c9-58934f28541e,revision_number=2']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:13:49.390046 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1825ba06-1501-401c-80f2-26fe87f31ac4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:13:50.620428 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 33560) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:13:51.020406 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [None req-08210ba2-2c30-4d38-a0a8-ac9cc2b9c700 admin admin] http://10.222.0.71:9696/v2.0/extensions returned with HTTP 200 {{(pid=91686) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 20 04:13:51.021433 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-08210ba2-2c30-4d38-a0a8-ac9cc2b9c700 admin admin] 10.222.0.71 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.3999636
May 20 04:13:53.444817 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 33570) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:13:54.093168 dv-cinder-790910-4-iscsi neutron-server[91687]: WARNING oslo_policy.policy [None req-7fdd3290-602c-4168-bbd9-4dd4bd2c2742 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
May 20 04:13:54.093734 dv-cinder-790910-4-iscsi neutron-server[91687]: WARNING oslo_policy.policy [None req-7fdd3290-602c-4168-bbd9-4dd4bd2c2742 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
May 20 04:13:54.308636 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [None req-7fdd3290-602c-4168-bbd9-4dd4bd2c2742 admin admin] http://10.222.0.71:9696/v2.0/extensions returned with HTTP 200 {{(pid=91687) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 20 04:13:54.309911 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-7fdd3290-602c-4168-bbd9-4dd4bd2c2742 admin admin] 10.222.0.71 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.8631411
May 20 04:13:54.707852 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 69ea2d25-dbaa-4b41-99c9-58934f28541e up at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:13:54.787040 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning for port 69ea2d25-dbaa-4b41-99c9-58934f28541e completed by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:13:54.801581 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e64af816-29f2-42a2-a748-c2fde2fa62de None None] Network 88cea6a9-3544-48bc-afe9-c0c966884538 requested from dv-cinder-790910-4-iscsi {{(pid=91688) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 04:13:54.924320 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-f11f6bea-5a09-43fd-a352-afa18ce8d50b None None] Provisioning for port 69ea2d25-dbaa-4b41-99c9-58934f28541e completed by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:13:54.935880 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-f11f6bea-5a09-43fd-a352-afa18ce8d50b None None] Provisioning complete for port 69ea2d25-dbaa-4b41-99c9-58934f28541e triggered by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:13:54.936287 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f11f6bea-5a09-43fd-a352-afa18ce8d50b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:13:55.156701 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f11f6bea-5a09-43fd-a352-afa18ce8d50b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:13:55.198134 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-f11f6bea-5a09-43fd-a352-afa18ce8d50b None None] For port 69ea2d25-dbaa-4b41-99c9-58934f28541e, host dv-cinder-790910-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=69ea2d25-dbaa-4b41-99c9-58934f28541e,segment=NetworkSegment(0bc260c1-bc85-4b55-a596-f08aa798037e),segment_id=0bc260c1-bc85-4b55-a596-f08aa798037e)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:13:55.203666 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f11f6bea-5a09-43fd-a352-afa18ce8d50b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:13:55.209674 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:13:55.281339 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f11f6bea-5a09-43fd-a352-afa18ce8d50b None None] Pushing event updated for resources: {'Port': ['ID=69ea2d25-dbaa-4b41-99c9-58934f28541e,revision_number=3']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:13:55.284597 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-f11f6bea-5a09-43fd-a352-afa18ce8d50b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:13:55.438467 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-fdd0ae0a-c8a7-4a29-9b99-064d3994da47 None None] Provisioning complete for port 69ea2d25-dbaa-4b41-99c9-58934f28541e triggered by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:13:55.438762 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-fdd0ae0a-c8a7-4a29-9b99-064d3994da47 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:13:56.664401 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 69ea2d25-dbaa-4b41-99c9-58934f28541e up at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:13:56.731921 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning complete for port 69ea2d25-dbaa-4b41-99c9-58934f28541e triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:13:56.732357 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:13:56.980673 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 33590) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:13:57.359628 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [None req-0ea245ef-4faa-4060-ba4e-f679c85d048a admin admin] Request body: {'router': {'tenant_id': '84d940a99e0247a0a7c7642fac9b3b56', 'name': 'router1', 'admin_state_up': True}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:13:57.428502 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.policy [None req-0ea245ef-4faa-4060-ba4e-f679c85d048a admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=91687) register_rules /opt/stack/neutron/neutron/policy.py:73}}
May 20 04:13:57.473922 dv-cinder-790910-4-iscsi neutron-server[91687]: WARNING oslo_policy.policy [None req-0ea245ef-4faa-4060-ba4e-f679c85d048a admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
May 20 04:13:57.474312 dv-cinder-790910-4-iscsi neutron-server[91687]: WARNING oslo_policy.policy [None req-0ea245ef-4faa-4060-ba4e-f679c85d048a admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
May 20 04:13:57.483087 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.quota [None req-0ea245ef-4faa-4060-ba4e-f679c85d048a admin admin] Loaded quota_driver: <neutron.db.quota.driver.DbQuotaDriver object at 0x7fced2341580>.
May 20 04:13:57.498660 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-0ea245ef-4faa-4060-ba4e-f679c85d048a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:13:57.505266 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-0ea245ef-4faa-4060-ba4e-f679c85d048a admin admin] Usage tracker for resource:router and tenant:84d940a99e0247a0a7c7642fac9b3b56 is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:13:57.509778 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-0ea245ef-4faa-4060-ba4e-f679c85d048a admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:13:57.517748 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-0ea245ef-4faa-4060-ba4e-f679c85d048a admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:13:57.535446 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-0ea245ef-4faa-4060-ba4e-f679c85d048a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1796465', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-6255'] for router, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:13:57.537434 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-0ea245ef-4faa-4060-ba4e-f679c85d048a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1713009', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1713968', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1590966', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-6244'] for router, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:13:57.563767 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-0ea245ef-4faa-4060-ba4e-f679c85d048a admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:13:57.684589 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-0ea245ef-4faa-4060-ba4e-f679c85d048a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1796474', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1714058'] for router, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:13:57.709366 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-0ea245ef-4faa-4060-ba4e-f679c85d048a admin admin] Notify callbacks [] for router, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:13:57.710587 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-0ea245ef-4faa-4060-ba4e-f679c85d048a admin admin] 10.222.0.71 "POST /v2.0/routers HTTP/1.1" status: 201  len: 709 time: 0.7289321
May 20 04:13:59.831319 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-9feaa6fd-b985-445d-8bbd-311fd5dc8424 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:14:00.073076 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 33602) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:14:00.459951 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [None req-d715c079-26a9-43c4-89a8-92f570aa918d admin admin] http://10.222.0.71:9696/v2.0/extensions returned with HTTP 200 {{(pid=91686) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 20 04:14:00.460938 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-d715c079-26a9-43c4-89a8-92f570aa918d admin admin] 10.222.0.71 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.3870234
May 20 04:14:02.536908 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:14:02.641626 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-059018ca-4740-4dbc-a885-da2204a2a16a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:14:02.879124 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 33612) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:14:03.259710 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ea4803bd-878f-47d5-9084-1ec41953c9db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:14:03.281365 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.v2.base [None req-6482a514-8251-45b3-a11e-16cc5200bffa admin admin] Request body: {'network': {'name': 'public', 'router:external': True, 'provider:physical_network': 'physnet1', 'is_default': True, 'provider:network_type': 'flat', 'admin_state_up': True}} {{(pid=91686) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:14:03.286767 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-6482a514-8251-45b3-a11e-16cc5200bffa admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:14:03.290835 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-6482a514-8251-45b3-a11e-16cc5200bffa admin admin] Usage tracker for resource:network and tenant:a53818aa01c142a68e4227871399c86a is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:14:03.294235 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-6482a514-8251-45b3-a11e-16cc5200bffa admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:14:03.300228 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-6482a514-8251-45b3-a11e-16cc5200bffa admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:14:03.311234 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6482a514-8251-45b3-a11e-16cc5200bffa admin admin] Made reservation on behalf of a53818aa01c142a68e4227871399c86a for: {'network': 1} {{(pid=91686) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 04:14:03.313607 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-6482a514-8251-45b3-a11e-16cc5200bffa admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-578118'] for network, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:14:03.325814 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-6482a514-8251-45b3-a11e-16cc5200bffa admin admin] Notify callbacks [] for security_group, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:14:03.340322 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-6482a514-8251-45b3-a11e-16cc5200bffa admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:14:03.344261 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-6482a514-8251-45b3-a11e-16cc5200bffa admin admin] Usage tracker for resource:security_group_rule and tenant:a53818aa01c142a68e4227871399c86a is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:14:03.347218 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-6482a514-8251-45b3-a11e-16cc5200bffa admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:14:03.353054 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-6482a514-8251-45b3-a11e-16cc5200bffa admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:14:03.439797 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-6482a514-8251-45b3-a11e-16cc5200bffa admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:14:03.444719 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-6482a514-8251-45b3-a11e-16cc5200bffa admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:14:03.447897 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-dee514c0-066e-4977-bb63-a45584852a56 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:14:03.463207 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.drivers.type_flat [None req-6482a514-8251-45b3-a11e-16cc5200bffa admin admin] Reserving flat network on physical network physnet1 {{(pid=91686) reserve_provider_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_flat.py:100}}
May 20 04:14:03.484138 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6482a514-8251-45b3-a11e-16cc5200bffa admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ea1c49ab-edd1-42f6-804c-3555c8fd4116,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:14:03.488160 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-6482a514-8251-45b3-a11e-16cc5200bffa admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:14:03.489126 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-6482a514-8251-45b3-a11e-16cc5200bffa admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1501910'] for segment, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:14:03.489460 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.db.segments_db [None req-6482a514-8251-45b3-a11e-16cc5200bffa admin admin] Added segment 8df49ec5-3fb9-4715-bc9a-f4019a6b55f9 of type flat for network aec557db-0c02-4008-8c9f-2efcd7462f90
May 20 04:14:03.524072 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-6482a514-8251-45b3-a11e-16cc5200bffa admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8782892092784'] for network, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:14:03.563641 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-6482a514-8251-45b3-a11e-16cc5200bffa admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1590664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1781430'] for network, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:14:03.565095 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6482a514-8251-45b3-a11e-16cc5200bffa admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:14:03.565621 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-6482a514-8251-45b3-a11e-16cc5200bffa admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for network, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:14:03.568826 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-dee514c0-066e-4977-bb63-a45584852a56 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:14:03.667485 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6482a514-8251-45b3-a11e-16cc5200bffa admin admin] Pushing event updated for resources: {'Network': ['ID=aec557db-0c02-4008-8c9f-2efcd7462f90,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:14:03.670278 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-6482a514-8251-45b3-a11e-16cc5200bffa admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.101s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:14:03.671991 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-6482a514-8251-45b3-a11e-16cc5200bffa admin admin] 10.222.0.71 "POST /v2.0/networks HTTP/1.1" status: 201  len: 847 time: 0.7918513
May 20 04:14:03.688078 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Network aec557db-0c02-4008-8c9f-2efcd7462f90 details requested by agent ovs-agent-dv-cinder-790910-4-iscsi with host dv-cinder-790910-4-iscsi {{(pid=91688) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 20 04:14:04.756063 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.agents_db [None req-92d61f12-17bc-4bf9-9eab-8a69b8c6da2f None None] Agent healthcheck: found 5 active agents {{(pid=91689) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 04:14:05.095589 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f21320cc-6a25-4ec1-8a32-8b119b35fd55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:14:06.083865 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 33632) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:14:06.318936 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-939408db-4bb2-4494-a924-af9999ed41dc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:14:06.320388 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-939408db-4bb2-4494-a924-af9999ed41dc admin admin] 10.222.0.71 "GET /v2.0/subnets/d0bf3a89-57e8-4fe7-9bf6-24daf5a96d70 HTTP/1.1" status: 200  len: 849 time: 0.2356591
May 20 04:14:06.460097 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-c4a6e3bb-d3cf-4a51-bba6-1e92169ff816 admin admin] 10.222.0.71 "GET /v2.0/routers/e5de3a3b-9eb2-42c7-a1d8-63a7d2e7a767 HTTP/1.1" status: 200  len: 704 time: 0.1331794
May 20 04:14:06.929595 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-cec75340-fe9b-4421-ace2-68efc51d9a73 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:14:07.173769 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.db_base_plugin_common [None req-cec75340-fe9b-4421-ace2-68efc51d9a73 admin admin] Allocated IP 172.20.0.1 (88cea6a9-3544-48bc-afe9-c0c966884538/d0bf3a89-57e8-4fe7-9bf6-24daf5a96d70/901ade8f-42a0-4916-8f47-724e14b6ccee) {{(pid=91687) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 04:14:07.355592 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-cec75340-fe9b-4421-ace2-68efc51d9a73 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:14:07.374546 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.provisioning_blocks [None req-cec75340-fe9b-4421-ace2-68efc51d9a73 admin admin] Transition to ACTIVE for port object 901ade8f-42a0-4916-8f47-724e14b6ccee will not be triggered until provisioned by entity DHCP. {{(pid=91687) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:14:07.429295 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-cec75340-fe9b-4421-ace2-68efc51d9a73 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8782892106231'] for port, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:14:07.433622 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:14:07.479660 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cec75340-fe9b-4421-ace2-68efc51d9a73 admin admin] Network 88cea6a9-3544-48bc-afe9-c0c966884538 is already hosted by enough agents. {{(pid=91687) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:14:07.486705 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.base_scheduler [None req-cec75340-fe9b-4421-ace2-68efc51d9a73 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91687) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:14:07.534412 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cec75340-fe9b-4421-ace2-68efc51d9a73 admin admin] Pushing event updated for resources: {'Port': ['ID=901ade8f-42a0-4916-8f47-724e14b6ccee,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:14:07.537079 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cec75340-fe9b-4421-ace2-68efc51d9a73 admin admin] Received port after_create {{(pid=91687) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 04:14:07.537601 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-cec75340-fe9b-4421-ace2-68efc51d9a73 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1716281'] for router_interface, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:14:07.663818 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cec75340-fe9b-4421-ace2-68efc51d9a73 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:14:07.664181 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cec75340-fe9b-4421-ace2-68efc51d9a73 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:14:07.664529 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cec75340-fe9b-4421-ace2-68efc51d9a73 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:14:07.664833 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cec75340-fe9b-4421-ace2-68efc51d9a73 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:14:07.665199 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cec75340-fe9b-4421-ace2-68efc51d9a73 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:14:07.665531 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cec75340-fe9b-4421-ace2-68efc51d9a73 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:14:07.665847 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cec75340-fe9b-4421-ace2-68efc51d9a73 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:14:07.666159 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cec75340-fe9b-4421-ace2-68efc51d9a73 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:14:07.666487 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cec75340-fe9b-4421-ace2-68efc51d9a73 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:14:07.667169 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cec75340-fe9b-4421-ace2-68efc51d9a73 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:14:07.667475 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cec75340-fe9b-4421-ace2-68efc51d9a73 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:14:07.667774 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cec75340-fe9b-4421-ace2-68efc51d9a73 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:14:07.668880 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cec75340-fe9b-4421-ace2-68efc51d9a73 admin admin] Tracked resource versions report:
May 20 04:14:07.668880 dv-cinder-790910-4-iscsi neutron-server[91687]: pushed versions:
May 20 04:14:07.668880 dv-cinder-790910-4-iscsi neutron-server[91687]: {   'AddressGroup': {'1.2'},
May 20 04:14:07.668880 dv-cinder-790910-4-iscsi neutron-server[91687]:     'ConntrackHelper': {'1.0'},
May 20 04:14:07.668880 dv-cinder-790910-4-iscsi neutron-server[91687]:     'Log': {'1.0'},
May 20 04:14:07.668880 dv-cinder-790910-4-iscsi neutron-server[91687]:     'Network': {'1.1'},
May 20 04:14:07.668880 dv-cinder-790910-4-iscsi neutron-server[91687]:     'Port': {'1.7'},
May 20 04:14:07.668880 dv-cinder-790910-4-iscsi neutron-server[91687]:     'PortForwarding': {'1.2'},
May 20 04:14:07.668880 dv-cinder-790910-4-iscsi neutron-server[91687]:     'QosPolicy': {'1.8'},
May 20 04:14:07.668880 dv-cinder-790910-4-iscsi neutron-server[91687]:     'SecurityGroup': {'1.4'},
May 20 04:14:07.668880 dv-cinder-790910-4-iscsi neutron-server[91687]:     'SecurityGroupRule': {'1.2'},
May 20 04:14:07.668880 dv-cinder-790910-4-iscsi neutron-server[91687]:     'SubPort': {'1.0'},
May 20 04:14:07.668880 dv-cinder-790910-4-iscsi neutron-server[91687]:     'Subnet': {'1.1'},
May 20 04:14:07.668880 dv-cinder-790910-4-iscsi neutron-server[91687]:     'Trunk': {'1.1'}}
May 20 04:14:07.668880 dv-cinder-790910-4-iscsi neutron-server[91687]: consumer versions:
May 20 04:14:07.668880 dv-cinder-790910-4-iscsi neutron-server[91687]: {   DHCP agent@dv-cinder-790910-4-iscsi: {},
May 20 04:14:07.668880 dv-cinder-790910-4-iscsi neutron-server[91687]:     L3 agent@dv-cinder-790910-4-iscsi: {},
May 20 04:14:07.668880 dv-cinder-790910-4-iscsi neutron-server[91687]:     Metadata agent@dv-cinder-790910-4-iscsi: {},
May 20 04:14:07.668880 dv-cinder-790910-4-iscsi neutron-server[91687]:     Metering agent@dv-cinder-790910-4-iscsi: {},
May 20 04:14:07.668880 dv-cinder-790910-4-iscsi neutron-server[91687]:     Open vSwitch agent@dv-cinder-790910-4-iscsi: {   'AddressGroup': '1.2',
May 20 04:14:07.668880 dv-cinder-790910-4-iscsi neutron-server[91687]:                                                      'ConntrackHelper': '1.0',
May 20 04:14:07.668880 dv-cinder-790910-4-iscsi neutron-server[91687]:                                                      'Log': '1.0',
May 20 04:14:07.668880 dv-cinder-790910-4-iscsi neutron-server[91687]:                                                      'Network': '1.1',
May 20 04:14:07.668880 dv-cinder-790910-4-iscsi neutron-server[91687]:                                                      'Port': '1.7',
May 20 04:14:07.668880 dv-cinder-790910-4-iscsi neutron-server[91687]:                                                      'PortForwarding': '1.2',
May 20 04:14:07.668880 dv-cinder-790910-4-iscsi neutron-server[91687]:                                                      'QosPolicy': '1.8',
May 20 04:14:07.668880 dv-cinder-790910-4-iscsi neutron-server[91687]:                                                      'SecurityGroup': '1.4',
May 20 04:14:07.668880 dv-cinder-790910-4-iscsi neutron-server[91687]:                                                      'SecurityGroupRule': '1.2',
May 20 04:14:07.668880 dv-cinder-790910-4-iscsi neutron-server[91687]:                                                      'SubPort': '1.0',
May 20 04:14:07.668880 dv-cinder-790910-4-iscsi neutron-server[91687]:                                                      'Subnet': '1.1',
May 20 04:14:07.668880 dv-cinder-790910-4-iscsi neutron-server[91687]:                                                      'Trunk': '1.1'}}
May 20 04:14:07.668880 dv-cinder-790910-4-iscsi neutron-server[91687]:  {{(pid=91687) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
May 20 04:14:07.678841 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-cec75340-fe9b-4421-ace2-68efc51d9a73 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.245s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:14:07.692874 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-112bd318-f5f3-4453-9586-110c47d85947 None None] Provisioning for port 901ade8f-42a0-4916-8f47-724e14b6ccee completed by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:14:07.700230 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-112bd318-f5f3-4453-9586-110c47d85947 None None] Provisioning complete for port 901ade8f-42a0-4916-8f47-724e14b6ccee triggered by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:14:07.700602 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-112bd318-f5f3-4453-9586-110c47d85947 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:14:07.755934 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-112bd318-f5f3-4453-9586-110c47d85947 None None] Port 901ade8f-42a0-4916-8f47-724e14b6ccee cannot update to ACTIVE because it is not bound. {{(pid=91688) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 20 04:14:07.854070 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-cec75340-fe9b-4421-ace2-68efc51d9a73 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:14:08.089795 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-cec75340-fe9b-4421-ace2-68efc51d9a73 admin admin] Notify callbacks [] for port, precommit_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:14:08.095079 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-cec75340-fe9b-4421-ace2-68efc51d9a73 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:14:08.096189 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-cec75340-fe9b-4421-ace2-68efc51d9a73 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1781412', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1716318'] for router_interface, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:14:08.100748 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-cec75340-fe9b-4421-ace2-68efc51d9a73 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:14:08.273212 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cec75340-fe9b-4421-ace2-68efc51d9a73 admin admin] Pushing event updated for resources: {'Port': ['ID=901ade8f-42a0-4916-8f47-724e14b6ccee,revision_number=2']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:14:08.277240 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-cec75340-fe9b-4421-ace2-68efc51d9a73 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.176s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:14:08.329723 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cec75340-fe9b-4421-ace2-68efc51d9a73 admin admin] Network 88cea6a9-3544-48bc-afe9-c0c966884538 is already hosted by enough agents. {{(pid=91687) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:14:08.330834 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.base_scheduler [None req-cec75340-fe9b-4421-ace2-68efc51d9a73 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91687) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:14:08.524342 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cec75340-fe9b-4421-ace2-68efc51d9a73 admin admin] Router e5de3a3b-9eb2-42c7-a1d8-63a7d2e7a767 is scheduled to L3 agent 02733fc0-fc9c-4e29-bc03-c27a792d539d with binding_index 1 {{(pid=91687) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 20 04:14:08.582336 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-b5ffc743-9e68-4e8e-ab46-09098e9e0ed3 None None] Provisioning complete for port 901ade8f-42a0-4916-8f47-724e14b6ccee triggered by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:14:08.582862 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-b5ffc743-9e68-4e8e-ab46-09098e9e0ed3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:14:08.639926 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-b5ffc743-9e68-4e8e-ab46-09098e9e0ed3 None None] Port 901ade8f-42a0-4916-8f47-724e14b6ccee cannot update to ACTIVE because it is not bound. {{(pid=91688) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 20 04:14:08.679301 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cec75340-fe9b-4421-ace2-68efc51d9a73 admin admin] Notify agent at l3_agent.dv-cinder-790910-4-iscsi the message routers_updated {{(pid=91687) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 04:14:08.689220 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-46405917-aa71-47c5-a401-de2f8e2b734f None None] Sync routers for ids ['e5de3a3b-9eb2-42c7-a1d8-63a7d2e7a767'] in dv-cinder-790910-4-iscsi {{(pid=91689) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 04:14:08.690759 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-cec75340-fe9b-4421-ace2-68efc51d9a73 admin admin] 10.222.0.71 "PUT /v2.0/routers/e5de3a3b-9eb2-42c7-a1d8-63a7d2e7a767/add_router_interface HTTP/1.1" status: 200  len: 508 time: 2.2239199
May 20 04:14:08.699979 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-46405917-aa71-47c5-a401-de2f8e2b734f None None] Routers {'e5de3a3b-9eb2-42c7-a1d8-63a7d2e7a767'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91689) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:14:08.700779 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-46405917-aa71-47c5-a401-de2f8e2b734f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced24c5f70>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:14:03Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['e5de3a3b-9eb2-42c7-a1d8-63a7d2e7a767'], 'active': True} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:14:08.880332 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvr_db [None req-46405917-aa71-47c5-a401-de2f8e2b734f None None] Set router e5de3a3b-9eb2-42c7-a1d8-63a7d2e7a767 gateway port host: None {{(pid=91689) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:14:09.257655 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-46405917-aa71-47c5-a401-de2f8e2b734f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced24c5f70>, [{'id': 'e5de3a3b-9eb2-42c7-a1d8-63a7d2e7a767', 'name': 'router1', 'tenant_id': '84d940a99e0247a0a7c7642fac9b3b56', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:13:57Z', 'updated_at': '2021-05-20T04:14:07Z', 'revision_number': 2, 'project_id': '84d940a99e0247a0a7c7642fac9b3b56', 'gw_port_host': None, '_interfaces': [{'id': '901ade8f-42a0-4916-8f47-724e14b6ccee', 'name': '', 'network_id': '88cea6a9-3544-48bc-afe9-c0c966884538', 'tenant_id': '84d940a99e0247a0a7c7642fac9b3b56', 'mac_address': 'fa:16:3e:fd:99:9e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e5de3a3b-9eb2-42c7-a1d8-63a7d2e7a767', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'd0bf3a89-57e8-4fe7-9bf6-24daf5a96d70', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:14:06Z', 'updated_at': '2021-05-20T04:14:07Z', 'revision_number': 2, 'project_id': '84d940a99e0247a0a7c7642fac9b3b56', 'subnets': [{'id': 'd0bf3a89-57e8-4fe7-9bf6-24daf5a96d70', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '2d16963f-5971-47f3-a207-088f45406783'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:14:09.262875 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-46405917-aa71-47c5-a401-de2f8e2b734f None None] Checking router: e5de3a3b-9eb2-42c7-a1d8-63a7d2e7a767 for host: dv-cinder-790910-4-iscsi {{(pid=91689) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 04:14:09.263248 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-46405917-aa71-47c5-a401-de2f8e2b734f None None] Updating router e5de3a3b-9eb2-42c7-a1d8-63a7d2e7a767 port 901ade8f-42a0-4916-8f47-724e14b6ccee binding host dv-cinder-790910-4-iscsi {{(pid=91689) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 20 04:14:09.316053 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron_lib.callbacks.manager [None req-46405917-aa71-47c5-a401-de2f8e2b734f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:14:09.718244 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron_lib.callbacks.manager [None req-46405917-aa71-47c5-a401-de2f8e2b734f None None] Notify callbacks [] for port, precommit_update {{(pid=91689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:14:09.733565 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.provisioning_blocks [None req-46405917-aa71-47c5-a401-de2f8e2b734f None None] Transition to ACTIVE for port object 901ade8f-42a0-4916-8f47-724e14b6ccee will not be triggered until provisioned by entity L2. {{(pid=91689) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:14:09.742631 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron_lib.callbacks.manager [None req-46405917-aa71-47c5-a401-de2f8e2b734f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:14:09.748235 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:14:09.967038 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9f95531-ee5d-4065-9923-cf5ce920a47a None None] Pushing event updated for resources: {'Port': ['ID=901ade8f-42a0-4916-8f47-724e14b6ccee,revision_number=3']} {{(pid=91689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:14:09.977839 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.managers [None req-46405917-aa71-47c5-a401-de2f8e2b734f None None] Attempting to bind port 901ade8f-42a0-4916-8f47-724e14b6ccee on host dv-cinder-790910-4-iscsi for vnic_type normal with profile  {{(pid=91689) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 04:14:09.978117 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.managers [None req-46405917-aa71-47c5-a401-de2f8e2b734f None None] Attempting to bind port 901ade8f-42a0-4916-8f47-724e14b6ccee by drivers openvswitch,hyperv on host dv-cinder-790910-4-iscsi at level 0 using segments [{'id': '0bc260c1-bc85-4b55-a596-f08aa798037e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': '88cea6a9-3544-48bc-afe9-c0c966884538'}] {{(pid=91689) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 04:14:09.978595 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-46405917-aa71-47c5-a401-de2f8e2b734f None None] Attempting to bind port 901ade8f-42a0-4916-8f47-724e14b6ccee on network 88cea6a9-3544-48bc-afe9-c0c966884538 {{(pid=91689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:14:09.981937 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9f95531-ee5d-4065-9923-cf5ce920a47a None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:14:09.982529 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9f95531-ee5d-4065-9923-cf5ce920a47a None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:14:09.983089 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9f95531-ee5d-4065-9923-cf5ce920a47a None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:14:09.983438 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9f95531-ee5d-4065-9923-cf5ce920a47a None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:14:09.983736 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9f95531-ee5d-4065-9923-cf5ce920a47a None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:14:09.984047 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9f95531-ee5d-4065-9923-cf5ce920a47a None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:14:09.984398 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9f95531-ee5d-4065-9923-cf5ce920a47a None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:14:09.984704 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9f95531-ee5d-4065-9923-cf5ce920a47a None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:14:09.985072 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9f95531-ee5d-4065-9923-cf5ce920a47a None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:14:09.985385 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9f95531-ee5d-4065-9923-cf5ce920a47a None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:14:09.985683 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9f95531-ee5d-4065-9923-cf5ce920a47a None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:14:09.985992 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9f95531-ee5d-4065-9923-cf5ce920a47a None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:14:09.987221 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9f95531-ee5d-4065-9923-cf5ce920a47a None None] Tracked resource versions report:
May 20 04:14:09.987221 dv-cinder-790910-4-iscsi neutron-server[91689]: pushed versions:
May 20 04:14:09.987221 dv-cinder-790910-4-iscsi neutron-server[91689]: {   'AddressGroup': {'1.2'},
May 20 04:14:09.987221 dv-cinder-790910-4-iscsi neutron-server[91689]:     'ConntrackHelper': {'1.0'},
May 20 04:14:09.987221 dv-cinder-790910-4-iscsi neutron-server[91689]:     'Log': {'1.0'},
May 20 04:14:09.987221 dv-cinder-790910-4-iscsi neutron-server[91689]:     'Network': {'1.1'},
May 20 04:14:09.987221 dv-cinder-790910-4-iscsi neutron-server[91689]:     'Port': {'1.7'},
May 20 04:14:09.987221 dv-cinder-790910-4-iscsi neutron-server[91689]:     'PortForwarding': {'1.2'},
May 20 04:14:09.987221 dv-cinder-790910-4-iscsi neutron-server[91689]:     'QosPolicy': {'1.8'},
May 20 04:14:09.987221 dv-cinder-790910-4-iscsi neutron-server[91689]:     'SecurityGroup': {'1.4'},
May 20 04:14:09.987221 dv-cinder-790910-4-iscsi neutron-server[91689]:     'SecurityGroupRule': {'1.2'},
May 20 04:14:09.987221 dv-cinder-790910-4-iscsi neutron-server[91689]:     'SubPort': {'1.0'},
May 20 04:14:09.987221 dv-cinder-790910-4-iscsi neutron-server[91689]:     'Subnet': {'1.1'},
May 20 04:14:09.987221 dv-cinder-790910-4-iscsi neutron-server[91689]:     'Trunk': {'1.1'}}
May 20 04:14:09.987221 dv-cinder-790910-4-iscsi neutron-server[91689]: consumer versions:
May 20 04:14:09.987221 dv-cinder-790910-4-iscsi neutron-server[91689]: {   DHCP agent@dv-cinder-790910-4-iscsi: {},
May 20 04:14:09.987221 dv-cinder-790910-4-iscsi neutron-server[91689]:     L3 agent@dv-cinder-790910-4-iscsi: {},
May 20 04:14:09.987221 dv-cinder-790910-4-iscsi neutron-server[91689]:     Metadata agent@dv-cinder-790910-4-iscsi: {},
May 20 04:14:09.987221 dv-cinder-790910-4-iscsi neutron-server[91689]:     Metering agent@dv-cinder-790910-4-iscsi: {},
May 20 04:14:09.987221 dv-cinder-790910-4-iscsi neutron-server[91689]:     Open vSwitch agent@dv-cinder-790910-4-iscsi: {   'AddressGroup': '1.2',
May 20 04:14:09.987221 dv-cinder-790910-4-iscsi neutron-server[91689]:                                                      'ConntrackHelper': '1.0',
May 20 04:14:09.987221 dv-cinder-790910-4-iscsi neutron-server[91689]:                                                      'Log': '1.0',
May 20 04:14:09.987221 dv-cinder-790910-4-iscsi neutron-server[91689]:                                                      'Network': '1.1',
May 20 04:14:09.987221 dv-cinder-790910-4-iscsi neutron-server[91689]:                                                      'Port': '1.7',
May 20 04:14:09.987221 dv-cinder-790910-4-iscsi neutron-server[91689]:                                                      'PortForwarding': '1.2',
May 20 04:14:09.987221 dv-cinder-790910-4-iscsi neutron-server[91689]:                                                      'QosPolicy': '1.8',
May 20 04:14:09.987221 dv-cinder-790910-4-iscsi neutron-server[91689]:                                                      'SecurityGroup': '1.4',
May 20 04:14:09.987221 dv-cinder-790910-4-iscsi neutron-server[91689]:                                                      'SecurityGroupRule': '1.2',
May 20 04:14:09.987221 dv-cinder-790910-4-iscsi neutron-server[91689]:                                                      'SubPort': '1.0',
May 20 04:14:09.987221 dv-cinder-790910-4-iscsi neutron-server[91689]:                                                      'Subnet': '1.1',
May 20 04:14:09.987221 dv-cinder-790910-4-iscsi neutron-server[91689]:                                                      'Trunk': '1.1'}}
May 20 04:14:09.987221 dv-cinder-790910-4-iscsi neutron-server[91689]:  {{(pid=91689) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
May 20 04:14:09.994615 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-46405917-aa71-47c5-a401-de2f8e2b734f None None] Checking agent: {'id': '333121d4-1023-4a33-a54c-f4dd052e1612', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-790910-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 4, 13, 33), 'started_at': datetime.datetime(2021, 5, 20, 4, 14, 3), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 4, 14, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-790910-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 04:14:09.995046 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-46405917-aa71-47c5-a401-de2f8e2b734f None None] Checking segment: {'id': '0bc260c1-bc85-4b55-a596-f08aa798037e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': '88cea6a9-3544-48bc-afe9-c0c966884538'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91689) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:14:09.995535 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron_lib.callbacks.manager [None req-46405917-aa71-47c5-a401-de2f8e2b734f None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:14:09.996004 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-46405917-aa71-47c5-a401-de2f8e2b734f None None] Bound using segment: {'id': '0bc260c1-bc85-4b55-a596-f08aa798037e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': '88cea6a9-3544-48bc-afe9-c0c966884538'} {{(pid=91689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 04:14:09.996451 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.managers [None req-46405917-aa71-47c5-a401-de2f8e2b734f None None] Bound port: 901ade8f-42a0-4916-8f47-724e14b6ccee, host: dv-cinder-790910-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0bc260c1-bc85-4b55-a596-f08aa798037e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': '88cea6a9-3544-48bc-afe9-c0c966884538'}}] {{(pid=91689) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 04:14:09.996834 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron_lib.callbacks.manager [None req-46405917-aa71-47c5-a401-de2f8e2b734f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:14:10.006924 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG oslo_concurrency.lockutils [None req-a9f95531-ee5d-4065-9923-cf5ce920a47a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.259s {{(pid=91689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:14:10.097317 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.db [None req-46405917-aa71-47c5-a401-de2f8e2b734f None None] For port 901ade8f-42a0-4916-8f47-724e14b6ccee, host dv-cinder-790910-4-iscsi, cleared binding levels {{(pid=91689) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 04:14:10.101954 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.db [None req-46405917-aa71-47c5-a401-de2f8e2b734f None None] For port 901ade8f-42a0-4916-8f47-724e14b6ccee, host dv-cinder-790910-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=901ade8f-42a0-4916-8f47-724e14b6ccee,segment=NetworkSegment(0bc260c1-bc85-4b55-a596-f08aa798037e),segment_id=0bc260c1-bc85-4b55-a596-f08aa798037e)] {{(pid=91689) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 04:14:10.109722 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron_lib.callbacks.manager [None req-46405917-aa71-47c5-a401-de2f8e2b734f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:14:10.113933 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG oslo_concurrency.lockutils [None req-a9f95531-ee5d-4065-9923-cf5ce920a47a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:14:10.232337 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-46405917-aa71-47c5-a401-de2f8e2b734f None None] Routers {'e5de3a3b-9eb2-42c7-a1d8-63a7d2e7a767'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91689) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:14:10.233307 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-46405917-aa71-47c5-a401-de2f8e2b734f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced24c5f70>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:14:03Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['e5de3a3b-9eb2-42c7-a1d8-63a7d2e7a767'], 'active': True} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:14:10.323868 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9f95531-ee5d-4065-9923-cf5ce920a47a None None] Pushing event updated for resources: {'Port': ['ID=901ade8f-42a0-4916-8f47-724e14b6ccee,revision_number=4']} {{(pid=91689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:14:10.329329 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG oslo_concurrency.lockutils [None req-a9f95531-ee5d-4065-9923-cf5ce920a47a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.215s {{(pid=91689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:14:10.427634 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvr_db [None req-46405917-aa71-47c5-a401-de2f8e2b734f None None] Set router e5de3a3b-9eb2-42c7-a1d8-63a7d2e7a767 gateway port host: None {{(pid=91689) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:14:10.770667 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-46405917-aa71-47c5-a401-de2f8e2b734f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced24c5f70>, [{'id': 'e5de3a3b-9eb2-42c7-a1d8-63a7d2e7a767', 'name': 'router1', 'tenant_id': '84d940a99e0247a0a7c7642fac9b3b56', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:13:57Z', 'updated_at': '2021-05-20T04:14:07Z', 'revision_number': 2, 'project_id': '84d940a99e0247a0a7c7642fac9b3b56', 'gw_port_host': None, '_interfaces': [{'id': '901ade8f-42a0-4916-8f47-724e14b6ccee', 'name': '', 'network_id': '88cea6a9-3544-48bc-afe9-c0c966884538', 'tenant_id': '84d940a99e0247a0a7c7642fac9b3b56', 'mac_address': 'fa:16:3e:fd:99:9e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e5de3a3b-9eb2-42c7-a1d8-63a7d2e7a767', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'd0bf3a89-57e8-4fe7-9bf6-24daf5a96d70', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:14:06Z', 'updated_at': '2021-05-20T04:14:10Z', 'revision_number': 4, 'project_id': '84d940a99e0247a0a7c7642fac9b3b56', 'subnets': [{'id': 'd0bf3a89-57e8-4fe7-9bf6-24daf5a96d70', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '2d16963f-5971-47f3-a207-088f45406783'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:14:10.774863 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-46405917-aa71-47c5-a401-de2f8e2b734f None None] The sync data for ids ['e5de3a3b-9eb2-42c7-a1d8-63a7d2e7a767'] in dv-cinder-790910-4-iscsi is: [{'id': 'e5de3a3b-9eb2-42c7-a1d8-63a7d2e7a767', 'name': 'router1', 'tenant_id': '84d940a99e0247a0a7c7642fac9b3b56', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:13:57Z', 'updated_at': '2021-05-20T04:14:07Z', 'revision_number': 2, 'project_id': '84d940a99e0247a0a7c7642fac9b3b56', 'gw_port_host': None, '_interfaces': [{'id': '901ade8f-42a0-4916-8f47-724e14b6ccee', 'name': '', 'network_id': '88cea6a9-3544-48bc-afe9-c0c966884538', 'tenant_id': '84d940a99e0247a0a7c7642fac9b3b56', 'mac_address': 'fa:16:3e:fd:99:9e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e5de3a3b-9eb2-42c7-a1d8-63a7d2e7a767', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'd0bf3a89-57e8-4fe7-9bf6-24daf5a96d70', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:14:06Z', 'updated_at': '2021-05-20T04:14:10Z', 'revision_number': 4, 'project_id': '84d940a99e0247a0a7c7642fac9b3b56', 'subnets': [{'id': 'd0bf3a89-57e8-4fe7-9bf6-24daf5a96d70', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '2d16963f-5971-47f3-a207-088f45406783'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91689) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 04:14:10.925528 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 33658) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:14:11.081627 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a6c8f0aa-45d8-494d-923d-8683b8a995be admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:14:11.083740 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-a6c8f0aa-45d8-494d-923d-8683b8a995be admin admin] 10.222.0.71 "GET /v2.0/networks/aec557db-0c02-4008-8c9f-2efcd7462f90 HTTP/1.1" status: 200  len: 842 time: 0.1567822
May 20 04:14:11.093548 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [None req-2a8b4a71-2005-47c7-ae62-9b71e08c1eab admin admin] Request body: {'subnet': {'name': 'public-subnet', 'enable_dhcp': False, 'gateway_ip': '172.27.1.1', 'cidr': '172.27.1.0/24', 'ip_version': 4, 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90'}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:14:11.099544 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-2a8b4a71-2005-47c7-ae62-9b71e08c1eab admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:14:11.103677 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-2a8b4a71-2005-47c7-ae62-9b71e08c1eab admin admin] Usage tracker for resource:subnet and tenant:a53818aa01c142a68e4227871399c86a is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:14:11.106874 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-2a8b4a71-2005-47c7-ae62-9b71e08c1eab admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:14:11.116530 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-2a8b4a71-2005-47c7-ae62-9b71e08c1eab admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:14:11.127440 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2a8b4a71-2005-47c7-ae62-9b71e08c1eab admin admin] Made reservation on behalf of a53818aa01c142a68e4227871399c86a for: {'subnet': 1} {{(pid=91687) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 04:14:11.129927 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-2a8b4a71-2005-47c7-ae62-9b71e08c1eab admin admin] Notify callbacks [] for subnet, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:14:11.612835 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.objects.ports [None req-2a8b4a71-2005-47c7-ae62-9b71e08c1eab admin admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=91687) get_objects /opt/stack/neutron/neutron/objects/ports.py:443}}
May 20 04:14:11.613355 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-2a8b4a71-2005-47c7-ae62-9b71e08c1eab admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-255887', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377'] for subnet, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:14:11.617165 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:14:11.689883 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a8b4a71-2005-47c7-ae62-9b71e08c1eab admin admin] Pushing event updated for resources: {'Subnet': ['ID=217f4b55-4415-4d57-8b43-2ff4c8ac8e81,revision_number=0']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:14:11.695939 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-2a8b4a71-2005-47c7-ae62-9b71e08c1eab admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:14:11.702718 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2a8b4a71-2005-47c7-ae62-9b71e08c1eab admin admin] Checking segment: {'id': '8df49ec5-3fb9-4715-bc9a-f4019a6b55f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91687) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:14:11.703124 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2a8b4a71-2005-47c7-ae62-9b71e08c1eab admin admin] Network hostable DHCP agents. Network: aec557db-0c02-4008-8c9f-2efcd7462f90, hostable agents: ['36d27813-c368-4fd7-ae26-0f662e0a96fd'], hosted agents: [] {{(pid=91687) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 20 04:14:11.724568 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2a8b4a71-2005-47c7-ae62-9b71e08c1eab admin admin] Network aec557db-0c02-4008-8c9f-2efcd7462f90 is scheduled to be hosted by DHCP agent 36d27813-c368-4fd7-ae26-0f662e0a96fd with binding_index 1 {{(pid=91687) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 20 04:14:11.735744 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.base_scheduler [None req-2a8b4a71-2005-47c7-ae62-9b71e08c1eab admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-790910-4-iscsi, aec557db-0c02-4008-8c9f-2efcd7462f90) {{(pid=91687) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:14:11.740464 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2a8b4a71-2005-47c7-ae62-9b71e08c1eab admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:14:11.741113 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-2a8b4a71-2005-47c7-ae62-9b71e08c1eab admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for subnet, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:14:11.748342 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e2835bc1-7654-446e-9c3a-cb2001eea6e5 None None] Network aec557db-0c02-4008-8c9f-2efcd7462f90 requested from dv-cinder-790910-4-iscsi {{(pid=91688) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 04:14:11.772998 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-2a8b4a71-2005-47c7-ae62-9b71e08c1eab admin admin] 10.222.0.71 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 821 time: 0.6743851
May 20 04:14:12.052097 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-44df98b5-c041-43c9-8f42-3c5eff61d8b2 None None] Network aec557db-0c02-4008-8c9f-2efcd7462f90 requested from dv-cinder-790910-4-iscsi {{(pid=91688) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 04:14:14.121840 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 33672) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:14:14.343911 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-73d4e5ff-71ba-46ee-9811-3be3328ec87a admin admin] 10.222.0.71 "GET /v2.0/routers/e5de3a3b-9eb2-42c7-a1d8-63a7d2e7a767 HTTP/1.1" status: 200  len: 710 time: 0.2209127
May 20 04:14:14.538669 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-adcc0fac-80f1-4928-a5a6-af2fc6953d6d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:14:14.540197 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-adcc0fac-80f1-4928-a5a6-af2fc6953d6d admin admin] 10.222.0.71 "GET /v2.0/networks/aec557db-0c02-4008-8c9f-2efcd7462f90 HTTP/1.1" status: 200  len: 886 time: 0.1907511
May 20 04:14:14.553734 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [None req-7b6806eb-2c6e-4ac4-83ec-fa177bc93335 admin admin] Request body: {'router': {'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90'}}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:14:14.750182 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 901ade8f-42a0-4916-8f47-724e14b6ccee up at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:14:14.819746 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning for port 901ade8f-42a0-4916-8f47-724e14b6ccee completed by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:14:14.824906 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning complete for port 901ade8f-42a0-4916-8f47-724e14b6ccee triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:14:14.825307 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:14:14.947633 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:14:14.987932 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] For port 901ade8f-42a0-4916-8f47-724e14b6ccee, host dv-cinder-790910-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=901ade8f-42a0-4916-8f47-724e14b6ccee,segment=NetworkSegment(0bc260c1-bc85-4b55-a596-f08aa798037e),segment_id=0bc260c1-bc85-4b55-a596-f08aa798037e)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:14:14.993029 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:14:14.995661 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1825ba06-1501-401c-80f2-26fe87f31ac4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:14:15.072698 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Pushing event updated for resources: {'Port': ['ID=901ade8f-42a0-4916-8f47-724e14b6ccee,revision_number=5']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:14:15.076511 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:14:15.157673 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-7b6806eb-2c6e-4ac4-83ec-fa177bc93335 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1713977', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1796355', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-6218'] for router, precommit_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:14:15.497854 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-7b6806eb-2c6e-4ac4-83ec-fa177bc93335 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:14:15.558728 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-7b6806eb-2c6e-4ac4-83ec-fa177bc93335 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:14:15.747956 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.db_base_plugin_common [None req-7b6806eb-2c6e-4ac4-83ec-fa177bc93335 admin admin] Allocated IP 172.27.1.169 (aec557db-0c02-4008-8c9f-2efcd7462f90/217f4b55-4415-4d57-8b43-2ff4c8ac8e81/005c8ffe-c66a-4306-8ee7-d510b39bb6db) {{(pid=91687) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 04:14:15.903776 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-7b6806eb-2c6e-4ac4-83ec-fa177bc93335 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:14:15.937242 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-7b6806eb-2c6e-4ac4-83ec-fa177bc93335 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8782892106231'] for port, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:14:15.942964 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:14:16.066701 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7b6806eb-2c6e-4ac4-83ec-fa177bc93335 admin admin] Network aec557db-0c02-4008-8c9f-2efcd7462f90 is already hosted by enough agents. {{(pid=91687) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:14:16.069644 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.base_scheduler [None req-7b6806eb-2c6e-4ac4-83ec-fa177bc93335 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91687) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:14:16.072580 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7b6806eb-2c6e-4ac4-83ec-fa177bc93335 admin admin] Received port after_create {{(pid=91687) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 04:14:16.143820 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b6806eb-2c6e-4ac4-83ec-fa177bc93335 admin admin] Pushing event updated for resources: {'Port': ['ID=005c8ffe-c66a-4306-8ee7-d510b39bb6db,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:14:16.195941 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-7b6806eb-2c6e-4ac4-83ec-fa177bc93335 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.253s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:14:16.513721 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-7b6806eb-2c6e-4ac4-83ec-fa177bc93335 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:14:16.696718 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 901ade8f-42a0-4916-8f47-724e14b6ccee up at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:14:16.770480 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning complete for port 901ade8f-42a0-4916-8f47-724e14b6ccee triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:14:16.770722 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:14:16.932729 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-7b6806eb-2c6e-4ac4-83ec-fa177bc93335 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1713977', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1796355', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-6218'] for router, precommit_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:14:16.936645 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-7b6806eb-2c6e-4ac4-83ec-fa177bc93335 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1714058', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1714168', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1714049', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1796381'] for router, after_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:14:17.118627 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7b6806eb-2c6e-4ac4-83ec-fa177bc93335 admin admin] Router e5de3a3b-9eb2-42c7-a1d8-63a7d2e7a767 has already been hosted by L3 agent 02733fc0-fc9c-4e29-bc03-c27a792d539d {{(pid=91687) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 04:14:17.307745 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7b6806eb-2c6e-4ac4-83ec-fa177bc93335 admin admin] Notify agent at l3_agent.dv-cinder-790910-4-iscsi the message routers_updated {{(pid=91687) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 04:14:17.320051 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-7b6806eb-2c6e-4ac4-83ec-fa177bc93335 admin admin] Notify callbacks [] for router, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:14:17.320497 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-556ecf47-9e7f-47f9-9fb4-397550dd4bb2 None None] Sync routers for ids ['e5de3a3b-9eb2-42c7-a1d8-63a7d2e7a767'] in dv-cinder-790910-4-iscsi {{(pid=91688) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 04:14:17.322015 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-7b6806eb-2c6e-4ac4-83ec-fa177bc93335 admin admin] 10.222.0.71 "PUT /v2.0/routers/e5de3a3b-9eb2-42c7-a1d8-63a7d2e7a767 HTTP/1.1" status: 200  len: 890 time: 2.7717957
May 20 04:14:17.333021 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-556ecf47-9e7f-47f9-9fb4-397550dd4bb2 None None] Routers {'e5de3a3b-9eb2-42c7-a1d8-63a7d2e7a767'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91688) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:14:17.333812 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-556ecf47-9e7f-47f9-9fb4-397550dd4bb2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced1a98ee0>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:14:03Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['e5de3a3b-9eb2-42c7-a1d8-63a7d2e7a767'], 'active': True} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:14:17.576244 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvr_db [None req-556ecf47-9e7f-47f9-9fb4-397550dd4bb2 None None] Set router e5de3a3b-9eb2-42c7-a1d8-63a7d2e7a767 gateway port host: dv-cinder-790910-4-iscsi {{(pid=91688) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:14:17.992775 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-556ecf47-9e7f-47f9-9fb4-397550dd4bb2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced1a98ee0>, [{'id': 'e5de3a3b-9eb2-42c7-a1d8-63a7d2e7a767', 'name': 'router1', 'tenant_id': '84d940a99e0247a0a7c7642fac9b3b56', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.169'}], 'enable_snat': True}, 'gw_port_id': '005c8ffe-c66a-4306-8ee7-d510b39bb6db', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:13:57Z', 'updated_at': '2021-05-20T04:14:16Z', 'revision_number': 4, 'project_id': '84d940a99e0247a0a7c7642fac9b3b56', 'gw_port': {'id': '005c8ffe-c66a-4306-8ee7-d510b39bb6db', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:f8:3e:c4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e5de3a3b-9eb2-42c7-a1d8-63a7d2e7a767', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.169', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:14:15Z', 'updated_at': '2021-05-20T04:14:15Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_interfaces': [{'id': '901ade8f-42a0-4916-8f47-724e14b6ccee', 'name': '', 'network_id': '88cea6a9-3544-48bc-afe9-c0c966884538', 'tenant_id': '84d940a99e0247a0a7c7642fac9b3b56', 'mac_address': 'fa:16:3e:fd:99:9e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e5de3a3b-9eb2-42c7-a1d8-63a7d2e7a767', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'd0bf3a89-57e8-4fe7-9bf6-24daf5a96d70', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:14:06Z', 'updated_at': '2021-05-20T04:14:14Z', 'revision_number': 5, 'project_id': '84d940a99e0247a0a7c7642fac9b3b56', 'subnets': [{'id': 'd0bf3a89-57e8-4fe7-9bf6-24daf5a96d70', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '2d16963f-5971-47f3-a207-088f45406783'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:14:18.001672 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-556ecf47-9e7f-47f9-9fb4-397550dd4bb2 None None] Checking router: e5de3a3b-9eb2-42c7-a1d8-63a7d2e7a767 for host: dv-cinder-790910-4-iscsi {{(pid=91688) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 04:14:18.002261 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-556ecf47-9e7f-47f9-9fb4-397550dd4bb2 None None] Updating router e5de3a3b-9eb2-42c7-a1d8-63a7d2e7a767 port 005c8ffe-c66a-4306-8ee7-d510b39bb6db binding host dv-cinder-790910-4-iscsi {{(pid=91688) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 20 04:14:18.099637 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-556ecf47-9e7f-47f9-9fb4-397550dd4bb2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:14:18.549319 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-556ecf47-9e7f-47f9-9fb4-397550dd4bb2 None None] Notify callbacks [] for port, precommit_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:14:18.564097 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-556ecf47-9e7f-47f9-9fb4-397550dd4bb2 None None] Transition to ACTIVE for port object 005c8ffe-c66a-4306-8ee7-d510b39bb6db will not be triggered until provisioned by entity L2. {{(pid=91688) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:14:18.573077 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-556ecf47-9e7f-47f9-9fb4-397550dd4bb2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:14:18.577500 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:14:18.669979 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6c8deb6-a49b-4eff-ad77-b0ee2103e5ba None None] Pushing event updated for resources: {'Port': ['ID=005c8ffe-c66a-4306-8ee7-d510b39bb6db,revision_number=2']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:14:18.673084 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.managers [None req-556ecf47-9e7f-47f9-9fb4-397550dd4bb2 None None] Attempting to bind port 005c8ffe-c66a-4306-8ee7-d510b39bb6db on host dv-cinder-790910-4-iscsi for vnic_type normal with profile  {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 04:14:18.673545 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.managers [None req-556ecf47-9e7f-47f9-9fb4-397550dd4bb2 None None] Attempting to bind port 005c8ffe-c66a-4306-8ee7-d510b39bb6db by drivers openvswitch,hyperv on host dv-cinder-790910-4-iscsi at level 0 using segments [{'id': '8df49ec5-3fb9-4715-bc9a-f4019a6b55f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90'}] {{(pid=91688) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 04:14:18.673995 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-556ecf47-9e7f-47f9-9fb4-397550dd4bb2 None None] Attempting to bind port 005c8ffe-c66a-4306-8ee7-d510b39bb6db on network aec557db-0c02-4008-8c9f-2efcd7462f90 {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:14:18.676732 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-c6c8deb6-a49b-4eff-ad77-b0ee2103e5ba None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.099s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:14:18.681566 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-556ecf47-9e7f-47f9-9fb4-397550dd4bb2 None None] Checking agent: {'id': '333121d4-1023-4a33-a54c-f4dd052e1612', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-790910-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 4, 13, 33), 'started_at': datetime.datetime(2021, 5, 20, 4, 14, 3), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 4, 14, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-790910-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 04:14:18.682213 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-556ecf47-9e7f-47f9-9fb4-397550dd4bb2 None None] Checking segment: {'id': '8df49ec5-3fb9-4715-bc9a-f4019a6b55f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91688) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:14:18.682569 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-556ecf47-9e7f-47f9-9fb4-397550dd4bb2 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:14:18.683036 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-556ecf47-9e7f-47f9-9fb4-397550dd4bb2 None None] Bound using segment: {'id': '8df49ec5-3fb9-4715-bc9a-f4019a6b55f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90'} {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 04:14:18.683622 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.managers [None req-556ecf47-9e7f-47f9-9fb4-397550dd4bb2 None None] Bound port: 005c8ffe-c66a-4306-8ee7-d510b39bb6db, host: dv-cinder-790910-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8df49ec5-3fb9-4715-bc9a-f4019a6b55f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90'}}] {{(pid=91688) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 04:14:18.684129 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-556ecf47-9e7f-47f9-9fb4-397550dd4bb2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:14:18.793212 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-556ecf47-9e7f-47f9-9fb4-397550dd4bb2 None None] For port 005c8ffe-c66a-4306-8ee7-d510b39bb6db, host dv-cinder-790910-4-iscsi, cleared binding levels {{(pid=91688) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 04:14:18.796882 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-556ecf47-9e7f-47f9-9fb4-397550dd4bb2 None None] For port 005c8ffe-c66a-4306-8ee7-d510b39bb6db, host dv-cinder-790910-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=005c8ffe-c66a-4306-8ee7-d510b39bb6db,segment=NetworkSegment(8df49ec5-3fb9-4715-bc9a-f4019a6b55f9),segment_id=8df49ec5-3fb9-4715-bc9a-f4019a6b55f9)] {{(pid=91688) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 04:14:18.803523 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-556ecf47-9e7f-47f9-9fb4-397550dd4bb2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:14:18.808022 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:14:18.887292 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-556ecf47-9e7f-47f9-9fb4-397550dd4bb2 None None] Routers {'e5de3a3b-9eb2-42c7-a1d8-63a7d2e7a767'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91688) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:14:18.887925 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-556ecf47-9e7f-47f9-9fb4-397550dd4bb2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced1a98ee0>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:14:03Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['e5de3a3b-9eb2-42c7-a1d8-63a7d2e7a767'], 'active': True} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:14:18.985494 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6c8deb6-a49b-4eff-ad77-b0ee2103e5ba None None] Pushing event updated for resources: {'Port': ['ID=005c8ffe-c66a-4306-8ee7-d510b39bb6db,revision_number=3']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:14:18.993067 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-c6c8deb6-a49b-4eff-ad77-b0ee2103e5ba None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.185s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:14:19.158052 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvr_db [None req-556ecf47-9e7f-47f9-9fb4-397550dd4bb2 None None] Set router e5de3a3b-9eb2-42c7-a1d8-63a7d2e7a767 gateway port host: dv-cinder-790910-4-iscsi {{(pid=91688) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:14:19.561321 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-556ecf47-9e7f-47f9-9fb4-397550dd4bb2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced1a98ee0>, [{'id': 'e5de3a3b-9eb2-42c7-a1d8-63a7d2e7a767', 'name': 'router1', 'tenant_id': '84d940a99e0247a0a7c7642fac9b3b56', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.169'}], 'enable_snat': True}, 'gw_port_id': '005c8ffe-c66a-4306-8ee7-d510b39bb6db', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:13:57Z', 'updated_at': '2021-05-20T04:14:16Z', 'revision_number': 4, 'project_id': '84d940a99e0247a0a7c7642fac9b3b56', 'gw_port': {'id': '005c8ffe-c66a-4306-8ee7-d510b39bb6db', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:f8:3e:c4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e5de3a3b-9eb2-42c7-a1d8-63a7d2e7a767', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.169', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:14:15Z', 'updated_at': '2021-05-20T04:14:18Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_interfaces': [{'id': '901ade8f-42a0-4916-8f47-724e14b6ccee', 'name': '', 'network_id': '88cea6a9-3544-48bc-afe9-c0c966884538', 'tenant_id': '84d940a99e0247a0a7c7642fac9b3b56', 'mac_address': 'fa:16:3e:fd:99:9e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e5de3a3b-9eb2-42c7-a1d8-63a7d2e7a767', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'd0bf3a89-57e8-4fe7-9bf6-24daf5a96d70', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:14:06Z', 'updated_at': '2021-05-20T04:14:14Z', 'revision_number': 5, 'project_id': '84d940a99e0247a0a7c7642fac9b3b56', 'subnets': [{'id': 'd0bf3a89-57e8-4fe7-9bf6-24daf5a96d70', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '2d16963f-5971-47f3-a207-088f45406783'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:14:19.569106 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-556ecf47-9e7f-47f9-9fb4-397550dd4bb2 None None] The sync data for ids ['e5de3a3b-9eb2-42c7-a1d8-63a7d2e7a767'] in dv-cinder-790910-4-iscsi is: [{'id': 'e5de3a3b-9eb2-42c7-a1d8-63a7d2e7a767', 'name': 'router1', 'tenant_id': '84d940a99e0247a0a7c7642fac9b3b56', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.169'}], 'enable_snat': True}, 'gw_port_id': '005c8ffe-c66a-4306-8ee7-d510b39bb6db', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:13:57Z', 'updated_at': '2021-05-20T04:14:16Z', 'revision_number': 4, 'project_id': '84d940a99e0247a0a7c7642fac9b3b56', 'gw_port': {'id': '005c8ffe-c66a-4306-8ee7-d510b39bb6db', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:f8:3e:c4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e5de3a3b-9eb2-42c7-a1d8-63a7d2e7a767', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.169', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:14:15Z', 'updated_at': '2021-05-20T04:14:18Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_interfaces': [{'id': '901ade8f-42a0-4916-8f47-724e14b6ccee', 'name': '', 'network_id': '88cea6a9-3544-48bc-afe9-c0c966884538', 'tenant_id': '84d940a99e0247a0a7c7642fac9b3b56', 'mac_address': 'fa:16:3e:fd:99:9e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e5de3a3b-9eb2-42c7-a1d8-63a7d2e7a767', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'd0bf3a89-57e8-4fe7-9bf6-24daf5a96d70', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:14:06Z', 'updated_at': '2021-05-20T04:14:14Z', 'revision_number': 5, 'project_id': '84d940a99e0247a0a7c7642fac9b3b56', 'subnets': [{'id': 'd0bf3a89-57e8-4fe7-9bf6-24daf5a96d70', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '2d16963f-5971-47f3-a207-088f45406783'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91688) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 04:14:19.785682 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 33682) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:14:19.919424 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-9e75728f-e2b3-4cbd-8669-e19648397a8f admin admin] 10.222.0.71 "GET /v2.0/ports?device_owner=network%3Arouter_gateway&fields=id&fields=name&fields=mac_address&fields=fixed_ips&fields=status HTTP/1.1" status: 200  len: 411 time: 0.1325748
May 20 04:14:20.709450 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 005c8ffe-c66a-4306-8ee7-d510b39bb6db up at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:14:20.781624 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning for port 005c8ffe-c66a-4306-8ee7-d510b39bb6db completed by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:14:20.787000 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning complete for port 005c8ffe-c66a-4306-8ee7-d510b39bb6db triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:14:20.787386 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:14:20.914533 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:14:20.934057 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] For port 005c8ffe-c66a-4306-8ee7-d510b39bb6db, host dv-cinder-790910-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=005c8ffe-c66a-4306-8ee7-d510b39bb6db,segment=NetworkSegment(8df49ec5-3fb9-4715-bc9a-f4019a6b55f9),segment_id=8df49ec5-3fb9-4715-bc9a-f4019a6b55f9)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:14:20.941826 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:14:20.945243 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:14:21.018826 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Pushing event updated for resources: {'Port': ['ID=005c8ffe-c66a-4306-8ee7-d510b39bb6db,revision_number=4']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:14:21.021918 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:14:22.737677 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 005c8ffe-c66a-4306-8ee7-d510b39bb6db up at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:14:22.818029 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning complete for port 005c8ffe-c66a-4306-8ee7-d510b39bb6db triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:14:22.818608 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:14:29.836322 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-4e82a254-54c6-47c7-954e-b73d46ed3a13 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:14:32.531696 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:14:32.642490 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-abae5076-2303-4a9e-90a4-ff40373c9cae None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:14:33.265021 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ea4803bd-878f-47d5-9084-1ec41953c9db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:14:35.097060 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f21320cc-6a25-4ec1-8a32-8b119b35fd55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:14:41.757421 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.agents_db [None req-92d61f12-17bc-4bf9-9eab-8a69b8c6da2f None None] Agent healthcheck: found 5 active agents {{(pid=91689) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 04:14:59.828154 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-dc5997ad-6463-49f1-8903-7590d0563b31 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:15:02.543116 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:15:02.656093 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ba19098d-bc15-475f-ab15-e5273678d43d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:15:03.267608 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ea4803bd-878f-47d5-9084-1ec41953c9db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:15:05.106784 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f21320cc-6a25-4ec1-8a32-8b119b35fd55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:15:18.756883 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.agents_db [None req-92d61f12-17bc-4bf9-9eab-8a69b8c6da2f None None] Agent healthcheck: found 5 active agents {{(pid=91689) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 04:15:29.824015 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-43433b4b-968b-45ed-8397-d7aa24ccb84e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:15:32.543002 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:15:32.641464 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-e1037985-5568-422a-9752-a955f9d6b8d4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:15:33.273460 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ea4803bd-878f-47d5-9084-1ec41953c9db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:15:35.096575 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f21320cc-6a25-4ec1-8a32-8b119b35fd55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:15:55.756046 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.agents_db [None req-92d61f12-17bc-4bf9-9eab-8a69b8c6da2f None None] Agent healthcheck: found 5 active agents {{(pid=91689) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 04:15:57.169761 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 34252) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:15:57.244291 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.pecan_wsgi.hooks.translation [None req-e7c8ebb6-5d4c-4e4d-8da2-f8b2ce8a2b42 admin admin] GET failed (client error): The resource could not be found.
May 20 04:15:57.244808 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-e7c8ebb6-5d4c-4e4d-8da2-f8b2ce8a2b42 admin admin] Synchronizing usage tracker for tenant:a53818aa01c142a68e4227871399c86a on resource:network {{(pid=91686) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:15:57.265315 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-e7c8ebb6-5d4c-4e4d-8da2-f8b2ce8a2b42 admin admin] Unset dirty status for tenant:a53818aa01c142a68e4227871399c86a on resource:network {{(pid=91686) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:15:57.266456 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-e7c8ebb6-5d4c-4e4d-8da2-f8b2ce8a2b42 admin admin] 10.222.0.71 "GET /v2.0/networks/private HTTP/1.1" status: 404  len: 315 time: 0.0957625
May 20 04:15:57.401756 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-979bfa9b-99ea-4ee3-89e3-d2e78d438f59 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:15:57.403191 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-979bfa9b-99ea-4ee3-89e3-d2e78d438f59 admin admin] 10.222.0.71 "GET /v2.0/networks?name=private HTTP/1.1" status: 200  len: 872 time: 0.1324959
May 20 04:15:59.521333 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 34262) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:15:59.634427 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2ee60be1-d914-4b0d-ad73-7267f1cfa929 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:15:59.635782 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-2ee60be1-d914-4b0d-ad73-7267f1cfa929 admin admin] 10.222.0.71 "GET /v2.0/subnets/d0bf3a89-57e8-4fe7-9bf6-24daf5a96d70 HTTP/1.1" status: 200  len: 849 time: 0.1134915
May 20 04:15:59.645351 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.v2.base [None req-18e469f0-fa10-4731-b31b-ed92470fe766 admin admin] Request body: {'subnet': {'dns_nameservers': ['8.8.8.8', '8.8.4.4']}} {{(pid=91686) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:15:59.767608 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-18e469f0-fa10-4731-b31b-ed92470fe766 admin admin] Notify callbacks [] for subnet, before_update {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:15:59.828323 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ff8a089e-ec93-42cf-8345-fa67c5d1196a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:15:59.967894 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-18e469f0-fa10-4731-b31b-ed92470fe766 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-255887', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8782892522918'] for subnet, after_update {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:15:59.973004 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:16:00.010912 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-18e469f0-fa10-4731-b31b-ed92470fe766 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:16:00.010912 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-18e469f0-fa10-4731-b31b-ed92470fe766 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for subnet, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:16:00.012199 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-18e469f0-fa10-4731-b31b-ed92470fe766 admin admin] 10.222.0.71 "PUT /v2.0/subnets/d0bf3a89-57e8-4fe7-9bf6-24daf5a96d70 HTTP/1.1" status: 200  len: 868 time: 0.3706694
May 20 04:16:00.014478 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-350ce625-a2f5-4b00-8aae-1ce1ccd153b3 None None] Network 88cea6a9-3544-48bc-afe9-c0c966884538 requested from dv-cinder-790910-4-iscsi {{(pid=91688) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 04:16:00.041695 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18e469f0-fa10-4731-b31b-ed92470fe766 admin admin] Pushing event updated for resources: {'Subnet': ['ID=d0bf3a89-57e8-4fe7-9bf6-24daf5a96d70,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:16:00.050197 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18e469f0-fa10-4731-b31b-ed92470fe766 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:16:00.050551 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18e469f0-fa10-4731-b31b-ed92470fe766 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:16:00.050889 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18e469f0-fa10-4731-b31b-ed92470fe766 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:16:00.051210 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18e469f0-fa10-4731-b31b-ed92470fe766 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:16:00.051537 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18e469f0-fa10-4731-b31b-ed92470fe766 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:16:00.051892 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18e469f0-fa10-4731-b31b-ed92470fe766 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:16:00.052371 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18e469f0-fa10-4731-b31b-ed92470fe766 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:16:00.052691 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18e469f0-fa10-4731-b31b-ed92470fe766 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:16:00.053041 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18e469f0-fa10-4731-b31b-ed92470fe766 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:16:00.053333 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18e469f0-fa10-4731-b31b-ed92470fe766 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:16:00.053903 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18e469f0-fa10-4731-b31b-ed92470fe766 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:16:00.054254 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18e469f0-fa10-4731-b31b-ed92470fe766 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:16:00.058057 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-18e469f0-fa10-4731-b31b-ed92470fe766 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:16:00.466630 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-76674011-3f46-4b54-82a1-80e133e1be6d None None] Provisioning complete for port 69ea2d25-dbaa-4b41-99c9-58934f28541e triggered by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:16:00.466982 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-76674011-3f46-4b54-82a1-80e133e1be6d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:16:00.592372 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-76674011-3f46-4b54-82a1-80e133e1be6d None None] Provisioning complete for port 901ade8f-42a0-4916-8f47-724e14b6ccee triggered by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:16:00.592606 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-76674011-3f46-4b54-82a1-80e133e1be6d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:16:02.153701 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 34272) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:16:02.334971 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5f3e7bec-8fb2-4577-96d3-463d652a64ae admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:16:02.335443 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5f3e7bec-8fb2-4577-96d3-463d652a64ae admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:16:02.337016 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-5f3e7bec-8fb2-4577-96d3-463d652a64ae admin admin] 10.222.0.71 "GET /v2.0/networks HTTP/1.1" status: 200  len: 1549 time: 0.1824219
May 20 04:16:02.537559 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:16:02.647442 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-dc03bce5-28f0-4ef9-a79e-21ca3be6576a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:16:03.273299 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ea4803bd-878f-47d5-9084-1ec41953c9db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:16:04.452385 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 34282) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:16:04.648263 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cc9dd602-996d-4344-9f92-47eb216ce2ce admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:16:04.648649 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cc9dd602-996d-4344-9f92-47eb216ce2ce admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:16:04.650309 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-cc9dd602-996d-4344-9f92-47eb216ce2ce admin admin] 10.222.0.71 "GET /v2.0/networks HTTP/1.1" status: 200  len: 1549 time: 0.1968470
May 20 04:16:05.101039 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f21320cc-6a25-4ec1-8a32-8b119b35fd55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:16:06.796542 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 34292) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:16:07.049463 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4c923016-5eb0-4ef7-b128-154a35dcb131 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:16:07.050815 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-4c923016-5eb0-4ef7-b128-154a35dcb131 admin admin] 10.222.0.71 "GET /v2.0/networks/88cea6a9-3544-48bc-afe9-c0c966884538 HTTP/1.1" status: 200  len: 869 time: 0.2532108
May 20 04:16:09.183544 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 34302) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:16:09.361766 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e8f0777e-0955-485d-96c7-5f20fe20e541 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:16:09.363010 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-e8f0777e-0955-485d-96c7-5f20fe20e541 admin admin] 10.222.0.71 "GET /v2.0/networks/aec557db-0c02-4008-8c9f-2efcd7462f90 HTTP/1.1" status: 200  len: 886 time: 0.1785438
May 20 04:16:11.478039 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 34312) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:16:11.609105 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-de391307-3683-4b52-a023-53bab7a7d3e4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:16:11.609572 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-de391307-3683-4b52-a023-53bab7a7d3e4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:16:11.611079 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-de391307-3683-4b52-a023-53bab7a7d3e4 admin admin] 10.222.0.71 "GET /v2.0/subnets HTTP/1.1" status: 200  len: 1479 time: 0.1320956
May 20 04:16:13.712430 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 34322) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:16:13.826359 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4052e680-8acf-403f-9a94-e4d3de9ec600 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:16:13.826807 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4052e680-8acf-403f-9a94-e4d3de9ec600 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:16:13.827596 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-4052e680-8acf-403f-9a94-e4d3de9ec600 admin admin] Synchronizing usage tracker for tenant:a53818aa01c142a68e4227871399c86a on resource:subnet {{(pid=91687) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:16:13.847227 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-4052e680-8acf-403f-9a94-e4d3de9ec600 admin admin] Unset dirty status for tenant:a53818aa01c142a68e4227871399c86a on resource:subnet {{(pid=91687) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:16:13.848413 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-4052e680-8acf-403f-9a94-e4d3de9ec600 admin admin] 10.222.0.71 "GET /v2.0/subnets HTTP/1.1" status: 200  len: 1479 time: 0.1348987
May 20 04:16:15.955984 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 34332) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:16:16.059768 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-60fe6a0b-d75c-40c2-90be-2e1656140d21 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:16:16.061145 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-60fe6a0b-d75c-40c2-90be-2e1656140d21 admin admin] 10.222.0.71 "GET /v2.0/subnets/217f4b55-4415-4d57-8b43-2ff4c8ac8e81 HTTP/1.1" status: 200  len: 816 time: 0.1041849
May 20 04:16:18.177680 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 34342) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:16:18.288603 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-925c16ba-c04d-499d-bd88-22e5727a4f5d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:16:18.289987 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-925c16ba-c04d-499d-bd88-22e5727a4f5d admin admin] 10.222.0.71 "GET /v2.0/subnets/d0bf3a89-57e8-4fe7-9bf6-24daf5a96d70 HTTP/1.1" status: 200  len: 868 time: 0.1113689
May 20 04:16:29.835688 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-18b3301b-3023-4b7f-a499-9a3f945fe9dd None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:16:32.543829 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:16:32.652006 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f6b2608d-b4dd-4844-a0a5-3231a15316e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:16:32.755336 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.agents_db [None req-92d61f12-17bc-4bf9-9eab-8a69b8c6da2f None None] Agent healthcheck: found 5 active agents {{(pid=91689) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 04:16:33.277368 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ea4803bd-878f-47d5-9084-1ec41953c9db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:16:35.104495 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f21320cc-6a25-4ec1-8a32-8b119b35fd55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:16:41.069449 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 34386) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:16:41.127837 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [None req-f42fb1cf-2433-42b1-b739-fa98d4114abd admin admin] http://10.222.0.71:9696/v2.0/extensions returned with HTTP 200 {{(pid=91686) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 20 04:16:41.129015 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-f42fb1cf-2433-42b1-b739-fa98d4114abd admin admin] 10.222.0.71 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0585899
May 20 04:16:43.353827 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 34396) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:16:43.424091 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.pecan_wsgi.hooks.translation [None req-e6adefcc-8648-403a-b269-71ad71030948 admin admin] GET failed (client error): The resource could not be found.
May 20 04:16:43.425448 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-e6adefcc-8648-403a-b269-71ad71030948 admin admin] 10.222.0.71 "GET /v2.0/networks/public HTTP/1.1" status: 404  len: 314 time: 0.0708377
May 20 04:16:43.554185 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1e26af5c-c925-4e75-9e9a-1e6e311ac279 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:16:43.555576 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-1e26af5c-c925-4e75-9e9a-1e6e311ac279 admin admin] 10.222.0.71 "GET /v2.0/networks?name=public HTTP/1.1" status: 200  len: 889 time: 0.1260426
May 20 04:16:45.695365 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 34406) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:16:45.746858 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.v2.base [None req-47ad0ee6-a2b0-4a68-8b50-6336f5dc6541 admin admin] Request body: {'network': {'shared': True, 'admin_state_up': True, 'name': 'shared'}} {{(pid=91686) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:16:45.751627 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-47ad0ee6-a2b0-4a68-8b50-6336f5dc6541 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:16:45.761953 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-47ad0ee6-a2b0-4a68-8b50-6336f5dc6541 admin admin] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:16:45.773823 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-47ad0ee6-a2b0-4a68-8b50-6336f5dc6541 admin admin] Made reservation on behalf of a53818aa01c142a68e4227871399c86a for: {'network': 1} {{(pid=91686) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 04:16:45.776052 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-47ad0ee6-a2b0-4a68-8b50-6336f5dc6541 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-578118'] for network, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:16:45.862505 dv-cinder-790910-4-iscsi neutron-server[91686]: WARNING neutron.services.revisions.revision_plugin [None req-47ad0ee6-a2b0-4a68-8b50-6336f5dc6541 admin admin] Could not find related network for resource <neutron.db.rbac_db_models.NetworkRBAC[object at 7fced16c45e0] {project_id='a53818aa01c142a68e4227871399c86a', id='eec808bc-d886-41e4-9b86-cdeb3f7f5269', target_tenant='*', action='access_as_shared', object_id='c5893098-fb92-4405-a661-0d84b5d35597'}> to bump revision.
May 20 04:16:45.874068 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-47ad0ee6-a2b0-4a68-8b50-6336f5dc6541 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 886}  {{(pid=91686) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 20 04:16:45.882824 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-47ad0ee6-a2b0-4a68-8b50-6336f5dc6541 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1501910'] for segment, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:16:45.883163 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.db.segments_db [None req-47ad0ee6-a2b0-4a68-8b50-6336f5dc6541 admin admin] Added segment 5d30f0fa-a01e-48f4-ae41-9529b23cf3c9 of type vlan for network c5893098-fb92-4405-a661-0d84b5d35597
May 20 04:16:45.909470 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-47ad0ee6-a2b0-4a68-8b50-6336f5dc6541 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8782892092784'] for network, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:16:45.940246 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-47ad0ee6-a2b0-4a68-8b50-6336f5dc6541 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1590664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1781430'] for network, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:16:45.941556 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-47ad0ee6-a2b0-4a68-8b50-6336f5dc6541 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:16:45.942124 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-47ad0ee6-a2b0-4a68-8b50-6336f5dc6541 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for network, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:16:45.945245 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:16:46.041641 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47ad0ee6-a2b0-4a68-8b50-6336f5dc6541 admin admin] Pushing event updated for resources: {'Network': ['ID=c5893098-fb92-4405-a661-0d84b5d35597,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:16:46.045611 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-47ad0ee6-a2b0-4a68-8b50-6336f5dc6541 admin admin] 10.222.0.71 "POST /v2.0/networks HTTP/1.1" status: 201  len: 847 time: 0.3492365
May 20 04:16:46.046349 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-47ad0ee6-a2b0-4a68-8b50-6336f5dc6541 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.101s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:16:46.052236 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Network c5893098-fb92-4405-a661-0d84b5d35597 details requested by agent ovs-agent-dv-cinder-790910-4-iscsi with host dv-cinder-790910-4-iscsi {{(pid=91688) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 20 04:16:48.188107 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 34416) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:16:48.270527 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.pecan_wsgi.hooks.translation [None req-942046fc-ec61-475d-aad0-1f3c311b749c admin admin] GET failed (client error): The resource could not be found.
May 20 04:16:48.271041 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-942046fc-ec61-475d-aad0-1f3c311b749c admin admin] Synchronizing usage tracker for tenant:a53818aa01c142a68e4227871399c86a on resource:network {{(pid=91686) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:16:48.288118 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-942046fc-ec61-475d-aad0-1f3c311b749c admin admin] Unset dirty status for tenant:a53818aa01c142a68e4227871399c86a on resource:network {{(pid=91686) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:16:48.289291 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-942046fc-ec61-475d-aad0-1f3c311b749c admin admin] 10.222.0.71 "GET /v2.0/networks/shared HTTP/1.1" status: 404  len: 314 time: 0.0998898
May 20 04:16:48.393810 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a63d53aa-a5a9-4435-b88c-de45bf0b526a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:16:48.395327 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-a63d53aa-a5a9-4435-b88c-de45bf0b526a admin admin] 10.222.0.71 "GET /v2.0/networks?name=shared HTTP/1.1" status: 200  len: 826 time: 0.1014924
May 20 04:16:48.406602 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.v2.base [None req-d668b76c-5591-432e-b4be-31fe01b20f5c admin admin] Request body: {'subnet': {'name': 'shared-subnet', 'ip_version': 4, 'description': 'shared-subnet', 'network_id': 'c5893098-fb92-4405-a661-0d84b5d35597', 'cidr': '192.168.233.0/24'}} {{(pid=91686) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:16:48.411306 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-d668b76c-5591-432e-b4be-31fe01b20f5c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:16:48.421371 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-d668b76c-5591-432e-b4be-31fe01b20f5c admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:16:48.432246 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d668b76c-5591-432e-b4be-31fe01b20f5c admin admin] Made reservation on behalf of a53818aa01c142a68e4227871399c86a for: {'subnet': 1} {{(pid=91686) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 04:16:48.434552 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-d668b76c-5591-432e-b4be-31fe01b20f5c admin admin] Notify callbacks [] for subnet, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:16:48.816781 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-d668b76c-5591-432e-b4be-31fe01b20f5c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-255887', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377'] for subnet, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:16:48.821318 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-18e469f0-fa10-4731-b31b-ed92470fe766 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:16:48.889095 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d668b76c-5591-432e-b4be-31fe01b20f5c admin admin] Pushing event updated for resources: {'Subnet': ['ID=6c0e93b5-9ca2-4e5a-a26d-a06ab6a5226e,revision_number=0']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:16:48.892273 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-d668b76c-5591-432e-b4be-31fe01b20f5c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:16:48.898092 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d668b76c-5591-432e-b4be-31fe01b20f5c admin admin] Checking segment: {'id': '5d30f0fa-a01e-48f4-ae41-9529b23cf3c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 886, 'network_id': 'c5893098-fb92-4405-a661-0d84b5d35597'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91686) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:16:48.898444 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d668b76c-5591-432e-b4be-31fe01b20f5c admin admin] Network hostable DHCP agents. Network: c5893098-fb92-4405-a661-0d84b5d35597, hostable agents: ['36d27813-c368-4fd7-ae26-0f662e0a96fd'], hosted agents: [] {{(pid=91686) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 20 04:16:48.916537 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d668b76c-5591-432e-b4be-31fe01b20f5c admin admin] Network c5893098-fb92-4405-a661-0d84b5d35597 is scheduled to be hosted by DHCP agent 36d27813-c368-4fd7-ae26-0f662e0a96fd with binding_index 1 {{(pid=91686) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 20 04:16:48.927603 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.base_scheduler [None req-d668b76c-5591-432e-b4be-31fe01b20f5c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-790910-4-iscsi, c5893098-fb92-4405-a661-0d84b5d35597) {{(pid=91686) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:16:48.932064 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d668b76c-5591-432e-b4be-31fe01b20f5c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:16:48.932649 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-d668b76c-5591-432e-b4be-31fe01b20f5c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for subnet, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:16:48.937183 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5ee2ee7a-c77d-4510-91dd-0cf3c7cc6810 None None] Network c5893098-fb92-4405-a661-0d84b5d35597 requested from dv-cinder-790910-4-iscsi {{(pid=91688) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 04:16:48.958515 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-d668b76c-5591-432e-b4be-31fe01b20f5c admin admin] 10.222.0.71 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 845 time: 0.5554597
May 20 04:16:49.191830 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7e4fef98-0e21-48b0-af46-8ad2d7bf810f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpfbdc8e9b-5136-5478-8aa8-b0b6b9be0f90-c5893098-fb92-4405-a661-0d84b5d35597', 'network_id': 'c5893098-fb92-4405-a661-0d84b5d35597', 'tenant_id': 'a53818aa01c142a68e4227871399c86a', 'fixed_ips': [{'subnet_id': '6c0e93b5-9ca2-4e5a-a26d-a06ab6a5226e'}]}} from dv-cinder-790910-4-iscsi. {{(pid=91688) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 20 04:16:49.192704 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-7e4fef98-0e21-48b0-af46-8ad2d7bf810f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_create {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:16:49.351231 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.db_base_plugin_common [None req-7e4fef98-0e21-48b0-af46-8ad2d7bf810f None None] Allocated IP 192.168.233.2 (c5893098-fb92-4405-a661-0d84b5d35597/6c0e93b5-9ca2-4e5a-a26d-a06ab6a5226e/ec752bb2-07cb-4673-bea8-f7feab65a32f) {{(pid=91688) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 04:16:49.560992 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-7e4fef98-0e21-48b0-af46-8ad2d7bf810f None None] Notify callbacks [] for port, precommit_create {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:16:49.574862 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-7e4fef98-0e21-48b0-af46-8ad2d7bf810f None None] Transition to ACTIVE for port object ec752bb2-07cb-4673-bea8-f7feab65a32f will not be triggered until provisioned by entity L2. {{(pid=91688) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:16:49.592148 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-7e4fef98-0e21-48b0-af46-8ad2d7bf810f None None] Transition to ACTIVE for port object ec752bb2-07cb-4673-bea8-f7feab65a32f will not be triggered until provisioned by entity DHCP. {{(pid=91688) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:16:49.598685 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-7e4fef98-0e21-48b0-af46-8ad2d7bf810f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8782892106231'] for port, after_create {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:16:49.603424 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:16:49.669469 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7e4fef98-0e21-48b0-af46-8ad2d7bf810f None None] Network c5893098-fb92-4405-a661-0d84b5d35597 is already hosted by enough agents. {{(pid=91688) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:16:49.672259 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.scheduler.base_scheduler [None req-7e4fef98-0e21-48b0-af46-8ad2d7bf810f None None] Resources bound (agent type, host, resource id):  {{(pid=91688) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:16:49.676559 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7e4fef98-0e21-48b0-af46-8ad2d7bf810f None None] Received port after_create {{(pid=91688) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 04:16:49.678674 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e4fef98-0e21-48b0-af46-8ad2d7bf810f None None] Pushing event updated for resources: {'Port': ['ID=ec752bb2-07cb-4673-bea8-f7feab65a32f,revision_number=1']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:16:49.710782 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e4fef98-0e21-48b0-af46-8ad2d7bf810f None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:16:49.711118 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e4fef98-0e21-48b0-af46-8ad2d7bf810f None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:16:49.711469 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e4fef98-0e21-48b0-af46-8ad2d7bf810f None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:16:49.711803 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e4fef98-0e21-48b0-af46-8ad2d7bf810f None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:16:49.712117 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e4fef98-0e21-48b0-af46-8ad2d7bf810f None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:16:49.712437 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e4fef98-0e21-48b0-af46-8ad2d7bf810f None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:16:49.712754 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e4fef98-0e21-48b0-af46-8ad2d7bf810f None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:16:49.713097 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e4fef98-0e21-48b0-af46-8ad2d7bf810f None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:16:49.713436 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e4fef98-0e21-48b0-af46-8ad2d7bf810f None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:16:49.713746 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e4fef98-0e21-48b0-af46-8ad2d7bf810f None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:16:49.714060 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e4fef98-0e21-48b0-af46-8ad2d7bf810f None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:16:49.714387 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e4fef98-0e21-48b0-af46-8ad2d7bf810f None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:16:49.726312 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-7e4fef98-0e21-48b0-af46-8ad2d7bf810f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.123s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:16:49.782234 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.managers [None req-7e4fef98-0e21-48b0-af46-8ad2d7bf810f None None] Attempting to bind port ec752bb2-07cb-4673-bea8-f7feab65a32f on host dv-cinder-790910-4-iscsi for vnic_type normal with profile  {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 04:16:49.782592 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.managers [None req-7e4fef98-0e21-48b0-af46-8ad2d7bf810f None None] Attempting to bind port ec752bb2-07cb-4673-bea8-f7feab65a32f by drivers openvswitch,hyperv on host dv-cinder-790910-4-iscsi at level 0 using segments [{'id': '5d30f0fa-a01e-48f4-ae41-9529b23cf3c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 886, 'network_id': 'c5893098-fb92-4405-a661-0d84b5d35597'}] {{(pid=91688) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 04:16:49.782975 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7e4fef98-0e21-48b0-af46-8ad2d7bf810f None None] Attempting to bind port ec752bb2-07cb-4673-bea8-f7feab65a32f on network c5893098-fb92-4405-a661-0d84b5d35597 {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:16:49.788663 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7e4fef98-0e21-48b0-af46-8ad2d7bf810f None None] Checking agent: {'id': '333121d4-1023-4a33-a54c-f4dd052e1612', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-790910-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 4, 13, 33), 'started_at': datetime.datetime(2021, 5, 20, 4, 14, 3), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 4, 16, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-790910-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 04:16:49.789170 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7e4fef98-0e21-48b0-af46-8ad2d7bf810f None None] Checking segment: {'id': '5d30f0fa-a01e-48f4-ae41-9529b23cf3c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 886, 'network_id': 'c5893098-fb92-4405-a661-0d84b5d35597'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91688) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:16:49.789451 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-7e4fef98-0e21-48b0-af46-8ad2d7bf810f None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:16:49.789842 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7e4fef98-0e21-48b0-af46-8ad2d7bf810f None None] Bound using segment: {'id': '5d30f0fa-a01e-48f4-ae41-9529b23cf3c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 886, 'network_id': 'c5893098-fb92-4405-a661-0d84b5d35597'} {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 04:16:49.790302 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.managers [None req-7e4fef98-0e21-48b0-af46-8ad2d7bf810f None None] Bound port: ec752bb2-07cb-4673-bea8-f7feab65a32f, host: dv-cinder-790910-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5d30f0fa-a01e-48f4-ae41-9529b23cf3c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 886, 'network_id': 'c5893098-fb92-4405-a661-0d84b5d35597'}}] {{(pid=91688) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 04:16:49.791039 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-7e4fef98-0e21-48b0-af46-8ad2d7bf810f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:16:49.883062 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-7e4fef98-0e21-48b0-af46-8ad2d7bf810f None None] For port ec752bb2-07cb-4673-bea8-f7feab65a32f, host dv-cinder-790910-4-iscsi, cleared binding levels {{(pid=91688) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 04:16:49.886867 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-7e4fef98-0e21-48b0-af46-8ad2d7bf810f None None] For port ec752bb2-07cb-4673-bea8-f7feab65a32f, host dv-cinder-790910-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=ec752bb2-07cb-4673-bea8-f7feab65a32f,segment=NetworkSegment(5d30f0fa-a01e-48f4-ae41-9529b23cf3c9),segment_id=5d30f0fa-a01e-48f4-ae41-9529b23cf3c9)] {{(pid=91688) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 04:16:49.891715 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-7e4fef98-0e21-48b0-af46-8ad2d7bf810f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:16:49.896299 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-7e4fef98-0e21-48b0-af46-8ad2d7bf810f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:16:49.974161 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e4fef98-0e21-48b0-af46-8ad2d7bf810f None None] Pushing event updated for resources: {'Port': ['ID=ec752bb2-07cb-4673-bea8-f7feab65a32f,revision_number=2']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:16:49.977436 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-7e4fef98-0e21-48b0-af46-8ad2d7bf810f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:16:50.791568 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a56f0913-72e2-4ab3-ab73-23bb3eea11db None None] Network c5893098-fb92-4405-a661-0d84b5d35597 requested from dv-cinder-790910-4-iscsi {{(pid=91688) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 04:16:50.875953 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device ec752bb2-07cb-4673-bea8-f7feab65a32f up at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:16:50.907031 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-7cc97bb8-b35c-4ba9-b7a0-9f8a31255826 None None] Provisioning for port ec752bb2-07cb-4673-bea8-f7feab65a32f completed by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:16:51.030281 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning for port ec752bb2-07cb-4673-bea8-f7feab65a32f completed by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:16:51.063674 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning complete for port ec752bb2-07cb-4673-bea8-f7feab65a32f triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:16:51.064045 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:16:51.207053 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:16:51.246995 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] For port ec752bb2-07cb-4673-bea8-f7feab65a32f, host dv-cinder-790910-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=ec752bb2-07cb-4673-bea8-f7feab65a32f,segment=NetworkSegment(5d30f0fa-a01e-48f4-ae41-9529b23cf3c9),segment_id=5d30f0fa-a01e-48f4-ae41-9529b23cf3c9)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:16:51.252641 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:16:51.255122 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-f11f6bea-5a09-43fd-a352-afa18ce8d50b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:16:51.330369 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Pushing event updated for resources: {'Port': ['ID=ec752bb2-07cb-4673-bea8-f7feab65a32f,revision_number=3']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:16:51.336252 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:16:51.451628 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-334ac4a5-d6f8-4470-bc07-c04888f8f616 None None] Provisioning complete for port ec752bb2-07cb-4673-bea8-f7feab65a32f triggered by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:16:51.451914 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-334ac4a5-d6f8-4470-bc07-c04888f8f616 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:16:52.798891 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device ec752bb2-07cb-4673-bea8-f7feab65a32f up at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:16:52.865202 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning complete for port ec752bb2-07cb-4673-bea8-f7feab65a32f triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:16:52.865575 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:16:59.830879 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-11df8216-0f6d-401c-bee0-1156f60eede2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:17:02.541214 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:17:02.656523 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ccd1f459-3c11-4ff7-a3fd-85434d1a5c3b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:17:03.280310 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ea4803bd-878f-47d5-9084-1ec41953c9db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:17:05.106443 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f21320cc-6a25-4ec1-8a32-8b119b35fd55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:17:09.754006 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.agents_db [None req-92d61f12-17bc-4bf9-9eab-8a69b8c6da2f None None] Agent healthcheck: found 5 active agents {{(pid=91689) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 04:17:29.835263 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-aea107de-43c6-4b8b-9fd4-17ffe9abf3fd None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:17:32.537168 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:17:32.660233 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-44c32d44-0365-4b61-a4c3-be78460f879c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:17:33.282563 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ea4803bd-878f-47d5-9084-1ec41953c9db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:17:35.109272 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f21320cc-6a25-4ec1-8a32-8b119b35fd55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:17:46.753259 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.agents_db [None req-92d61f12-17bc-4bf9-9eab-8a69b8c6da2f None None] Agent healthcheck: found 5 active agents {{(pid=91689) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 04:17:55.118918 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 34468) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:17:55.125095 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [None req-b66006a6-8010-4111-9460-bc603a5f3483 tempest-verify_tempest_config-1512819456 tempest-verify_tempest_config-1512819456-project] http://10.222.0.71:9696/v2.0/extensions returned with HTTP 200 {{(pid=91687) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 20 04:17:55.126038 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-b66006a6-8010-4111-9460-bc603a5f3483 tempest-verify_tempest_config-1512819456 tempest-verify_tempest_config-1512819456-project] 10.222.0.71 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13635 time: 0.0061591
May 20 04:17:55.446862 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 34486) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:17:55.600981 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-a6d89c14-57b7-4561-8017-6b63c509b930 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:17:55.616446 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-a6d89c14-57b7-4561-8017-6b63c509b930 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:17:55.620767 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-a6d89c14-57b7-4561-8017-6b63c509b930 admin admin] Usage tracker for resource:security_group_rule and tenant:59b42bb83cca4117b004b602f10c0b9a is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:17:55.624235 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-a6d89c14-57b7-4561-8017-6b63c509b930 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:17:55.630511 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-a6d89c14-57b7-4561-8017-6b63c509b930 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:17:55.730959 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-a6d89c14-57b7-4561-8017-6b63c509b930 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:17:55.735651 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-a6d89c14-57b7-4561-8017-6b63c509b930 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:17:55.742962 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:17:55.784994 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6d89c14-57b7-4561-8017-6b63c509b930 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0cad153c-f52a-4c2e-bcac-b048a53d6923,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:17:55.789142 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-a6d89c14-57b7-4561-8017-6b63c509b930 admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=59b42bb83cca4117b004b602f10c0b9a&name=default HTTP/1.1" status: 200  len: 2975 time: 0.3411641
May 20 04:17:55.792403 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 34492) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:17:55.795117 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a6d89c14-57b7-4561-8017-6b63c509b930 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:17:55.795487 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a6d89c14-57b7-4561-8017-6b63c509b930 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:17:55.795878 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a6d89c14-57b7-4561-8017-6b63c509b930 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:17:55.796204 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a6d89c14-57b7-4561-8017-6b63c509b930 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:17:55.796524 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a6d89c14-57b7-4561-8017-6b63c509b930 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:17:55.796931 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a6d89c14-57b7-4561-8017-6b63c509b930 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:17:55.797351 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a6d89c14-57b7-4561-8017-6b63c509b930 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:17:55.797732 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a6d89c14-57b7-4561-8017-6b63c509b930 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:17:55.798181 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a6d89c14-57b7-4561-8017-6b63c509b930 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:17:55.798538 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a6d89c14-57b7-4561-8017-6b63c509b930 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:17:55.798868 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a6d89c14-57b7-4561-8017-6b63c509b930 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:17:55.799183 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a6d89c14-57b7-4561-8017-6b63c509b930 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:17:55.804834 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-a6d89c14-57b7-4561-8017-6b63c509b930 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:17:55.856652 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-62b8b20c-a9da-4e21-98fe-1219b62bb042 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:17:55.883143 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-62b8b20c-a9da-4e21-98fe-1219b62bb042 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:17:55.977326 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-62b8b20c-a9da-4e21-98fe-1219b62bb042 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:17:55.981888 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-6482a514-8251-45b3-a11e-16cc5200bffa admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:17:55.993456 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62b8b20c-a9da-4e21-98fe-1219b62bb042 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0cad153c-f52a-4c2e-bcac-b048a53d6923,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:17:56.003253 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-62b8b20c-a9da-4e21-98fe-1219b62bb042 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:17:56.004380 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-62b8b20c-a9da-4e21-98fe-1219b62bb042 admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/0cad153c-f52a-4c2e-bcac-b048a53d6923 HTTP/1.1" status: 204  len: 168 time: 0.2109711
May 20 04:17:56.005601 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62b8b20c-a9da-4e21-98fe-1219b62bb042 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:17:56.005939 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62b8b20c-a9da-4e21-98fe-1219b62bb042 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:17:56.006271 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62b8b20c-a9da-4e21-98fe-1219b62bb042 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:17:56.006594 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62b8b20c-a9da-4e21-98fe-1219b62bb042 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:17:56.007239 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62b8b20c-a9da-4e21-98fe-1219b62bb042 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:17:56.007591 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62b8b20c-a9da-4e21-98fe-1219b62bb042 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:17:56.007915 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62b8b20c-a9da-4e21-98fe-1219b62bb042 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:17:56.008265 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62b8b20c-a9da-4e21-98fe-1219b62bb042 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:17:56.008548 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62b8b20c-a9da-4e21-98fe-1219b62bb042 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:17:56.009005 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62b8b20c-a9da-4e21-98fe-1219b62bb042 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:17:56.009206 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62b8b20c-a9da-4e21-98fe-1219b62bb042 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:17:56.009522 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62b8b20c-a9da-4e21-98fe-1219b62bb042 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:17:56.012636 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-62b8b20c-a9da-4e21-98fe-1219b62bb042 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:17:59.840041 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-bcc7ad75-65f8-4860-9d6c-da5c4e7bb090 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:18:02.533244 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:18:02.664385 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f1e16510-3e85-4523-b3b7-00d9aa404758 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:18:03.287642 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ea4803bd-878f-47d5-9084-1ec41953c9db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:18:05.115752 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f21320cc-6a25-4ec1-8a32-8b119b35fd55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:18:23.755434 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.agents_db [None req-92d61f12-17bc-4bf9-9eab-8a69b8c6da2f None None] Agent healthcheck: found 5 active agents {{(pid=91689) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 04:18:29.846542 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-223ae260-bad4-4255-940e-cd1781a8d871 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:18:32.538241 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:18:32.677571 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-4bec91de-0140-49a0-ab6f-4889cfb4046b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:18:33.295584 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ea4803bd-878f-47d5-9084-1ec41953c9db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:18:35.122831 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f21320cc-6a25-4ec1-8a32-8b119b35fd55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:18:59.848101 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-2a5a452c-1c6d-4d48-86e4-17ab21ce55ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:19:00.753949 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.agents_db [None req-92d61f12-17bc-4bf9-9eab-8a69b8c6da2f None None] Agent healthcheck: found 5 active agents {{(pid=91689) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 04:19:02.542142 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:19:02.678644 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-4c3c726b-5b18-481e-a98a-e5b042b91792 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:19:03.299337 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ea4803bd-878f-47d5-9084-1ec41953c9db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:19:05.124472 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f21320cc-6a25-4ec1-8a32-8b119b35fd55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:19:29.846119 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-03d8ceac-6fb0-489a-8b96-be815828f983 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:19:32.539515 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:19:32.673150 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-7b747337-480d-4d04-ac61-0f21e5cfe10a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:19:33.301764 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ea4803bd-878f-47d5-9084-1ec41953c9db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:19:33.650809 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692'] for agent, after_create {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:19:35.121971 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f21320cc-6a25-4ec1-8a32-8b119b35fd55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:19:36.014915 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 34544) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:19:36.134928 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-3210d925-35bf-4570-904e-004b4957d78e admin admin] 10.222.0.71 "GET /v2.0/agents HTTP/1.1" status: 200  len: 4303 time: 0.1187925
May 20 04:19:37.753847 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.agents_db [None req-92d61f12-17bc-4bf9-9eab-8a69b8c6da2f None None] Agent healthcheck: found 6 active agents {{(pid=91689) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 04:19:38.266473 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 34554) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:19:38.325078 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-77272093-7e9d-430f-888c-47f04c9fb15b admin admin] 10.222.0.71 "GET /v2.0/agents HTTP/1.1" status: 200  len: 4303 time: 0.0571494
May 20 04:19:59.842206 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f1ffcc24-290f-40a0-9e58-541d3fa143fd None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:20:02.536502 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:20:02.679071 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-dd32d7de-9bba-4b6e-b3b9-ab68590f7332 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:20:03.304277 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ea4803bd-878f-47d5-9084-1ec41953c9db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:20:03.608113 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:20:05.130728 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f21320cc-6a25-4ec1-8a32-8b119b35fd55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:20:14.758473 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.agents_db [None req-92d61f12-17bc-4bf9-9eab-8a69b8c6da2f None None] Agent healthcheck: found 6 active agents {{(pid=91689) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 04:20:29.836233 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-3b84c36e-5966-4851-929e-05e71ab40e68 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:20:32.532843 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:20:32.680147 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-476b3861-1507-45f9-9207-3d2dff5c5a8f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:20:33.306933 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ea4803bd-878f-47d5-9084-1ec41953c9db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:20:33.616923 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:20:35.129910 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f21320cc-6a25-4ec1-8a32-8b119b35fd55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:20:51.758989 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.agents_db [None req-92d61f12-17bc-4bf9-9eab-8a69b8c6da2f None None] Agent healthcheck: found 6 active agents {{(pid=91689) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 04:20:59.840159 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-4cd7e954-03a3-4a5d-b3f5-18dd18d39e23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:02.552992 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:02.691590 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1878f960-1ac8-4891-86f4-f7efc173ea3b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:03.328316 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ea4803bd-878f-47d5-9084-1ec41953c9db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:03.634398 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:05.179786 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f21320cc-6a25-4ec1-8a32-8b119b35fd55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:07.138626 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 34744) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:21:07.512118 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [None req-25c3ba7c-b49d-44f8-b540-7ea6373ee96b admin admin] Request body: {'network': {'name': 'tempest-ServerRescueNegativeTestJSON-2060961621-network', 'tenant_id': 'b7d86d894a5f420e86f4c28d7772bd22'}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:21:07.531018 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-25c3ba7c-b49d-44f8-b540-7ea6373ee96b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:21:07.545354 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-25c3ba7c-b49d-44f8-b540-7ea6373ee96b admin admin] Usage tracker for resource:network and tenant:b7d86d894a5f420e86f4c28d7772bd22 is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:21:07.545354 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-25c3ba7c-b49d-44f8-b540-7ea6373ee96b admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:21:07.553584 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-25c3ba7c-b49d-44f8-b540-7ea6373ee96b admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:21:07.570677 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-25c3ba7c-b49d-44f8-b540-7ea6373ee96b admin admin] Made reservation on behalf of b7d86d894a5f420e86f4c28d7772bd22 for: {'network': 1} {{(pid=91687) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 04:21:07.574056 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-25c3ba7c-b49d-44f8-b540-7ea6373ee96b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-578118'] for network, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:07.588944 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-25c3ba7c-b49d-44f8-b540-7ea6373ee96b admin admin] Notify callbacks [] for security_group, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:07.605510 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-25c3ba7c-b49d-44f8-b540-7ea6373ee96b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:21:07.610488 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-25c3ba7c-b49d-44f8-b540-7ea6373ee96b admin admin] Usage tracker for resource:security_group_rule and tenant:b7d86d894a5f420e86f4c28d7772bd22 is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:21:07.614000 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-25c3ba7c-b49d-44f8-b540-7ea6373ee96b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:21:07.620577 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-25c3ba7c-b49d-44f8-b540-7ea6373ee96b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:21:07.713900 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-25c3ba7c-b49d-44f8-b540-7ea6373ee96b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:07.722002 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-25c3ba7c-b49d-44f8-b540-7ea6373ee96b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:07.725646 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-a6d89c14-57b7-4561-8017-6b63c509b930 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:07.759646 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25c3ba7c-b49d-44f8-b540-7ea6373ee96b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8cbf810a-7c03-41fd-8b60-12a4f73202de,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:07.770841 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25c3ba7c-b49d-44f8-b540-7ea6373ee96b admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:21:07.771176 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25c3ba7c-b49d-44f8-b540-7ea6373ee96b admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:21:07.771496 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25c3ba7c-b49d-44f8-b540-7ea6373ee96b admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:21:07.771821 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25c3ba7c-b49d-44f8-b540-7ea6373ee96b admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:21:07.772140 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25c3ba7c-b49d-44f8-b540-7ea6373ee96b admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:21:07.772460 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25c3ba7c-b49d-44f8-b540-7ea6373ee96b admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:21:07.772774 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25c3ba7c-b49d-44f8-b540-7ea6373ee96b admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:21:07.773123 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25c3ba7c-b49d-44f8-b540-7ea6373ee96b admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:21:07.773460 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25c3ba7c-b49d-44f8-b540-7ea6373ee96b admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:21:07.773806 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25c3ba7c-b49d-44f8-b540-7ea6373ee96b admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:21:07.774083 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25c3ba7c-b49d-44f8-b540-7ea6373ee96b admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:21:07.774395 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25c3ba7c-b49d-44f8-b540-7ea6373ee96b admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:21:07.775481 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25c3ba7c-b49d-44f8-b540-7ea6373ee96b admin admin] Tracked resource versions report:
May 20 04:21:07.775481 dv-cinder-790910-4-iscsi neutron-server[91687]: pushed versions:
May 20 04:21:07.775481 dv-cinder-790910-4-iscsi neutron-server[91687]: {   'AddressGroup': {'1.2'},
May 20 04:21:07.775481 dv-cinder-790910-4-iscsi neutron-server[91687]:     'ConntrackHelper': {'1.0'},
May 20 04:21:07.775481 dv-cinder-790910-4-iscsi neutron-server[91687]:     'Log': {'1.0'},
May 20 04:21:07.775481 dv-cinder-790910-4-iscsi neutron-server[91687]:     'Network': {'1.1'},
May 20 04:21:07.775481 dv-cinder-790910-4-iscsi neutron-server[91687]:     'Port': {'1.7'},
May 20 04:21:07.775481 dv-cinder-790910-4-iscsi neutron-server[91687]:     'PortForwarding': {'1.2'},
May 20 04:21:07.775481 dv-cinder-790910-4-iscsi neutron-server[91687]:     'QosPolicy': {'1.8'},
May 20 04:21:07.775481 dv-cinder-790910-4-iscsi neutron-server[91687]:     'SecurityGroup': {'1.4'},
May 20 04:21:07.775481 dv-cinder-790910-4-iscsi neutron-server[91687]:     'SecurityGroupRule': {'1.2'},
May 20 04:21:07.775481 dv-cinder-790910-4-iscsi neutron-server[91687]:     'SubPort': {'1.0'},
May 20 04:21:07.775481 dv-cinder-790910-4-iscsi neutron-server[91687]:     'Subnet': {'1.1'},
May 20 04:21:07.775481 dv-cinder-790910-4-iscsi neutron-server[91687]:     'Trunk': {'1.1'}}
May 20 04:21:07.775481 dv-cinder-790910-4-iscsi neutron-server[91687]: consumer versions:
May 20 04:21:07.775481 dv-cinder-790910-4-iscsi neutron-server[91687]: {   DHCP agent@dv-cinder-790910-4-iscsi: {},
May 20 04:21:07.775481 dv-cinder-790910-4-iscsi neutron-server[91687]:     HyperV agent@hv-cinder-79091: {},
May 20 04:21:07.775481 dv-cinder-790910-4-iscsi neutron-server[91687]:     L3 agent@dv-cinder-790910-4-iscsi: {},
May 20 04:21:07.775481 dv-cinder-790910-4-iscsi neutron-server[91687]:     Metadata agent@dv-cinder-790910-4-iscsi: {},
May 20 04:21:07.775481 dv-cinder-790910-4-iscsi neutron-server[91687]:     Metering agent@dv-cinder-790910-4-iscsi: {},
May 20 04:21:07.775481 dv-cinder-790910-4-iscsi neutron-server[91687]:     Open vSwitch agent@dv-cinder-790910-4-iscsi: {   'AddressGroup': '1.2',
May 20 04:21:07.775481 dv-cinder-790910-4-iscsi neutron-server[91687]:                                                      'ConntrackHelper': '1.0',
May 20 04:21:07.775481 dv-cinder-790910-4-iscsi neutron-server[91687]:                                                      'Log': '1.0',
May 20 04:21:07.775481 dv-cinder-790910-4-iscsi neutron-server[91687]:                                                      'Network': '1.1',
May 20 04:21:07.775481 dv-cinder-790910-4-iscsi neutron-server[91687]:                                                      'Port': '1.7',
May 20 04:21:07.775481 dv-cinder-790910-4-iscsi neutron-server[91687]:                                                      'PortForwarding': '1.2',
May 20 04:21:07.775481 dv-cinder-790910-4-iscsi neutron-server[91687]:                                                      'QosPolicy': '1.8',
May 20 04:21:07.775481 dv-cinder-790910-4-iscsi neutron-server[91687]:                                                      'SecurityGroup': '1.4',
May 20 04:21:07.775481 dv-cinder-790910-4-iscsi neutron-server[91687]:                                                      'SecurityGroupRule': '1.2',
May 20 04:21:07.775481 dv-cinder-790910-4-iscsi neutron-server[91687]:                                                      'SubPort': '1.0',
May 20 04:21:07.775481 dv-cinder-790910-4-iscsi neutron-server[91687]:                                                      'Subnet': '1.1',
May 20 04:21:07.775481 dv-cinder-790910-4-iscsi neutron-server[91687]:                                                      'Trunk': '1.1'}}
May 20 04:21:07.775481 dv-cinder-790910-4-iscsi neutron-server[91687]:  {{(pid=91687) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
May 20 04:21:07.778347 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-25c3ba7c-b49d-44f8-b540-7ea6373ee96b admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 897}  {{(pid=91687) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 20 04:21:07.781027 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-25c3ba7c-b49d-44f8-b540-7ea6373ee96b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:07.792835 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-25c3ba7c-b49d-44f8-b540-7ea6373ee96b admin admin] Notify callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8782892553674', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1501910'] for segment, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:07.793480 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-25c3ba7c-b49d-44f8-b540-7ea6373ee96b admin admin] Unsubscribe: <function _add_segment_host_mapping_for_segment at 0x7fced30d5ca0> segment precommit_create {{(pid=91687) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}}
May 20 04:21:07.793979 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.db.segments_db [None req-25c3ba7c-b49d-44f8-b540-7ea6373ee96b admin admin] Added segment 9d2ee761-256d-4e66-82a3-ef6e5bd352c1 of type vlan for network 348b2b0f-c826-45ab-ba85-8430235b9cac
May 20 04:21:07.835459 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-25c3ba7c-b49d-44f8-b540-7ea6373ee96b admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8782892092784'] for network, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:07.887288 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-25c3ba7c-b49d-44f8-b540-7ea6373ee96b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1590664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1781430'] for network, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:07.888681 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-25c3ba7c-b49d-44f8-b540-7ea6373ee96b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:21:07.889283 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-25c3ba7c-b49d-44f8-b540-7ea6373ee96b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for network, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:07.901620 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 34776) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:21:07.917980 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:07.961998 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-25c3ba7c-b49d-44f8-b540-7ea6373ee96b admin admin] 10.222.0.71 "POST /v2.0/networks HTTP/1.1" status: 201  len: 892 time: 0.8181319
May 20 04:21:07.963803 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 34788) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:21:07.976899 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.v2.base [None req-05e5b728-6c65-4f2f-bd89-a283697fe617 admin admin] Request body: {'subnet': {'network_id': '348b2b0f-c826-45ab-ba85-8430235b9cac', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerRescueNegativeTestJSON-2060961621-subnet', 'tenant_id': 'b7d86d894a5f420e86f4c28d7772bd22', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=91686) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:21:07.988108 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-05e5b728-6c65-4f2f-bd89-a283697fe617 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:21:07.996860 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-05e5b728-6c65-4f2f-bd89-a283697fe617 admin admin] Usage tracker for resource:subnet and tenant:b7d86d894a5f420e86f4c28d7772bd22 is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:21:08.004228 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-05e5b728-6c65-4f2f-bd89-a283697fe617 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:21:08.018534 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-05e5b728-6c65-4f2f-bd89-a283697fe617 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:21:08.030932 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25c3ba7c-b49d-44f8-b540-7ea6373ee96b admin admin] Pushing event updated for resources: {'Network': ['ID=348b2b0f-c826-45ab-ba85-8430235b9cac,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:08.038903 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-05e5b728-6c65-4f2f-bd89-a283697fe617 admin admin] Made reservation on behalf of b7d86d894a5f420e86f4c28d7772bd22 for: {'subnet': 1} {{(pid=91686) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 04:21:08.044782 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-25c3ba7c-b49d-44f8-b540-7ea6373ee96b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.127s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:08.045408 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Network 348b2b0f-c826-45ab-ba85-8430235b9cac details requested by agent ovs-agent-dv-cinder-790910-4-iscsi with host dv-cinder-790910-4-iscsi {{(pid=91688) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 20 04:21:08.050634 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-05e5b728-6c65-4f2f-bd89-a283697fe617 admin admin] Notify callbacks [] for subnet, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:08.125808 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 34798) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:21:08.419701 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.v2.base [None req-1cc56189-d139-4ba5-896d-89ca32afec74 admin admin] Request body: {'network': {'name': 'tempest-DeleteServersTestJSON-1707450002-network', 'tenant_id': 'b6214ee7a3fe4823b9db71f53439835e'}} {{(pid=91686) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:21:08.497768 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-1cc56189-d139-4ba5-896d-89ca32afec74 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:21:08.512131 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-1cc56189-d139-4ba5-896d-89ca32afec74 admin admin] Usage tracker for resource:network and tenant:b6214ee7a3fe4823b9db71f53439835e is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:21:08.529284 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-1cc56189-d139-4ba5-896d-89ca32afec74 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:21:08.543146 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-1cc56189-d139-4ba5-896d-89ca32afec74 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:21:08.549241 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [None req-2d08487b-d239-40bf-9d04-884d569b105e admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeShelveTestJSON-1895235554-network', 'tenant_id': 'ef3bec4745b14484ac8e21cd16cbd11d'}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:21:08.558539 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-2d08487b-d239-40bf-9d04-884d569b105e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:21:08.566623 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-2d08487b-d239-40bf-9d04-884d569b105e admin admin] Usage tracker for resource:network and tenant:ef3bec4745b14484ac8e21cd16cbd11d is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:21:08.572131 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-2d08487b-d239-40bf-9d04-884d569b105e admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:21:08.578755 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1cc56189-d139-4ba5-896d-89ca32afec74 admin admin] Made reservation on behalf of b6214ee7a3fe4823b9db71f53439835e for: {'network': 1} {{(pid=91686) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 04:21:08.582773 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-1cc56189-d139-4ba5-896d-89ca32afec74 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-578118'] for network, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:08.583291 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-2d08487b-d239-40bf-9d04-884d569b105e admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:21:08.599963 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2d08487b-d239-40bf-9d04-884d569b105e admin admin] Made reservation on behalf of ef3bec4745b14484ac8e21cd16cbd11d for: {'network': 1} {{(pid=91687) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 04:21:08.603709 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-2d08487b-d239-40bf-9d04-884d569b105e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-578118'] for network, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:08.621818 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-2d08487b-d239-40bf-9d04-884d569b105e admin admin] Notify callbacks [] for security_group, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:08.639495 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-2d08487b-d239-40bf-9d04-884d569b105e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:21:08.644209 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-2d08487b-d239-40bf-9d04-884d569b105e admin admin] Usage tracker for resource:security_group_rule and tenant:ef3bec4745b14484ac8e21cd16cbd11d is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:21:08.647880 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-2d08487b-d239-40bf-9d04-884d569b105e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:21:08.654856 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-2d08487b-d239-40bf-9d04-884d569b105e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:21:08.689251 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-1cc56189-d139-4ba5-896d-89ca32afec74 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:08.731663 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-1cc56189-d139-4ba5-896d-89ca32afec74 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:21:08.742519 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-1cc56189-d139-4ba5-896d-89ca32afec74 admin admin] Usage tracker for resource:security_group_rule and tenant:b6214ee7a3fe4823b9db71f53439835e is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:21:08.762073 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-1cc56189-d139-4ba5-896d-89ca32afec74 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:21:08.775494 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-2d08487b-d239-40bf-9d04-884d569b105e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:08.775861 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-1cc56189-d139-4ba5-896d-89ca32afec74 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:21:08.783749 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-2d08487b-d239-40bf-9d04-884d569b105e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:08.797167 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:08.826284 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2d08487b-d239-40bf-9d04-884d569b105e admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 864}  {{(pid=91687) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 20 04:21:08.855366 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d08487b-d239-40bf-9d04-884d569b105e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3964c773-44b6-48ed-a264-0a09ce1eab7e,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:08.860203 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-2d08487b-d239-40bf-9d04-884d569b105e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1501910'] for segment, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:08.860623 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.db.segments_db [None req-2d08487b-d239-40bf-9d04-884d569b105e admin admin] Added segment 9521f383-6017-4b4d-9f47-cff4ed54cb57 of type vlan for network 21794e86-fda7-40a6-a5a8-db117c7eeb9d
May 20 04:21:08.862184 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-2d08487b-d239-40bf-9d04-884d569b105e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:08.896045 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-2d08487b-d239-40bf-9d04-884d569b105e admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8782892092784'] for network, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:08.977527 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-2d08487b-d239-40bf-9d04-884d569b105e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1590664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1781430'] for network, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:08.983574 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2d08487b-d239-40bf-9d04-884d569b105e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:21:08.984549 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-2d08487b-d239-40bf-9d04-884d569b105e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for network, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:08.994975 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:09.023462 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-05e5b728-6c65-4f2f-bd89-a283697fe617 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-255887', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377'] for subnet, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:09.039098 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:09.112472 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 34830) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:21:09.113668 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05e5b728-6c65-4f2f-bd89-a283697fe617 admin admin] Pushing event updated for resources: {'Subnet': ['ID=b488dc7d-0e70-4e52-9179-7e6c3e4fb0a1,revision_number=0']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:09.136331 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05e5b728-6c65-4f2f-bd89-a283697fe617 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:21:09.137104 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05e5b728-6c65-4f2f-bd89-a283697fe617 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:21:09.137603 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05e5b728-6c65-4f2f-bd89-a283697fe617 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:21:09.138275 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05e5b728-6c65-4f2f-bd89-a283697fe617 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:21:09.138762 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05e5b728-6c65-4f2f-bd89-a283697fe617 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:21:09.139393 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05e5b728-6c65-4f2f-bd89-a283697fe617 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:21:09.140002 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05e5b728-6c65-4f2f-bd89-a283697fe617 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:21:09.140747 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05e5b728-6c65-4f2f-bd89-a283697fe617 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:21:09.141498 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05e5b728-6c65-4f2f-bd89-a283697fe617 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:21:09.141988 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05e5b728-6c65-4f2f-bd89-a283697fe617 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:21:09.142456 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05e5b728-6c65-4f2f-bd89-a283697fe617 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:21:09.142927 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05e5b728-6c65-4f2f-bd89-a283697fe617 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:21:09.144213 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05e5b728-6c65-4f2f-bd89-a283697fe617 admin admin] Tracked resource versions report:
May 20 04:21:09.144213 dv-cinder-790910-4-iscsi neutron-server[91686]: pushed versions:
May 20 04:21:09.144213 dv-cinder-790910-4-iscsi neutron-server[91686]: {   'AddressGroup': {'1.2'},
May 20 04:21:09.144213 dv-cinder-790910-4-iscsi neutron-server[91686]:     'ConntrackHelper': {'1.0'},
May 20 04:21:09.144213 dv-cinder-790910-4-iscsi neutron-server[91686]:     'Log': {'1.0'},
May 20 04:21:09.144213 dv-cinder-790910-4-iscsi neutron-server[91686]:     'Network': {'1.1'},
May 20 04:21:09.144213 dv-cinder-790910-4-iscsi neutron-server[91686]:     'Port': {'1.7'},
May 20 04:21:09.144213 dv-cinder-790910-4-iscsi neutron-server[91686]:     'PortForwarding': {'1.2'},
May 20 04:21:09.144213 dv-cinder-790910-4-iscsi neutron-server[91686]:     'QosPolicy': {'1.8'},
May 20 04:21:09.144213 dv-cinder-790910-4-iscsi neutron-server[91686]:     'SecurityGroup': {'1.4'},
May 20 04:21:09.144213 dv-cinder-790910-4-iscsi neutron-server[91686]:     'SecurityGroupRule': {'1.2'},
May 20 04:21:09.144213 dv-cinder-790910-4-iscsi neutron-server[91686]:     'SubPort': {'1.0'},
May 20 04:21:09.144213 dv-cinder-790910-4-iscsi neutron-server[91686]:     'Subnet': {'1.1'},
May 20 04:21:09.144213 dv-cinder-790910-4-iscsi neutron-server[91686]:     'Trunk': {'1.1'}}
May 20 04:21:09.144213 dv-cinder-790910-4-iscsi neutron-server[91686]: consumer versions:
May 20 04:21:09.144213 dv-cinder-790910-4-iscsi neutron-server[91686]: {   DHCP agent@dv-cinder-790910-4-iscsi: {},
May 20 04:21:09.144213 dv-cinder-790910-4-iscsi neutron-server[91686]:     HyperV agent@hv-cinder-79091: {},
May 20 04:21:09.144213 dv-cinder-790910-4-iscsi neutron-server[91686]:     L3 agent@dv-cinder-790910-4-iscsi: {},
May 20 04:21:09.144213 dv-cinder-790910-4-iscsi neutron-server[91686]:     Metadata agent@dv-cinder-790910-4-iscsi: {},
May 20 04:21:09.144213 dv-cinder-790910-4-iscsi neutron-server[91686]:     Metering agent@dv-cinder-790910-4-iscsi: {},
May 20 04:21:09.144213 dv-cinder-790910-4-iscsi neutron-server[91686]:     Open vSwitch agent@dv-cinder-790910-4-iscsi: {   'AddressGroup': '1.2',
May 20 04:21:09.144213 dv-cinder-790910-4-iscsi neutron-server[91686]:                                                      'ConntrackHelper': '1.0',
May 20 04:21:09.144213 dv-cinder-790910-4-iscsi neutron-server[91686]:                                                      'Log': '1.0',
May 20 04:21:09.144213 dv-cinder-790910-4-iscsi neutron-server[91686]:                                                      'Network': '1.1',
May 20 04:21:09.144213 dv-cinder-790910-4-iscsi neutron-server[91686]:                                                      'Port': '1.7',
May 20 04:21:09.144213 dv-cinder-790910-4-iscsi neutron-server[91686]:                                                      'PortForwarding': '1.2',
May 20 04:21:09.144213 dv-cinder-790910-4-iscsi neutron-server[91686]:                                                      'QosPolicy': '1.8',
May 20 04:21:09.144213 dv-cinder-790910-4-iscsi neutron-server[91686]:                                                      'SecurityGroup': '1.4',
May 20 04:21:09.144213 dv-cinder-790910-4-iscsi neutron-server[91686]:                                                      'SecurityGroupRule': '1.2',
May 20 04:21:09.144213 dv-cinder-790910-4-iscsi neutron-server[91686]:                                                      'SubPort': '1.0',
May 20 04:21:09.144213 dv-cinder-790910-4-iscsi neutron-server[91686]:                                                      'Subnet': '1.1',
May 20 04:21:09.144213 dv-cinder-790910-4-iscsi neutron-server[91686]:                                                      'Trunk': '1.1'}}
May 20 04:21:09.144213 dv-cinder-790910-4-iscsi neutron-server[91686]:  {{(pid=91686) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
May 20 04:21:09.163383 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-05e5b728-6c65-4f2f-bd89-a283697fe617 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.125s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:09.176117 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-1cc56189-d139-4ba5-896d-89ca32afec74 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:09.177213 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 34838) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:21:09.194772 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-1cc56189-d139-4ba5-896d-89ca32afec74 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:09.210163 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d08487b-d239-40bf-9d04-884d569b105e admin admin] Pushing event updated for resources: {'Network': ['ID=21794e86-fda7-40a6-a5a8-db117c7eeb9d,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:09.219450 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:09.224663 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Network 21794e86-fda7-40a6-a5a8-db117c7eeb9d details requested by agent ovs-agent-dv-cinder-790910-4-iscsi with host dv-cinder-790910-4-iscsi {{(pid=91688) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 20 04:21:09.233715 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-2d08487b-d239-40bf-9d04-884d569b105e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.227s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:09.249695 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cc56189-d139-4ba5-896d-89ca32afec74 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a5479633-0923-4a98-9c22-65615d7859f0,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:09.254310 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-05e5b728-6c65-4f2f-bd89-a283697fe617 admin admin] Checking segment: {'id': '9d2ee761-256d-4e66-82a3-ef6e5bd352c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '348b2b0f-c826-45ab-ba85-8430235b9cac'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91686) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:21:09.254965 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-05e5b728-6c65-4f2f-bd89-a283697fe617 admin admin] Network hostable DHCP agents. Network: 348b2b0f-c826-45ab-ba85-8430235b9cac, hostable agents: ['36d27813-c368-4fd7-ae26-0f662e0a96fd'], hosted agents: [] {{(pid=91686) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 20 04:21:09.260475 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-1cc56189-d139-4ba5-896d-89ca32afec74 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:09.277782 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1cc56189-d139-4ba5-896d-89ca32afec74 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 879}  {{(pid=91686) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 20 04:21:09.290401 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-2d08487b-d239-40bf-9d04-884d569b105e admin admin] 10.222.0.71 "POST /v2.0/networks HTTP/1.1" status: 201  len: 890 time: 1.1597574
May 20 04:21:09.290847 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 34854) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:21:09.300520 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [None req-9a613364-ee1a-4224-acf3-cb7fcfc1a6fb admin admin] Request body: {'subnet': {'network_id': '21794e86-fda7-40a6-a5a8-db117c7eeb9d', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeShelveTestJSON-1895235554-subnet', 'tenant_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:21:09.301100 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-05e5b728-6c65-4f2f-bd89-a283697fe617 admin admin] Network 348b2b0f-c826-45ab-ba85-8430235b9cac is scheduled to be hosted by DHCP agent 36d27813-c368-4fd7-ae26-0f662e0a96fd with binding_index 1 {{(pid=91686) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 20 04:21:09.304069 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-1cc56189-d139-4ba5-896d-89ca32afec74 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1501910'] for segment, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:09.304655 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.db.segments_db [None req-1cc56189-d139-4ba5-896d-89ca32afec74 admin admin] Added segment 743e4a81-111b-4929-b0d4-50516fe60014 of type vlan for network 4100b38a-1db4-4a6e-9c33-7bcf19c64d59
May 20 04:21:09.308432 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-9a613364-ee1a-4224-acf3-cb7fcfc1a6fb admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:21:09.315669 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-9a613364-ee1a-4224-acf3-cb7fcfc1a6fb admin admin] Usage tracker for resource:subnet and tenant:ef3bec4745b14484ac8e21cd16cbd11d is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:21:09.320419 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.base_scheduler [None req-05e5b728-6c65-4f2f-bd89-a283697fe617 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-790910-4-iscsi, 348b2b0f-c826-45ab-ba85-8430235b9cac) {{(pid=91686) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:21:09.321238 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-9a613364-ee1a-4224-acf3-cb7fcfc1a6fb admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:21:09.333486 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-9a613364-ee1a-4224-acf3-cb7fcfc1a6fb admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:21:09.338511 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-05e5b728-6c65-4f2f-bd89-a283697fe617 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:21:09.339363 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-05e5b728-6c65-4f2f-bd89-a283697fe617 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for subnet, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:09.361387 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-1cc56189-d139-4ba5-896d-89ca32afec74 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8782892092784'] for network, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:09.379022 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9a613364-ee1a-4224-acf3-cb7fcfc1a6fb admin admin] Made reservation on behalf of ef3bec4745b14484ac8e21cd16cbd11d for: {'subnet': 1} {{(pid=91687) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 04:21:09.387083 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-9a613364-ee1a-4224-acf3-cb7fcfc1a6fb admin admin] Notify callbacks [] for subnet, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:09.399669 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-05e5b728-6c65-4f2f-bd89-a283697fe617 admin admin] 10.222.0.71 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 856 time: 1.4339926
May 20 04:21:09.406182 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 34858) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:21:09.423435 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.v2.base [None req-d3094b96-60ea-4e42-bbdf-13f522966312 admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-2047512993-network', 'tenant_id': '67505d01c5a94fe5aa463aefc8bec9da'}} {{(pid=91686) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:21:09.431285 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.v2.base [None req-6add0f19-9a5f-4ec0-989e-ed338dc52cec admin admin] Request body: {'router': {'name': 'tempest-ServerRescueNegativeTestJSON-2060961621-router', 'tenant_id': 'b7d86d894a5f420e86f4c28d7772bd22', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90'}}} {{(pid=91686) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:21:09.437115 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-d3094b96-60ea-4e42-bbdf-13f522966312 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:21:09.437354 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-18a4804e-ea23-457b-85d1-4bdc1e410c9c None None] Network 348b2b0f-c826-45ab-ba85-8430235b9cac requested from dv-cinder-790910-4-iscsi {{(pid=91688) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 04:21:09.440353 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-6add0f19-9a5f-4ec0-989e-ed338dc52cec admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:21:09.447006 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-d3094b96-60ea-4e42-bbdf-13f522966312 admin admin] Usage tracker for resource:network and tenant:67505d01c5a94fe5aa463aefc8bec9da is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:21:09.451251 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-6add0f19-9a5f-4ec0-989e-ed338dc52cec admin admin] Usage tracker for resource:router and tenant:b7d86d894a5f420e86f4c28d7772bd22 is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:21:09.455275 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-d3094b96-60ea-4e42-bbdf-13f522966312 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:21:09.458380 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-1cc56189-d139-4ba5-896d-89ca32afec74 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1590664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1781430'] for network, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:09.459649 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-6add0f19-9a5f-4ec0-989e-ed338dc52cec admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:21:09.469650 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1cc56189-d139-4ba5-896d-89ca32afec74 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:21:09.470517 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-1cc56189-d139-4ba5-896d-89ca32afec74 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for network, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:09.475263 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-6add0f19-9a5f-4ec0-989e-ed338dc52cec admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:21:09.480329 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-d3094b96-60ea-4e42-bbdf-13f522966312 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:21:09.483066 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:09.572373 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-1cc56189-d139-4ba5-896d-89ca32afec74 admin admin] 10.222.0.71 "POST /v2.0/networks HTTP/1.1" status: 201  len: 885 time: 1.6694868
May 20 04:21:09.578635 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-6add0f19-9a5f-4ec0-989e-ed338dc52cec admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1796465', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-6255'] for router, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:09.580572 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-6add0f19-9a5f-4ec0-989e-ed338dc52cec admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1713009', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1713968', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1590966', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-6244'] for router, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:09.581639 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 34874) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:21:09.585725 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d3094b96-60ea-4e42-bbdf-13f522966312 admin admin] Made reservation on behalf of 67505d01c5a94fe5aa463aefc8bec9da for: {'network': 1} {{(pid=91686) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 04:21:09.588414 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-d3094b96-60ea-4e42-bbdf-13f522966312 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-578118'] for network, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:09.598690 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-675685ef-b5a7-4efb-88da-d55e463a352f admin admin] Notify callbacks [] for security_group, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:09.668606 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [None req-25eab167-a43e-426e-9d7d-6e5c2a6bc5e8 admin admin] Request body: {'subnet': {'network_id': '4100b38a-1db4-4a6e-9c33-7bcf19c64d59', 'cidr': '172.20.0.0/28', 'name': 'tempest-DeleteServersTestJSON-1707450002-subnet', 'tenant_id': 'b6214ee7a3fe4823b9db71f53439835e', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:21:09.681507 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-25eab167-a43e-426e-9d7d-6e5c2a6bc5e8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:21:09.690134 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-25eab167-a43e-426e-9d7d-6e5c2a6bc5e8 admin admin] Usage tracker for resource:subnet and tenant:b6214ee7a3fe4823b9db71f53439835e is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:21:09.695297 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-25eab167-a43e-426e-9d7d-6e5c2a6bc5e8 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:21:09.706494 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-25eab167-a43e-426e-9d7d-6e5c2a6bc5e8 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:21:09.728492 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-675685ef-b5a7-4efb-88da-d55e463a352f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:21:09.736528 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-675685ef-b5a7-4efb-88da-d55e463a352f admin admin] Usage tracker for resource:security_group_rule and tenant:a61b8d65046541aa9f87854950584138 is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:21:09.740552 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-675685ef-b5a7-4efb-88da-d55e463a352f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:21:09.745225 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-25eab167-a43e-426e-9d7d-6e5c2a6bc5e8 admin admin] Made reservation on behalf of b6214ee7a3fe4823b9db71f53439835e for: {'subnet': 1} {{(pid=91687) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 04:21:09.748379 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-25eab167-a43e-426e-9d7d-6e5c2a6bc5e8 admin admin] Notify callbacks [] for subnet, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:09.757738 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-675685ef-b5a7-4efb-88da-d55e463a352f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:21:09.760052 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-769e3b97-3561-42ab-8767-c846741bc67a None None] Network 348b2b0f-c826-45ab-ba85-8430235b9cac requested from dv-cinder-790910-4-iscsi {{(pid=91688) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 04:21:09.886383 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-675685ef-b5a7-4efb-88da-d55e463a352f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:09.888446 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cc56189-d139-4ba5-896d-89ca32afec74 admin admin] Pushing event updated for resources: {'Network': ['ID=4100b38a-1db4-4a6e-9c33-7bcf19c64d59,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:09.907522 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Network 4100b38a-1db4-4a6e-9c33-7bcf19c64d59 details requested by agent ovs-agent-dv-cinder-790910-4-iscsi with host dv-cinder-790910-4-iscsi {{(pid=91688) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 20 04:21:09.942066 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-6add0f19-9a5f-4ec0-989e-ed338dc52cec admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:10.158036 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-d3094b96-60ea-4e42-bbdf-13f522966312 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:10.188839 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-1cc56189-d139-4ba5-896d-89ca32afec74 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.705s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:10.223615 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-9a613364-ee1a-4224-acf3-cb7fcfc1a6fb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-255887', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377'] for subnet, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:10.231402 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-675685ef-b5a7-4efb-88da-d55e463a352f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:10.260518 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-d3094b96-60ea-4e42-bbdf-13f522966312 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:21:10.262574 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-2a8b4a71-2005-47c7-ae62-9b71e08c1eab admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:10.272628 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-62b8b20c-a9da-4e21-98fe-1219b62bb042 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:10.296354 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-d3094b96-60ea-4e42-bbdf-13f522966312 admin admin] Usage tracker for resource:security_group_rule and tenant:67505d01c5a94fe5aa463aefc8bec9da is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:21:10.321153 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-d3094b96-60ea-4e42-bbdf-13f522966312 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:21:10.368912 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-d3094b96-60ea-4e42-bbdf-13f522966312 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:21:10.379150 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a613364-ee1a-4224-acf3-cb7fcfc1a6fb admin admin] Pushing event updated for resources: {'Subnet': ['ID=06f38702-3d3c-4e25-8f84-85483d1ddf28,revision_number=0']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:10.415603 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-9a613364-ee1a-4224-acf3-cb7fcfc1a6fb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.153s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:10.424469 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9a613364-ee1a-4224-acf3-cb7fcfc1a6fb admin admin] Checking segment: {'id': '9521f383-6017-4b4d-9f47-cff4ed54cb57', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 864, 'network_id': '21794e86-fda7-40a6-a5a8-db117c7eeb9d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91687) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:21:10.424822 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9a613364-ee1a-4224-acf3-cb7fcfc1a6fb admin admin] Network hostable DHCP agents. Network: 21794e86-fda7-40a6-a5a8-db117c7eeb9d, hostable agents: ['36d27813-c368-4fd7-ae26-0f662e0a96fd'], hosted agents: [] {{(pid=91687) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 20 04:21:10.464444 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-675685ef-b5a7-4efb-88da-d55e463a352f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cea3ca71-b457-41d1-b5bb-58fa19f23456,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:10.476600 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-675685ef-b5a7-4efb-88da-d55e463a352f admin admin] Synchronizing usage tracker for tenant:a53818aa01c142a68e4227871399c86a on resource:security_group {{(pid=91686) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:21:10.497597 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9a613364-ee1a-4224-acf3-cb7fcfc1a6fb admin admin] Network 21794e86-fda7-40a6-a5a8-db117c7eeb9d is scheduled to be hosted by DHCP agent 36d27813-c368-4fd7-ae26-0f662e0a96fd with binding_index 1 {{(pid=91687) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 20 04:21:10.516420 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.base_scheduler [None req-9a613364-ee1a-4224-acf3-cb7fcfc1a6fb admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-790910-4-iscsi, 21794e86-fda7-40a6-a5a8-db117c7eeb9d) {{(pid=91687) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:21:10.523873 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9a613364-ee1a-4224-acf3-cb7fcfc1a6fb admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:21:10.524993 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-9a613364-ee1a-4224-acf3-cb7fcfc1a6fb admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for subnet, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:10.526870 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3fe0b598-76a5-4627-8840-d2c4da11623c None None] Network 21794e86-fda7-40a6-a5a8-db117c7eeb9d requested from dv-cinder-790910-4-iscsi {{(pid=91688) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 04:21:10.604562 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-9a613364-ee1a-4224-acf3-cb7fcfc1a6fb admin admin] 10.222.0.71 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 853 time: 1.3122551
May 20 04:21:10.610263 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 34890) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:21:10.619028 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-675685ef-b5a7-4efb-88da-d55e463a352f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.346s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:10.620448 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [None req-2153d097-ea28-4280-b639-7c93adfa12b7 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeShelveTestJSON-1895235554-router', 'tenant_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90'}}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:21:10.724886 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-2153d097-ea28-4280-b639-7c93adfa12b7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:21:10.736672 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-2153d097-ea28-4280-b639-7c93adfa12b7 admin admin] Usage tracker for resource:router and tenant:ef3bec4745b14484ac8e21cd16cbd11d is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:21:10.747103 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-2153d097-ea28-4280-b639-7c93adfa12b7 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:21:10.762833 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-2153d097-ea28-4280-b639-7c93adfa12b7 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:21:10.795060 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-2153d097-ea28-4280-b639-7c93adfa12b7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1796465', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-6255'] for router, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:10.797481 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-2153d097-ea28-4280-b639-7c93adfa12b7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1713009', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1713968', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1590966', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-6244'] for router, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:10.823306 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-675685ef-b5a7-4efb-88da-d55e463a352f admin admin] Unset dirty status for tenant:a53818aa01c142a68e4227871399c86a on resource:security_group {{(pid=91686) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:21:10.824933 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-675685ef-b5a7-4efb-88da-d55e463a352f admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=a61b8d65046541aa9f87854950584138&name=default HTTP/1.1" status: 200  len: 2975 time: 1.6382787
May 20 04:21:10.829604 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-6add0f19-9a5f-4ec0-989e-ed338dc52cec admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1713977', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1796355', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-6218'] for router, precommit_update {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:10.834039 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 34898) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:21:10.881406 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-2153d097-ea28-4280-b639-7c93adfa12b7 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:10.987685 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 34906) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:21:11.103525 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aad9ef34-d62d-4fb9-b027-6d9ca14d151f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpfbdc8e9b-5136-5478-8aa8-b0b6b9be0f90-21794e86-fda7-40a6-a5a8-db117c7eeb9d', 'network_id': '21794e86-fda7-40a6-a5a8-db117c7eeb9d', 'tenant_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'fixed_ips': [{'subnet_id': '06f38702-3d3c-4e25-8f84-85483d1ddf28'}]}} from dv-cinder-790910-4-iscsi. {{(pid=91688) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 20 04:21:11.104650 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-aad9ef34-d62d-4fb9-b027-6d9ca14d151f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_create {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:11.116318 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-0f5929d0-455a-4f4d-89b6-401ed193e430 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:11.171471 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-0f5929d0-455a-4f4d-89b6-401ed193e430 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:11.271344 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-d3094b96-60ea-4e42-bbdf-13f522966312 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:11.341645 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-d3094b96-60ea-4e42-bbdf-13f522966312 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:11.342713 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-0f5929d0-455a-4f4d-89b6-401ed193e430 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:11.355965 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-94d57b86-978b-4374-943c-661aad187e15 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:11.368941 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:11.427152 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-94d57b86-978b-4374-943c-661aad187e15 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:21:11.451792 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d3094b96-60ea-4e42-bbdf-13f522966312 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 899}  {{(pid=91686) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 20 04:21:11.463396 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-0f5929d0-455a-4f4d-89b6-401ed193e430 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:11.464791 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-0f5929d0-455a-4f4d-89b6-401ed193e430 admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/cea3ca71-b457-41d1-b5bb-58fa19f23456 HTTP/1.1" status: 204  len: 168 time: 0.6280422
May 20 04:21:11.474917 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-94d57b86-978b-4374-943c-661aad187e15 admin admin] Usage tracker for resource:security_group_rule and tenant:69a141e7df9249a4b48fc96ea0a6cbba is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:21:11.486242 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-94d57b86-978b-4374-943c-661aad187e15 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:21:11.499639 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3094b96-60ea-4e42-bbdf-13f522966312 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=de1a690a-0045-412a-b705-2cf7abe6681b,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:11.502839 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-94d57b86-978b-4374-943c-661aad187e15 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:21:11.505698 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-d3094b96-60ea-4e42-bbdf-13f522966312 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1501910'] for segment, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:11.506013 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.db_base_plugin_common [None req-aad9ef34-d62d-4fb9-b027-6d9ca14d151f None None] Allocated IP 172.20.0.2 (21794e86-fda7-40a6-a5a8-db117c7eeb9d/06f38702-3d3c-4e25-8f84-85483d1ddf28/37c13c83-3c6b-4c47-8428-d4af18562753) {{(pid=91688) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 04:21:11.506160 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.db.segments_db [None req-d3094b96-60ea-4e42-bbdf-13f522966312 admin admin] Added segment 04a1687e-8456-4751-bf61-29951b14a5c9 of type vlan for network 8f3c5439-7e79-4f14-a1a4-1c62e4ffee6f
May 20 04:21:11.555141 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f5929d0-455a-4f4d-89b6-401ed193e430 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cea3ca71-b457-41d1-b5bb-58fa19f23456,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:11.581612 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-0f5929d0-455a-4f4d-89b6-401ed193e430 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.212s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:11.585338 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.186s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:11.585620 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:11.620829 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-2153d097-ea28-4280-b639-7c93adfa12b7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1713977', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1796355', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-6218'] for router, precommit_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:11.627968 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-25eab167-a43e-426e-9d7d-6e5c2a6bc5e8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-255887', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377'] for subnet, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:11.643800 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-9a613364-ee1a-4224-acf3-cb7fcfc1a6fb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:11.738179 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-d3094b96-60ea-4e42-bbdf-13f522966312 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8782892092784'] for network, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:11.902571 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-25eab167-a43e-426e-9d7d-6e5c2a6bc5e8 admin admin] Checking segment: {'id': '743e4a81-111b-4929-b0d4-50516fe60014', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 879, 'network_id': '4100b38a-1db4-4a6e-9c33-7bcf19c64d59'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91687) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:21:11.903131 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-25eab167-a43e-426e-9d7d-6e5c2a6bc5e8 admin admin] Network hostable DHCP agents. Network: 4100b38a-1db4-4a6e-9c33-7bcf19c64d59, hostable agents: ['36d27813-c368-4fd7-ae26-0f662e0a96fd'], hosted agents: [] {{(pid=91687) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 20 04:21:11.928834 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25eab167-a43e-426e-9d7d-6e5c2a6bc5e8 admin admin] Pushing event updated for resources: {'Subnet': ['ID=88b525de-7494-46b7-a333-32b76e112ad7,revision_number=0']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:11.936136 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-25eab167-a43e-426e-9d7d-6e5c2a6bc5e8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.293s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:11.951030 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-d3094b96-60ea-4e42-bbdf-13f522966312 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1590664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1781430'] for network, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:11.961885 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d3094b96-60ea-4e42-bbdf-13f522966312 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:21:11.962592 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-d3094b96-60ea-4e42-bbdf-13f522966312 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for network, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:11.996730 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:12.008561 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-25eab167-a43e-426e-9d7d-6e5c2a6bc5e8 admin admin] Network 4100b38a-1db4-4a6e-9c33-7bcf19c64d59 is scheduled to be hosted by DHCP agent 36d27813-c368-4fd7-ae26-0f662e0a96fd with binding_index 1 {{(pid=91687) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 20 04:21:12.024990 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-d3094b96-60ea-4e42-bbdf-13f522966312 admin admin] 10.222.0.71 "POST /v2.0/networks HTTP/1.1" status: 201  len: 898 time: 2.9022512
May 20 04:21:12.029952 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 34924) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:21:12.037879 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [None req-8c6a0267-5110-4ac4-85d2-5930cf2ed9de admin admin] Request body: {'subnet': {'network_id': '8f3c5439-7e79-4f14-a1a4-1c62e4ffee6f', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-2047512993-subnet', 'tenant_id': '67505d01c5a94fe5aa463aefc8bec9da', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:21:12.044207 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-6add0f19-9a5f-4ec0-989e-ed338dc52cec admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:12.045144 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.base_scheduler [None req-25eab167-a43e-426e-9d7d-6e5c2a6bc5e8 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-790910-4-iscsi, 4100b38a-1db4-4a6e-9c33-7bcf19c64d59) {{(pid=91687) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:21:12.050467 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-8c6a0267-5110-4ac4-85d2-5930cf2ed9de admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:21:12.051788 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-aad9ef34-d62d-4fb9-b027-6d9ca14d151f None None] Notify callbacks [] for port, precommit_create {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:12.058948 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-25eab167-a43e-426e-9d7d-6e5c2a6bc5e8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:21:12.059995 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-25eab167-a43e-426e-9d7d-6e5c2a6bc5e8 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for subnet, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:12.064100 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-8c6a0267-5110-4ac4-85d2-5930cf2ed9de admin admin] Usage tracker for resource:subnet and tenant:67505d01c5a94fe5aa463aefc8bec9da is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:21:12.070533 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-8c6a0267-5110-4ac4-85d2-5930cf2ed9de admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:21:12.085225 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d172a8b4-32ee-42f2-aab4-5d6ad28492f0 None None] Network 4100b38a-1db4-4a6e-9c33-7bcf19c64d59 requested from dv-cinder-790910-4-iscsi {{(pid=91688) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 04:21:12.087057 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-8c6a0267-5110-4ac4-85d2-5930cf2ed9de admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:21:12.131627 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-25eab167-a43e-426e-9d7d-6e5c2a6bc5e8 admin admin] 10.222.0.71 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 849 time: 2.4654367
May 20 04:21:12.131627 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8c6a0267-5110-4ac4-85d2-5930cf2ed9de admin admin] Made reservation on behalf of 67505d01c5a94fe5aa463aefc8bec9da for: {'subnet': 1} {{(pid=91687) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 04:21:12.131627 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-8c6a0267-5110-4ac4-85d2-5930cf2ed9de admin admin] Notify callbacks [] for subnet, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:12.153906 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-6add0f19-9a5f-4ec0-989e-ed338dc52cec admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:12.204544 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-aad9ef34-d62d-4fb9-b027-6d9ca14d151f None None] Transition to ACTIVE for port object 37c13c83-3c6b-4c47-8428-d4af18562753 will not be triggered until provisioned by entity L2. {{(pid=91688) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:21:12.262783 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-aad9ef34-d62d-4fb9-b027-6d9ca14d151f None None] Transition to ACTIVE for port object 37c13c83-3c6b-4c47-8428-d4af18562753 will not be triggered until provisioned by entity DHCP. {{(pid=91688) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:21:12.317790 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-aad9ef34-d62d-4fb9-b027-6d9ca14d151f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8782892106231'] for port, after_create {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:12.328779 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:12.349509 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 34930) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:21:12.386205 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.db_base_plugin_common [None req-6add0f19-9a5f-4ec0-989e-ed338dc52cec admin admin] Allocated IP 172.27.1.34 (aec557db-0c02-4008-8c9f-2efcd7462f90/217f4b55-4415-4d57-8b43-2ff4c8ac8e81/a51c67da-478f-4b96-ab49-4cd64c665710) {{(pid=91686) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 04:21:12.427138 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aad9ef34-d62d-4fb9-b027-6d9ca14d151f None None] Pushing event updated for resources: {'Port': ['ID=37c13c83-3c6b-4c47-8428-d4af18562753,revision_number=1']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:12.441216 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aad9ef34-d62d-4fb9-b027-6d9ca14d151f None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:21:12.441867 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aad9ef34-d62d-4fb9-b027-6d9ca14d151f None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:21:12.442522 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aad9ef34-d62d-4fb9-b027-6d9ca14d151f None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:21:12.443012 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aad9ef34-d62d-4fb9-b027-6d9ca14d151f None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:21:12.443487 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aad9ef34-d62d-4fb9-b027-6d9ca14d151f None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:21:12.444245 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aad9ef34-d62d-4fb9-b027-6d9ca14d151f None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:21:12.444763 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aad9ef34-d62d-4fb9-b027-6d9ca14d151f None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:21:12.445314 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aad9ef34-d62d-4fb9-b027-6d9ca14d151f None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:21:12.445782 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aad9ef34-d62d-4fb9-b027-6d9ca14d151f None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:21:12.446613 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aad9ef34-d62d-4fb9-b027-6d9ca14d151f None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:21:12.447117 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aad9ef34-d62d-4fb9-b027-6d9ca14d151f None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:21:12.447580 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aad9ef34-d62d-4fb9-b027-6d9ca14d151f None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:21:12.449465 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aad9ef34-d62d-4fb9-b027-6d9ca14d151f None None] Tracked resource versions report:
May 20 04:21:12.449465 dv-cinder-790910-4-iscsi neutron-server[91688]: pushed versions:
May 20 04:21:12.449465 dv-cinder-790910-4-iscsi neutron-server[91688]: {   'AddressGroup': {'1.2'},
May 20 04:21:12.449465 dv-cinder-790910-4-iscsi neutron-server[91688]:     'ConntrackHelper': {'1.0'},
May 20 04:21:12.449465 dv-cinder-790910-4-iscsi neutron-server[91688]:     'Log': {'1.0'},
May 20 04:21:12.449465 dv-cinder-790910-4-iscsi neutron-server[91688]:     'Network': {'1.1'},
May 20 04:21:12.449465 dv-cinder-790910-4-iscsi neutron-server[91688]:     'Port': {'1.7'},
May 20 04:21:12.449465 dv-cinder-790910-4-iscsi neutron-server[91688]:     'PortForwarding': {'1.2'},
May 20 04:21:12.449465 dv-cinder-790910-4-iscsi neutron-server[91688]:     'QosPolicy': {'1.8'},
May 20 04:21:12.449465 dv-cinder-790910-4-iscsi neutron-server[91688]:     'SecurityGroup': {'1.4'},
May 20 04:21:12.449465 dv-cinder-790910-4-iscsi neutron-server[91688]:     'SecurityGroupRule': {'1.2'},
May 20 04:21:12.449465 dv-cinder-790910-4-iscsi neutron-server[91688]:     'SubPort': {'1.0'},
May 20 04:21:12.449465 dv-cinder-790910-4-iscsi neutron-server[91688]:     'Subnet': {'1.1'},
May 20 04:21:12.449465 dv-cinder-790910-4-iscsi neutron-server[91688]:     'Trunk': {'1.1'}}
May 20 04:21:12.449465 dv-cinder-790910-4-iscsi neutron-server[91688]: consumer versions:
May 20 04:21:12.449465 dv-cinder-790910-4-iscsi neutron-server[91688]: {   DHCP agent@dv-cinder-790910-4-iscsi: {},
May 20 04:21:12.449465 dv-cinder-790910-4-iscsi neutron-server[91688]:     HyperV agent@hv-cinder-79091: {},
May 20 04:21:12.449465 dv-cinder-790910-4-iscsi neutron-server[91688]:     L3 agent@dv-cinder-790910-4-iscsi: {},
May 20 04:21:12.449465 dv-cinder-790910-4-iscsi neutron-server[91688]:     Metadata agent@dv-cinder-790910-4-iscsi: {},
May 20 04:21:12.449465 dv-cinder-790910-4-iscsi neutron-server[91688]:     Metering agent@dv-cinder-790910-4-iscsi: {},
May 20 04:21:12.449465 dv-cinder-790910-4-iscsi neutron-server[91688]:     Open vSwitch agent@dv-cinder-790910-4-iscsi: {   'AddressGroup': '1.2',
May 20 04:21:12.449465 dv-cinder-790910-4-iscsi neutron-server[91688]:                                                      'ConntrackHelper': '1.0',
May 20 04:21:12.449465 dv-cinder-790910-4-iscsi neutron-server[91688]:                                                      'Log': '1.0',
May 20 04:21:12.449465 dv-cinder-790910-4-iscsi neutron-server[91688]:                                                      'Network': '1.1',
May 20 04:21:12.449465 dv-cinder-790910-4-iscsi neutron-server[91688]:                                                      'Port': '1.7',
May 20 04:21:12.449465 dv-cinder-790910-4-iscsi neutron-server[91688]:                                                      'PortForwarding': '1.2',
May 20 04:21:12.449465 dv-cinder-790910-4-iscsi neutron-server[91688]:                                                      'QosPolicy': '1.8',
May 20 04:21:12.449465 dv-cinder-790910-4-iscsi neutron-server[91688]:                                                      'SecurityGroup': '1.4',
May 20 04:21:12.449465 dv-cinder-790910-4-iscsi neutron-server[91688]:                                                      'SecurityGroupRule': '1.2',
May 20 04:21:12.449465 dv-cinder-790910-4-iscsi neutron-server[91688]:                                                      'SubPort': '1.0',
May 20 04:21:12.449465 dv-cinder-790910-4-iscsi neutron-server[91688]:                                                      'Subnet': '1.1',
May 20 04:21:12.449465 dv-cinder-790910-4-iscsi neutron-server[91688]:                                                      'Trunk': '1.1'}}
May 20 04:21:12.449465 dv-cinder-790910-4-iscsi neutron-server[91688]:  {{(pid=91688) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
May 20 04:21:12.460016 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-aad9ef34-d62d-4fb9-b027-6d9ca14d151f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.131s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:12.472343 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aad9ef34-d62d-4fb9-b027-6d9ca14d151f None None] Network 21794e86-fda7-40a6-a5a8-db117c7eeb9d is already hosted by enough agents. {{(pid=91688) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:21:12.476336 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.scheduler.base_scheduler [None req-aad9ef34-d62d-4fb9-b027-6d9ca14d151f None None] Resources bound (agent type, host, resource id):  {{(pid=91688) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:21:12.490238 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aad9ef34-d62d-4fb9-b027-6d9ca14d151f None None] Received port after_create {{(pid=91688) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 04:21:12.635979 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-1160709a-ea08-4499-938a-151e538c5c0b admin admin] Notify callbacks [] for security_group, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:12.637657 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-6add0f19-9a5f-4ec0-989e-ed338dc52cec admin admin] Notify callbacks [] for port, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:12.696164 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-1160709a-ea08-4499-938a-151e538c5c0b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:21:12.701605 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-2153d097-ea28-4280-b639-7c93adfa12b7 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:12.714933 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-6add0f19-9a5f-4ec0-989e-ed338dc52cec admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8782892106231'] for port, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:12.724720 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3094b96-60ea-4e42-bbdf-13f522966312 admin admin] Pushing event updated for resources: {'Network': ['ID=8f3c5439-7e79-4f14-a1a4-1c62e4ffee6f,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:12.732518 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-d3094b96-60ea-4e42-bbdf-13f522966312 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.735s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:12.733917 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.003s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:12.767488 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-94d57b86-978b-4374-943c-661aad187e15 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:12.788203 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-2153d097-ea28-4280-b639-7c93adfa12b7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:12.790440 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-94d57b86-978b-4374-943c-661aad187e15 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:12.792436 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6add0f19-9a5f-4ec0-989e-ed338dc52cec admin admin] Network aec557db-0c02-4008-8c9f-2efcd7462f90 is already hosted by enough agents. {{(pid=91686) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:21:12.799077 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Network 8f3c5439-7e79-4f14-a1a4-1c62e4ffee6f details requested by agent ovs-agent-dv-cinder-790910-4-iscsi with host dv-cinder-790910-4-iscsi {{(pid=91688) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 20 04:21:12.811408 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.base_scheduler [None req-6add0f19-9a5f-4ec0-989e-ed338dc52cec admin admin] Resources bound (agent type, host, resource id):  {{(pid=91686) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:21:12.818522 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6add0f19-9a5f-4ec0-989e-ed338dc52cec admin admin] Received port after_create {{(pid=91686) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 04:21:12.981609 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.managers [None req-aad9ef34-d62d-4fb9-b027-6d9ca14d151f None None] Attempting to bind port 37c13c83-3c6b-4c47-8428-d4af18562753 on host dv-cinder-790910-4-iscsi for vnic_type normal with profile  {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 04:21:12.982320 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.managers [None req-aad9ef34-d62d-4fb9-b027-6d9ca14d151f None None] Attempting to bind port 37c13c83-3c6b-4c47-8428-d4af18562753 by drivers openvswitch,hyperv on host dv-cinder-790910-4-iscsi at level 0 using segments [{'id': '9521f383-6017-4b4d-9f47-cff4ed54cb57', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 864, 'network_id': '21794e86-fda7-40a6-a5a8-db117c7eeb9d'}] {{(pid=91688) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 04:21:12.982973 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aad9ef34-d62d-4fb9-b027-6d9ca14d151f None None] Attempting to bind port 37c13c83-3c6b-4c47-8428-d4af18562753 on network 21794e86-fda7-40a6-a5a8-db117c7eeb9d {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:21:13.014272 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.db_base_plugin_common [None req-2153d097-ea28-4280-b639-7c93adfa12b7 admin admin] Allocated IP 172.27.1.72 (aec557db-0c02-4008-8c9f-2efcd7462f90/217f4b55-4415-4d57-8b43-2ff4c8ac8e81/16508f6e-35a3-4301-9018-78e099969b00) {{(pid=91687) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 04:21:13.048180 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aad9ef34-d62d-4fb9-b027-6d9ca14d151f None None] Checking agent: {'id': '333121d4-1023-4a33-a54c-f4dd052e1612', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-790910-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 4, 13, 33), 'started_at': datetime.datetime(2021, 5, 20, 4, 14, 3), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 4, 21, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-790910-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 04:21:13.049052 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aad9ef34-d62d-4fb9-b027-6d9ca14d151f None None] Checking segment: {'id': '9521f383-6017-4b4d-9f47-cff4ed54cb57', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 864, 'network_id': '21794e86-fda7-40a6-a5a8-db117c7eeb9d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91688) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:21:13.049662 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-aad9ef34-d62d-4fb9-b027-6d9ca14d151f None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:13.050361 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aad9ef34-d62d-4fb9-b027-6d9ca14d151f None None] Bound using segment: {'id': '9521f383-6017-4b4d-9f47-cff4ed54cb57', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 864, 'network_id': '21794e86-fda7-40a6-a5a8-db117c7eeb9d'} {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 04:21:13.051220 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.managers [None req-aad9ef34-d62d-4fb9-b027-6d9ca14d151f None None] Bound port: 37c13c83-3c6b-4c47-8428-d4af18562753, host: dv-cinder-790910-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9521f383-6017-4b4d-9f47-cff4ed54cb57', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 864, 'network_id': '21794e86-fda7-40a6-a5a8-db117c7eeb9d'}}] {{(pid=91688) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 04:21:13.051884 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-aad9ef34-d62d-4fb9-b027-6d9ca14d151f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:13.103791 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6add0f19-9a5f-4ec0-989e-ed338dc52cec admin admin] Pushing event updated for resources: {'Port': ['ID=a51c67da-478f-4b96-ab49-4cd64c665710,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:13.117608 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-6add0f19-9a5f-4ec0-989e-ed338dc52cec admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.383s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:13.124054 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.306s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:13.133994 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-94d57b86-978b-4374-943c-661aad187e15 admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=69a141e7df9249a4b48fc96ea0a6cbba&name=default HTTP/1.1" status: 200  len: 2975 time: 2.1448684
May 20 04:21:13.192719 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 34948) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:21:13.204926 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-2153d097-ea28-4280-b639-7c93adfa12b7 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:13.225760 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-1160709a-ea08-4499-938a-151e538c5c0b admin admin] Usage tracker for resource:security_group_rule and tenant:6078fa3175bc4977acf39797ac62987c is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:21:13.291291 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-1160709a-ea08-4499-938a-151e538c5c0b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:21:13.322285 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-1160709a-ea08-4499-938a-151e538c5c0b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:21:13.343691 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-aad9ef34-d62d-4fb9-b027-6d9ca14d151f None None] For port 37c13c83-3c6b-4c47-8428-d4af18562753, host dv-cinder-790910-4-iscsi, cleared binding levels {{(pid=91688) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 04:21:13.349759 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-aad9ef34-d62d-4fb9-b027-6d9ca14d151f None None] For port 37c13c83-3c6b-4c47-8428-d4af18562753, host dv-cinder-790910-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=37c13c83-3c6b-4c47-8428-d4af18562753,segment=NetworkSegment(9521f383-6017-4b4d-9f47-cff4ed54cb57),segment_id=9521f383-6017-4b4d-9f47-cff4ed54cb57)] {{(pid=91688) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 04:21:13.367835 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-aad9ef34-d62d-4fb9-b027-6d9ca14d151f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:13.368770 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94d57b86-978b-4374-943c-661aad187e15 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1afd9fc1-d8cb-456b-b473-15539ff1e84c,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:13.378242 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-0c33b8b7-e453-49b0-975d-523259f7466b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:13.379598 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-abf9c894-2cc6-45d2-9083-767533f2071f None None] Network 4100b38a-1db4-4a6e-9c33-7bcf19c64d59 requested from dv-cinder-790910-4-iscsi {{(pid=91688) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 04:21:13.382733 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-94d57b86-978b-4374-943c-661aad187e15 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.259s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:13.485255 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:13.523618 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-2153d097-ea28-4280-b639-7c93adfa12b7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8782892106231'] for port, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:13.524619 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 34970) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:21:13.536143 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-cec75340-fe9b-4421-ace2-68efc51d9a73 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:13.548013 dv-cinder-790910-4-iscsi neutron-server[91686]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases.
May 20 04:21:13.575898 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-0c33b8b7-e453-49b0-975d-523259f7466b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:13.744308 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2153d097-ea28-4280-b639-7c93adfa12b7 admin admin] Network aec557db-0c02-4008-8c9f-2efcd7462f90 is already hosted by enough agents. {{(pid=91687) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:21:13.780384 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aad9ef34-d62d-4fb9-b027-6d9ca14d151f None None] Pushing event updated for resources: {'Port': ['ID=37c13c83-3c6b-4c47-8428-d4af18562753,revision_number=2']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:13.788172 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-6add0f19-9a5f-4ec0-989e-ed338dc52cec admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:13.795556 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-aad9ef34-d62d-4fb9-b027-6d9ca14d151f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.312s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:13.828346 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.base_scheduler [None req-2153d097-ea28-4280-b639-7c93adfa12b7 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91687) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:21:13.834091 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2153d097-ea28-4280-b639-7c93adfa12b7 admin admin] Received port after_create {{(pid=91687) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 04:21:14.009692 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2153d097-ea28-4280-b639-7c93adfa12b7 admin admin] Pushing event updated for resources: {'Port': ['ID=16508f6e-35a3-4301-9018-78e099969b00,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:14.016584 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-2153d097-ea28-4280-b639-7c93adfa12b7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.480s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:14.054933 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a29b5ab6-2541-493f-a266-5f2fd459002a req-68183b7b-92a3-46fc-a6d6-efbbb3742e16 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:21:14.055696 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [req-a29b5ab6-2541-493f-a266-5f2fd459002a req-68183b7b-92a3-46fc-a6d6-efbbb3742e16 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Synchronizing usage tracker for tenant:b6214ee7a3fe4823b9db71f53439835e on resource:network {{(pid=91686) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:21:14.067815 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-0c33b8b7-e453-49b0-975d-523259f7466b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:14.084624 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-94d57b86-978b-4374-943c-661aad187e15 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:14.108204 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-1160709a-ea08-4499-938a-151e538c5c0b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:14.110127 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c33b8b7-e453-49b0-975d-523259f7466b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1afd9fc1-d8cb-456b-b473-15539ff1e84c,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:14.131046 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-0c33b8b7-e453-49b0-975d-523259f7466b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:14.233995 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-1160709a-ea08-4499-938a-151e538c5c0b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:14.267867 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-2d08487b-d239-40bf-9d04-884d569b105e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:14.303667 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [req-a29b5ab6-2541-493f-a266-5f2fd459002a req-68183b7b-92a3-46fc-a6d6-efbbb3742e16 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Unset dirty status for tenant:b6214ee7a3fe4823b9db71f53439835e on resource:network {{(pid=91686) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:21:14.310491 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-a29b5ab6-2541-493f-a266-5f2fd459002a req-68183b7b-92a3-46fc-a6d6-efbbb3742e16 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/networks?id=4100b38a-1db4-4a6e-9c33-7bcf19c64d59 HTTP/1.1" status: 200  len: 812 time: 0.7706268
May 20 04:21:14.339100 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-a29b5ab6-2541-493f-a266-5f2fd459002a req-66269325-881d-4282-9fa8-29cbeb9d4e64 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/quotas/b6214ee7a3fe4823b9db71f53439835e HTTP/1.1" status: 200  len: 375 time: 0.0275731
May 20 04:21:14.346594 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-1160709a-ea08-4499-938a-151e538c5c0b admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=6078fa3175bc4977acf39797ac62987c&name=default HTTP/1.1" status: 200  len: 2975 time: 1.8153589
May 20 04:21:14.351596 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-0c33b8b7-e453-49b0-975d-523259f7466b admin admin] Notify callbacks [] for security_group, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:14.352800 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-0c33b8b7-e453-49b0-975d-523259f7466b admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/1afd9fc1-d8cb-456b-b473-15539ff1e84c HTTP/1.1" status: 204  len: 168 time: 1.1506002
May 20 04:21:14.353528 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 34986) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:21:14.357066 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1160709a-ea08-4499-938a-151e538c5c0b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ace080c6-9363-4038-bab5-a0cfeb5394e9,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:14.366643 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-1160709a-ea08-4499-938a-151e538c5c0b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.099s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:14.506827 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-a29b5ab6-2541-493f-a266-5f2fd459002a req-0dceeb3f-1a68-47cc-ae39-f063e2fd3ebd tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/ports?tenant_id=b6214ee7a3fe4823b9db71f53439835e&fields=id HTTP/1.1" status: 200  len: 210 time: 0.1648097
May 20 04:21:14.721143 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-2153d097-ea28-4280-b639-7c93adfa12b7 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:14.798599 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-8c6a0267-5110-4ac4-85d2-5930cf2ed9de admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-255887', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377'] for subnet, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:14.815144 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-25eab167-a43e-426e-9d7d-6e5c2a6bc5e8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:14.840376 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-6add0f19-9a5f-4ec0-989e-ed338dc52cec admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1796474', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1714058'] for router, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:14.927547 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-e2d83481-aeba-4790-99de-07e5203a928e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:15.070487 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c6a0267-5110-4ac4-85d2-5930cf2ed9de admin admin] Pushing event updated for resources: {'Subnet': ['ID=8056a6e8-a142-41c5-912d-67dac326144f,revision_number=0']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:15.077078 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-8c6a0267-5110-4ac4-85d2-5930cf2ed9de admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.262s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:15.084851 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8c6a0267-5110-4ac4-85d2-5930cf2ed9de admin admin] Checking segment: {'id': '04a1687e-8456-4751-bf61-29951b14a5c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 899, 'network_id': '8f3c5439-7e79-4f14-a1a4-1c62e4ffee6f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91687) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:21:15.085238 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8c6a0267-5110-4ac4-85d2-5930cf2ed9de admin admin] Network hostable DHCP agents. Network: 8f3c5439-7e79-4f14-a1a4-1c62e4ffee6f, hostable agents: ['36d27813-c368-4fd7-ae26-0f662e0a96fd'], hosted agents: [] {{(pid=91687) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 20 04:21:15.195750 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 37c13c83-3c6b-4c47-8428-d4af18562753 up at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:21:15.196393 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 35004) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:21:15.214238 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [req-a29b5ab6-2541-493f-a266-5f2fd459002a req-f76a8d3d-69da-446d-ab3d-8f867c69b3a8 service neutron] http://10.222.0.71:9696/v2.0/extensions returned with HTTP 200 {{(pid=91686) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 20 04:21:15.216718 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-a29b5ab6-2541-493f-a266-5f2fd459002a req-f76a8d3d-69da-446d-ab3d-8f867c69b3a8 service neutron] 10.222.0.71 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.4055312
May 20 04:21:15.271102 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-7826a9ec-9154-4811-95bd-fd77f77372a3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:15.297423 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning for port 37c13c83-3c6b-4c47-8428-d4af18562753 completed by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:21:15.324673 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8c6a0267-5110-4ac4-85d2-5930cf2ed9de admin admin] Network 8f3c5439-7e79-4f14-a1a4-1c62e4ffee6f is scheduled to be hosted by DHCP agent 36d27813-c368-4fd7-ae26-0f662e0a96fd with binding_index 1 {{(pid=91687) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 20 04:21:15.393658 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-7826a9ec-9154-4811-95bd-fd77f77372a3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:21:15.413176 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-7826a9ec-9154-4811-95bd-fd77f77372a3 admin admin] Usage tracker for resource:security_group_rule and tenant:53ab969fd51d4945bcfea58761bc5775 is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:21:15.419028 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-7826a9ec-9154-4811-95bd-fd77f77372a3 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:21:15.427541 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.base_scheduler [None req-8c6a0267-5110-4ac4-85d2-5930cf2ed9de admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-790910-4-iscsi, 8f3c5439-7e79-4f14-a1a4-1c62e4ffee6f) {{(pid=91687) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:21:15.429480 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-7826a9ec-9154-4811-95bd-fd77f77372a3 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:21:15.442372 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-28a13b70-b9a2-4a1f-817f-09433cf59dc5 None None] Network 8f3c5439-7e79-4f14-a1a4-1c62e4ffee6f requested from dv-cinder-790910-4-iscsi {{(pid=91688) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 04:21:15.444705 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8c6a0267-5110-4ac4-85d2-5930cf2ed9de admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:21:15.445334 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-8c6a0267-5110-4ac4-85d2-5930cf2ed9de admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for subnet, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:15.482325 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-2153d097-ea28-4280-b639-7c93adfa12b7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1796474', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1714058'] for router, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:15.624365 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-8c6a0267-5110-4ac4-85d2-5930cf2ed9de admin admin] 10.222.0.71 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 862 time: 3.5932834
May 20 04:21:15.644056 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-e2d83481-aeba-4790-99de-07e5203a928e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:15.659634 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-73827e0f-4f8f-4df7-bfe5-4287a34ae614 None None] Network 21794e86-fda7-40a6-a5a8-db117c7eeb9d requested from dv-cinder-790910-4-iscsi {{(pid=91688) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 04:21:15.832640 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-a29b5ab6-2541-493f-a266-5f2fd459002a req-5090db22-1d13-4941-b80e-56c258126ff2 service neutron] 10.222.0.71 "GET /v2.0/networks/4100b38a-1db4-4a6e-9c33-7bcf19c64d59?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.5646439
May 20 04:21:15.931217 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-7826a9ec-9154-4811-95bd-fd77f77372a3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:15.936461 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-fd976232-d52a-4095-83ed-1c0d0221cf33 None None] Provisioning for port 37c13c83-3c6b-4c47-8428-d4af18562753 completed by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:21:15.942356 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-7826a9ec-9154-4811-95bd-fd77f77372a3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:15.958401 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-25c3ba7c-b49d-44f8-b540-7ea6373ee96b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:16.030797 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-e2d83481-aeba-4790-99de-07e5203a928e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:16.052817 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:16.075856 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2d83481-aeba-4790-99de-07e5203a928e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ace080c6-9363-4038-bab5-a0cfeb5394e9,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:16.092069 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-e2d83481-aeba-4790-99de-07e5203a928e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:16.094273 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-fd976232-d52a-4095-83ed-1c0d0221cf33 None None] Provisioning complete for port 37c13c83-3c6b-4c47-8428-d4af18562753 triggered by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:21:16.096425 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-fd976232-d52a-4095-83ed-1c0d0221cf33 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:16.103738 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6add0f19-9a5f-4ec0-989e-ed338dc52cec admin admin] Router 4ec3fa08-f3da-44bd-bf6b-4feab27e9b78 is scheduled to L3 agent 02733fc0-fc9c-4e29-bc03-c27a792d539d with binding_index 1 {{(pid=91686) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 20 04:21:16.111596 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-e2d83481-aeba-4790-99de-07e5203a928e admin admin] Notify callbacks [] for security_group, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:16.112995 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-e2d83481-aeba-4790-99de-07e5203a928e admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/ace080c6-9363-4038-bab5-a0cfeb5394e9 HTTP/1.1" status: 204  len: 168 time: 1.6641054
May 20 04:21:16.132826 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-a29b5ab6-2541-493f-a266-5f2fd459002a req-72f575e8-22c2-4ef9-87fd-fc572787a202 service neutron] 10.222.0.71 "GET /v2.0/networks/4100b38a-1db4-4a6e-9c33-7bcf19c64d59?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2819073
May 20 04:21:16.224811 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2153d097-ea28-4280-b639-7c93adfa12b7 admin admin] Router 34eeb764-2607-4d9f-96c4-89598b702500 is scheduled to L3 agent 02733fc0-fc9c-4e29-bc03-c27a792d539d with binding_index 1 {{(pid=91687) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 20 04:21:16.231453 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-7826a9ec-9154-4811-95bd-fd77f77372a3 admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=53ab969fd51d4945bcfea58761bc5775&name=default HTTP/1.1" status: 200  len: 2975 time: 1.0339565
May 20 04:21:16.238364 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7826a9ec-9154-4811-95bd-fd77f77372a3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d1c89168-240f-408e-bd21-4579c6bee520,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:16.241061 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 35034) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:21:16.356603 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-7826a9ec-9154-4811-95bd-fd77f77372a3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.398s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:16.503085 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b06f5c03-cceb-433d-a71e-418acba7c940 None None] Network 8f3c5439-7e79-4f14-a1a4-1c62e4ffee6f requested from dv-cinder-790910-4-iscsi {{(pid=91688) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 04:21:16.574973 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-f34547a0-6513-4014-bf7d-1a0699e21e60 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:16.692149 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-f34547a0-6513-4014-bf7d-1a0699e21e60 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:16.751217 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2153d097-ea28-4280-b639-7c93adfa12b7 admin admin] Notify agent at l3_agent.dv-cinder-790910-4-iscsi the message routers_updated {{(pid=91687) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 04:21:16.796745 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-2153d097-ea28-4280-b639-7c93adfa12b7 admin admin] Notify callbacks [] for router, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:16.805399 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-2153d097-ea28-4280-b639-7c93adfa12b7 admin admin] 10.222.0.71 "POST /v2.0/routers HTTP/1.1" status: 201  len: 928 time: 6.1935854
May 20 04:21:16.809012 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 35056) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:21:16.876106 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2627ae6b-48a2-43a3-95fa-7e75008fcfd9 None None] Sync routers for ids ['34eeb764-2607-4d9f-96c4-89598b702500'] in dv-cinder-790910-4-iscsi {{(pid=91689) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 04:21:16.928468 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2627ae6b-48a2-43a3-95fa-7e75008fcfd9 None None] Routers {'34eeb764-2607-4d9f-96c4-89598b702500'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91689) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:21:16.929850 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-2627ae6b-48a2-43a3-95fa-7e75008fcfd9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced246f5e0>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:21:03Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['34eeb764-2607-4d9f-96c4-89598b702500'], 'active': True} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:21:17.099327 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-41cdb79c-68f0-48c7-a385-122383178287 req-821e0941-05a5-4289-baf1-cbd323bf18ac tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/ports?device_id=20a6d6ed-f811-42fd-8b44-ab4c031330e7 HTTP/1.1" status: 200  len: 210 time: 0.2327995
May 20 04:21:17.151163 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6add0f19-9a5f-4ec0-989e-ed338dc52cec admin admin] Notify agent at l3_agent.dv-cinder-790910-4-iscsi the message routers_updated {{(pid=91686) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 04:21:17.190070 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fbdced15-c0db-4046-b63a-905c382e7a1d None None] Sync routers for ids ['4ec3fa08-f3da-44bd-bf6b-4feab27e9b78'] in dv-cinder-790910-4-iscsi {{(pid=91688) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 04:21:17.207293 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-6add0f19-9a5f-4ec0-989e-ed338dc52cec admin admin] Notify callbacks [] for router, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:17.208583 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-6add0f19-9a5f-4ec0-989e-ed338dc52cec admin admin] 10.222.0.71 "POST /v2.0/routers HTTP/1.1" status: 201  len: 930 time: 7.7994316
May 20 04:21:17.211409 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 35076) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:21:17.367806 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-f34547a0-6513-4014-bf7d-1a0699e21e60 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:17.381150 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fbdced15-c0db-4046-b63a-905c382e7a1d None None] Routers {'4ec3fa08-f3da-44bd-bf6b-4feab27e9b78'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91688) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:21:17.382236 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-fbdced15-c0db-4046-b63a-905c382e7a1d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced1b4de50>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:21:03Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['4ec3fa08-f3da-44bd-bf6b-4feab27e9b78'], 'active': True} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:21:17.518623 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:17.566490 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-fd976232-d52a-4095-83ed-1c0d0221cf33 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:17.567366 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f34547a0-6513-4014-bf7d-1a0699e21e60 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d1c89168-240f-408e-bd21-4579c6bee520,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:17.570189 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-f34547a0-6513-4014-bf7d-1a0699e21e60 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:17.592090 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-f34547a0-6513-4014-bf7d-1a0699e21e60 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:17.597715 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-f34547a0-6513-4014-bf7d-1a0699e21e60 admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/d1c89168-240f-408e-bd21-4579c6bee520 HTTP/1.1" status: 204  len: 168 time: 1.2414386
May 20 04:21:17.780053 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvr_db [None req-2627ae6b-48a2-43a3-95fa-7e75008fcfd9 None None] Set router 34eeb764-2607-4d9f-96c4-89598b702500 gateway port host: dv-cinder-790910-4-iscsi {{(pid=91689) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:21:17.956772 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-fd976232-d52a-4095-83ed-1c0d0221cf33 None None] For port 37c13c83-3c6b-4c47-8428-d4af18562753, host dv-cinder-790910-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=37c13c83-3c6b-4c47-8428-d4af18562753,segment=NetworkSegment(9521f383-6017-4b4d-9f47-cff4ed54cb57),segment_id=9521f383-6017-4b4d-9f47-cff4ed54cb57)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:21:17.980587 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-fd976232-d52a-4095-83ed-1c0d0221cf33 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:18.023893 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:18.100979 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 35100) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:21:18.138212 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.v2.base [None req-8f90687d-d247-456e-a20b-287f17db1de2 admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-846800874-network', 'tenant_id': 'f19de276d4f943ce8aa2bdc4930890d1'}} {{(pid=91686) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:21:18.278693 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvr_db [None req-fbdced15-c0db-4046-b63a-905c382e7a1d None None] Set router 4ec3fa08-f3da-44bd-bf6b-4feab27e9b78 gateway port host: dv-cinder-790910-4-iscsi {{(pid=91688) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:21:18.282193 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 35116) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:21:18.292403 dv-cinder-790910-4-iscsi neutron-server[91687]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases.
May 20 04:21:18.366600 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-8f90687d-d247-456e-a20b-287f17db1de2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:21:18.405377 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-8f90687d-d247-456e-a20b-287f17db1de2 admin admin] Usage tracker for resource:network and tenant:f19de276d4f943ce8aa2bdc4930890d1 is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:21:18.414526 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-8f90687d-d247-456e-a20b-287f17db1de2 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:21:18.427056 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-2742cb37-5d02-4138-9c79-9766b5f44f60 req-79be56eb-f0cd-4607-8185-1764dd6feda4 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/ports?device_id=20a6d6ed-f811-42fd-8b44-ab4c031330e7 HTTP/1.1" status: 200  len: 210 time: 0.1414652
May 20 04:21:18.449985 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-8f90687d-d247-456e-a20b-287f17db1de2 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:21:18.651839 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8f90687d-d247-456e-a20b-287f17db1de2 admin admin] Made reservation on behalf of f19de276d4f943ce8aa2bdc4930890d1 for: {'network': 1} {{(pid=91686) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 04:21:18.655118 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-8f90687d-d247-456e-a20b-287f17db1de2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-578118'] for network, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:18.678891 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-2627ae6b-48a2-43a3-95fa-7e75008fcfd9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced246f5e0>, [{'id': '34eeb764-2607-4d9f-96c4-89598b702500', 'name': 'tempest-AttachVolumeShelveTestJSON-1895235554-router', 'tenant_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.72'}], 'enable_snat': True}, 'gw_port_id': '16508f6e-35a3-4301-9018-78e099969b00', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:21:10Z', 'updated_at': '2021-05-20T04:21:14Z', 'revision_number': 3, 'project_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'gw_port': {'id': '16508f6e-35a3-4301-9018-78e099969b00', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:e3:82', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '34eeb764-2607-4d9f-96c4-89598b702500', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:21:12Z', 'updated_at': '2021-05-20T04:21:13Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi'}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:21:18.685007 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2627ae6b-48a2-43a3-95fa-7e75008fcfd9 None None] Checking router: 34eeb764-2607-4d9f-96c4-89598b702500 for host: dv-cinder-790910-4-iscsi {{(pid=91689) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 04:21:18.689942 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-b2649d32-9948-48d7-9579-158920e7ec5d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:18.690685 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2627ae6b-48a2-43a3-95fa-7e75008fcfd9 None None] Updating router 34eeb764-2607-4d9f-96c4-89598b702500 port 16508f6e-35a3-4301-9018-78e099969b00 binding host dv-cinder-790910-4-iscsi {{(pid=91689) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 20 04:21:18.723575 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-8f90687d-d247-456e-a20b-287f17db1de2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:18.789186 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-8f90687d-d247-456e-a20b-287f17db1de2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:21:18.807823 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-8f90687d-d247-456e-a20b-287f17db1de2 admin admin] Usage tracker for resource:security_group_rule and tenant:f19de276d4f943ce8aa2bdc4930890d1 is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:21:18.828035 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron_lib.callbacks.manager [None req-2627ae6b-48a2-43a3-95fa-7e75008fcfd9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:18.828874 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-8f90687d-d247-456e-a20b-287f17db1de2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:21:18.864354 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd976232-d52a-4095-83ed-1c0d0221cf33 None None] Pushing event updated for resources: {'Port': ['ID=37c13c83-3c6b-4c47-8428-d4af18562753,revision_number=3']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:18.998163 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-8f90687d-d247-456e-a20b-287f17db1de2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:21:19.058764 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-fd976232-d52a-4095-83ed-1c0d0221cf33 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 1.035s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:19.101960 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.db_base_plugin_common [None req-b2649d32-9948-48d7-9579-158920e7ec5d admin admin] Allocated IP 172.20.0.1 (21794e86-fda7-40a6-a5a8-db117c7eeb9d/06f38702-3d3c-4e25-8f84-85483d1ddf28/aad390e4-f9e2-4bbe-9e64-7b390cc7f3b3) {{(pid=91687) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 04:21:19.171557 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-da741bb0-cf6e-48d4-b8da-5a67e1f53dfd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:19.352713 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-4d663b76-23f7-45d7-aabd-b56ddaca4c15 None None] Provisioning complete for port 37c13c83-3c6b-4c47-8428-d4af18562753 triggered by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:21:19.353483 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-4d663b76-23f7-45d7-aabd-b56ddaca4c15 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:19.547013 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-b2649d32-9948-48d7-9579-158920e7ec5d admin admin] Notify callbacks [] for port, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:19.627456 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.provisioning_blocks [None req-b2649d32-9948-48d7-9579-158920e7ec5d admin admin] Transition to ACTIVE for port object aad390e4-f9e2-4bbe-9e64-7b390cc7f3b3 will not be triggered until provisioned by entity DHCP. {{(pid=91687) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:21:19.672289 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.db_base_plugin_common [None req-da741bb0-cf6e-48d4-b8da-5a67e1f53dfd admin admin] Allocated IP 172.20.0.1 (348b2b0f-c826-45ab-ba85-8430235b9cac/b488dc7d-0e70-4e52-9179-7e6c3e4fb0a1/a4932092-c8bd-4cf6-88c2-2bbb4eb549b3) {{(pid=91686) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 04:21:19.695592 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-8f90687d-d247-456e-a20b-287f17db1de2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:19.724624 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-b2649d32-9948-48d7-9579-158920e7ec5d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8782892106231'] for port, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:19.743552 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:19.851010 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-27efa1fa-0403-4b8b-9a2d-bef98546017e req-8f092d5a-fe4e-481c-9e8f-cdea84a8dc62 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/ports?device_id=20a6d6ed-f811-42fd-8b44-ab4c031330e7 HTTP/1.1" status: 200  len: 210 time: 0.1663127
May 20 04:21:19.861410 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-fbdced15-c0db-4046-b63a-905c382e7a1d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced1b4de50>, [{'id': '4ec3fa08-f3da-44bd-bf6b-4feab27e9b78', 'name': 'tempest-ServerRescueNegativeTestJSON-2060961621-router', 'tenant_id': 'b7d86d894a5f420e86f4c28d7772bd22', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.34'}], 'enable_snat': True}, 'gw_port_id': 'a51c67da-478f-4b96-ab49-4cd64c665710', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:21:09Z', 'updated_at': '2021-05-20T04:21:13Z', 'revision_number': 3, 'project_id': 'b7d86d894a5f420e86f4c28d7772bd22', 'gw_port': {'id': 'a51c67da-478f-4b96-ab49-4cd64c665710', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:d9:31:98', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4ec3fa08-f3da-44bd-bf6b-4feab27e9b78', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.34', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:21:12Z', 'updated_at': '2021-05-20T04:21:12Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi'}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:21:19.866584 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fbdced15-c0db-4046-b63a-905c382e7a1d None None] Checking router: 4ec3fa08-f3da-44bd-bf6b-4feab27e9b78 for host: dv-cinder-790910-4-iscsi {{(pid=91688) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 04:21:19.867498 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fbdced15-c0db-4046-b63a-905c382e7a1d None None] Updating router 4ec3fa08-f3da-44bd-bf6b-4feab27e9b78 port a51c67da-478f-4b96-ab49-4cd64c665710 binding host dv-cinder-790910-4-iscsi {{(pid=91688) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 20 04:21:19.871672 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-8f90687d-d247-456e-a20b-287f17db1de2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:19.888371 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-675685ef-b5a7-4efb-88da-d55e463a352f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:19.945939 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-fbdced15-c0db-4046-b63a-905c382e7a1d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:20.178450 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2649d32-9948-48d7-9579-158920e7ec5d admin admin] Pushing event updated for resources: {'Port': ['ID=aad390e4-f9e2-4bbe-9e64-7b390cc7f3b3,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:20.191932 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron_lib.callbacks.manager [None req-2627ae6b-48a2-43a3-95fa-7e75008fcfd9 None None] Notify callbacks [] for port, precommit_update {{(pid=91689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:20.193636 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-b2649d32-9948-48d7-9579-158920e7ec5d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.450s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:20.216145 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b2649d32-9948-48d7-9579-158920e7ec5d admin admin] Network 21794e86-fda7-40a6-a5a8-db117c7eeb9d is already hosted by enough agents. {{(pid=91687) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:21:20.219326 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.base_scheduler [None req-b2649d32-9948-48d7-9579-158920e7ec5d admin admin] Resources bound (agent type, host, resource id):  {{(pid=91687) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:21:20.219581 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.provisioning_blocks [None req-2627ae6b-48a2-43a3-95fa-7e75008fcfd9 None None] Transition to ACTIVE for port object 16508f6e-35a3-4301-9018-78e099969b00 will not be triggered until provisioned by entity L2. {{(pid=91689) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:21:20.223290 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b2649d32-9948-48d7-9579-158920e7ec5d admin admin] Received port after_create {{(pid=91687) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 04:21:20.223926 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-b2649d32-9948-48d7-9579-158920e7ec5d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1716281'] for router_interface, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:20.240260 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron_lib.callbacks.manager [None req-2627ae6b-48a2-43a3-95fa-7e75008fcfd9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:20.244285 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f90687d-d247-456e-a20b-287f17db1de2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f0a915f3-6df1-4ca9-a949-1a6838dd4596,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:20.260258 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:20.266191 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-8f90687d-d247-456e-a20b-287f17db1de2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.378s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:20.278053 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8f90687d-d247-456e-a20b-287f17db1de2 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 850}  {{(pid=91686) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 20 04:21:20.438369 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-da741bb0-cf6e-48d4-b8da-5a67e1f53dfd admin admin] Notify callbacks [] for port, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:20.528140 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-da741bb0-cf6e-48d4-b8da-5a67e1f53dfd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8782892106231'] for port, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:20.529243 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.managers [None req-2627ae6b-48a2-43a3-95fa-7e75008fcfd9 None None] Attempting to bind port 16508f6e-35a3-4301-9018-78e099969b00 on host dv-cinder-790910-4-iscsi for vnic_type normal with profile  {{(pid=91689) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 04:21:20.529862 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.managers [None req-2627ae6b-48a2-43a3-95fa-7e75008fcfd9 None None] Attempting to bind port 16508f6e-35a3-4301-9018-78e099969b00 by drivers openvswitch,hyperv on host dv-cinder-790910-4-iscsi at level 0 using segments [{'id': '8df49ec5-3fb9-4715-bc9a-f4019a6b55f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90'}] {{(pid=91689) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 04:21:20.532536 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2627ae6b-48a2-43a3-95fa-7e75008fcfd9 None None] Attempting to bind port 16508f6e-35a3-4301-9018-78e099969b00 on network aec557db-0c02-4008-8c9f-2efcd7462f90 {{(pid=91689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:21:20.537459 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-b2649d32-9948-48d7-9579-158920e7ec5d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:20.553917 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:20.599088 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2627ae6b-48a2-43a3-95fa-7e75008fcfd9 None None] Checking agent: {'id': '333121d4-1023-4a33-a54c-f4dd052e1612', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-790910-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 4, 13, 33), 'started_at': datetime.datetime(2021, 5, 20, 4, 14, 3), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 4, 21, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-790910-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 04:21:20.603232 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2627ae6b-48a2-43a3-95fa-7e75008fcfd9 None None] Checking segment: {'id': '8df49ec5-3fb9-4715-bc9a-f4019a6b55f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91689) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:21:20.605358 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron_lib.callbacks.manager [None req-2627ae6b-48a2-43a3-95fa-7e75008fcfd9 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:20.606048 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2627ae6b-48a2-43a3-95fa-7e75008fcfd9 None None] Bound using segment: {'id': '8df49ec5-3fb9-4715-bc9a-f4019a6b55f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90'} {{(pid=91689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 04:21:20.606891 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.managers [None req-2627ae6b-48a2-43a3-95fa-7e75008fcfd9 None None] Bound port: 16508f6e-35a3-4301-9018-78e099969b00, host: dv-cinder-790910-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8df49ec5-3fb9-4715-bc9a-f4019a6b55f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90'}}] {{(pid=91689) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 04:21:20.617336 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron_lib.callbacks.manager [None req-2627ae6b-48a2-43a3-95fa-7e75008fcfd9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:20.641570 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-8f90687d-d247-456e-a20b-287f17db1de2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1501910'] for segment, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:20.642272 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.db.segments_db [None req-8f90687d-d247-456e-a20b-287f17db1de2 admin admin] Added segment e789589d-281b-437d-a8a9-98ef763c6c9d of type vlan for network 0ce28fd5-15fe-4fee-ac41-386db9383364
May 20 04:21:20.704519 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc1a6b76-36b2-43a5-8d34-0e74421f311c None None] Pushing event updated for resources: {'Port': ['ID=16508f6e-35a3-4301-9018-78e099969b00,revision_number=2']} {{(pid=91689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:20.804258 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.db [None req-2627ae6b-48a2-43a3-95fa-7e75008fcfd9 None None] For port 16508f6e-35a3-4301-9018-78e099969b00, host dv-cinder-790910-4-iscsi, cleared binding levels {{(pid=91689) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 04:21:20.806077 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-da741bb0-cf6e-48d4-b8da-5a67e1f53dfd admin admin] Network 348b2b0f-c826-45ab-ba85-8430235b9cac is already hosted by enough agents. {{(pid=91686) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:21:20.809284 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.db [None req-2627ae6b-48a2-43a3-95fa-7e75008fcfd9 None None] For port 16508f6e-35a3-4301-9018-78e099969b00, host dv-cinder-790910-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=16508f6e-35a3-4301-9018-78e099969b00,segment=NetworkSegment(8df49ec5-3fb9-4715-bc9a-f4019a6b55f9),segment_id=8df49ec5-3fb9-4715-bc9a-f4019a6b55f9)] {{(pid=91689) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 04:21:20.821901 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron_lib.callbacks.manager [None req-2627ae6b-48a2-43a3-95fa-7e75008fcfd9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:20.825535 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc1a6b76-36b2-43a5-8d34-0e74421f311c None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:21:20.826178 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc1a6b76-36b2-43a5-8d34-0e74421f311c None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:21:20.827045 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc1a6b76-36b2-43a5-8d34-0e74421f311c None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:21:20.827645 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc1a6b76-36b2-43a5-8d34-0e74421f311c None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:21:20.827859 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.base_scheduler [None req-da741bb0-cf6e-48d4-b8da-5a67e1f53dfd admin admin] Resources bound (agent type, host, resource id):  {{(pid=91686) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:21:20.828335 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc1a6b76-36b2-43a5-8d34-0e74421f311c None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:21:20.828942 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc1a6b76-36b2-43a5-8d34-0e74421f311c None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:21:20.829454 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc1a6b76-36b2-43a5-8d34-0e74421f311c None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:21:20.830466 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc1a6b76-36b2-43a5-8d34-0e74421f311c None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:21:20.830979 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc1a6b76-36b2-43a5-8d34-0e74421f311c None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:21:20.831606 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc1a6b76-36b2-43a5-8d34-0e74421f311c None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:21:20.832588 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc1a6b76-36b2-43a5-8d34-0e74421f311c None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:21:20.833101 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc1a6b76-36b2-43a5-8d34-0e74421f311c None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:21:20.835190 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc1a6b76-36b2-43a5-8d34-0e74421f311c None None] Tracked resource versions report:
May 20 04:21:20.835190 dv-cinder-790910-4-iscsi neutron-server[91689]: pushed versions:
May 20 04:21:20.835190 dv-cinder-790910-4-iscsi neutron-server[91689]: {   'AddressGroup': {'1.2'},
May 20 04:21:20.835190 dv-cinder-790910-4-iscsi neutron-server[91689]:     'ConntrackHelper': {'1.0'},
May 20 04:21:20.835190 dv-cinder-790910-4-iscsi neutron-server[91689]:     'Log': {'1.0'},
May 20 04:21:20.835190 dv-cinder-790910-4-iscsi neutron-server[91689]:     'Network': {'1.1'},
May 20 04:21:20.835190 dv-cinder-790910-4-iscsi neutron-server[91689]:     'Port': {'1.7'},
May 20 04:21:20.835190 dv-cinder-790910-4-iscsi neutron-server[91689]:     'PortForwarding': {'1.2'},
May 20 04:21:20.835190 dv-cinder-790910-4-iscsi neutron-server[91689]:     'QosPolicy': {'1.8'},
May 20 04:21:20.835190 dv-cinder-790910-4-iscsi neutron-server[91689]:     'SecurityGroup': {'1.4'},
May 20 04:21:20.835190 dv-cinder-790910-4-iscsi neutron-server[91689]:     'SecurityGroupRule': {'1.2'},
May 20 04:21:20.835190 dv-cinder-790910-4-iscsi neutron-server[91689]:     'SubPort': {'1.0'},
May 20 04:21:20.835190 dv-cinder-790910-4-iscsi neutron-server[91689]:     'Subnet': {'1.1'},
May 20 04:21:20.835190 dv-cinder-790910-4-iscsi neutron-server[91689]:     'Trunk': {'1.1'}}
May 20 04:21:20.835190 dv-cinder-790910-4-iscsi neutron-server[91689]: consumer versions:
May 20 04:21:20.835190 dv-cinder-790910-4-iscsi neutron-server[91689]: {   DHCP agent@dv-cinder-790910-4-iscsi: {},
May 20 04:21:20.835190 dv-cinder-790910-4-iscsi neutron-server[91689]:     HyperV agent@hv-cinder-79091: {},
May 20 04:21:20.835190 dv-cinder-790910-4-iscsi neutron-server[91689]:     L3 agent@dv-cinder-790910-4-iscsi: {},
May 20 04:21:20.835190 dv-cinder-790910-4-iscsi neutron-server[91689]:     Metadata agent@dv-cinder-790910-4-iscsi: {},
May 20 04:21:20.835190 dv-cinder-790910-4-iscsi neutron-server[91689]:     Metering agent@dv-cinder-790910-4-iscsi: {},
May 20 04:21:20.835190 dv-cinder-790910-4-iscsi neutron-server[91689]:     Open vSwitch agent@dv-cinder-790910-4-iscsi: {   'AddressGroup': '1.2',
May 20 04:21:20.835190 dv-cinder-790910-4-iscsi neutron-server[91689]:                                                      'ConntrackHelper': '1.0',
May 20 04:21:20.835190 dv-cinder-790910-4-iscsi neutron-server[91689]:                                                      'Log': '1.0',
May 20 04:21:20.835190 dv-cinder-790910-4-iscsi neutron-server[91689]:                                                      'Network': '1.1',
May 20 04:21:20.835190 dv-cinder-790910-4-iscsi neutron-server[91689]:                                                      'Port': '1.7',
May 20 04:21:20.835190 dv-cinder-790910-4-iscsi neutron-server[91689]:                                                      'PortForwarding': '1.2',
May 20 04:21:20.835190 dv-cinder-790910-4-iscsi neutron-server[91689]:                                                      'QosPolicy': '1.8',
May 20 04:21:20.835190 dv-cinder-790910-4-iscsi neutron-server[91689]:                                                      'SecurityGroup': '1.4',
May 20 04:21:20.835190 dv-cinder-790910-4-iscsi neutron-server[91689]:                                                      'SecurityGroupRule': '1.2',
May 20 04:21:20.835190 dv-cinder-790910-4-iscsi neutron-server[91689]:                                                      'SubPort': '1.0',
May 20 04:21:20.835190 dv-cinder-790910-4-iscsi neutron-server[91689]:                                                      'Subnet': '1.1',
May 20 04:21:20.835190 dv-cinder-790910-4-iscsi neutron-server[91689]:                                                      'Trunk': '1.1'}}
May 20 04:21:20.835190 dv-cinder-790910-4-iscsi neutron-server[91689]:  {{(pid=91689) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
May 20 04:21:20.854652 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG oslo_concurrency.lockutils [None req-dc1a6b76-36b2-43a5-8d34-0e74421f311c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.597s {{(pid=91689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:20.855399 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG oslo_concurrency.lockutils [None req-dc1a6b76-36b2-43a5-8d34-0e74421f311c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:20.856415 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-cc1d182a-cdaa-479f-aeef-23bafbc02eaf None None] Provisioning for port aad390e4-f9e2-4bbe-9e64-7b390cc7f3b3 completed by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:21:20.889646 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.l3_dvrscheduler_db [None req-da741bb0-cf6e-48d4-b8da-5a67e1f53dfd admin admin] Received port after_create {{(pid=91686) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 04:21:20.890552 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-da741bb0-cf6e-48d4-b8da-5a67e1f53dfd admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1716281'] for router_interface, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:20.899606 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-cc1d182a-cdaa-479f-aeef-23bafbc02eaf None None] Provisioning complete for port aad390e4-f9e2-4bbe-9e64-7b390cc7f3b3 triggered by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:21:20.899606 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-cc1d182a-cdaa-479f-aeef-23bafbc02eaf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:21.032747 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2627ae6b-48a2-43a3-95fa-7e75008fcfd9 None None] Routers {'34eeb764-2607-4d9f-96c4-89598b702500'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91689) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:21:21.032747 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-2627ae6b-48a2-43a3-95fa-7e75008fcfd9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced246f5e0>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:21:03Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['34eeb764-2607-4d9f-96c4-89598b702500'], 'active': True} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:21:21.072446 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-fbdced15-c0db-4046-b63a-905c382e7a1d None None] Notify callbacks [] for port, precommit_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:21.135804 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 37c13c83-3c6b-4c47-8428-d4af18562753 up at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:21:21.341503 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-fbdced15-c0db-4046-b63a-905c382e7a1d None None] Transition to ACTIVE for port object a51c67da-478f-4b96-ab49-4cd64c665710 will not be triggered until provisioned by entity L2. {{(pid=91688) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:21:21.345226 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-8f90687d-d247-456e-a20b-287f17db1de2 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8782892092784'] for network, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:21.357392 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-cc1d182a-cdaa-479f-aeef-23bafbc02eaf None None] Port aad390e4-f9e2-4bbe-9e64-7b390cc7f3b3 cannot update to ACTIVE because it is not bound. {{(pid=91688) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 20 04:21:21.371053 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-b2649d32-9948-48d7-9579-158920e7ec5d admin admin] Notify callbacks [] for port, precommit_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:21.375227 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-fbdced15-c0db-4046-b63a-905c382e7a1d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:21.386444 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da741bb0-cf6e-48d4-b8da-5a67e1f53dfd admin admin] Pushing event updated for resources: {'Port': ['ID=a4932092-c8bd-4cf6-88c2-2bbb4eb549b3,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:21.400896 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-da741bb0-cf6e-48d4-b8da-5a67e1f53dfd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.847s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:21.409218 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-c6c8deb6-a49b-4eff-ad77-b0ee2103e5ba None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:21.414312 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc1a6b76-36b2-43a5-8d34-0e74421f311c None None] Pushing event updated for resources: {'Port': ['ID=16508f6e-35a3-4301-9018-78e099969b00,revision_number=3']} {{(pid=91689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:21.428334 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG oslo_concurrency.lockutils [None req-dc1a6b76-36b2-43a5-8d34-0e74421f311c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.572s {{(pid=91689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:21.468391 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-b2649d32-9948-48d7-9579-158920e7ec5d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:21.483711 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-b2649d32-9948-48d7-9579-158920e7ec5d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1781412', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1716318'] for router_interface, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:21.487874 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning complete for port 37c13c83-3c6b-4c47-8428-d4af18562753 triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:21:21.488407 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:21.508032 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-480a1c2a-ccae-48d5-a9a9-d5f217b102d5 req-b18597de-38b4-4ab4-bab7-63a586cd2b46 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/ports?device_id=20a6d6ed-f811-42fd-8b44-ab4c031330e7 HTTP/1.1" status: 200  len: 210 time: 0.2540388
May 20 04:21:21.515787 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-b2649d32-9948-48d7-9579-158920e7ec5d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:21.522925 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-8f90687d-d247-456e-a20b-287f17db1de2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1590664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1781430'] for network, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:21.524718 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8f90687d-d247-456e-a20b-287f17db1de2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:21:21.525548 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-8f90687d-d247-456e-a20b-287f17db1de2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for network, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:21.640866 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-1cc56189-d139-4ba5-896d-89ca32afec74 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:21.663368 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-8f90687d-d247-456e-a20b-287f17db1de2 admin admin] 10.222.0.71 "POST /v2.0/networks HTTP/1.1" status: 201  len: 897 time: 3.5596285
May 20 04:21:21.685940 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 35202) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:21:21.711401 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.v2.base [None req-c3db815f-156d-4cb3-b8cb-a795a2d69a36 admin admin] Request body: {'subnet': {'network_id': '0ce28fd5-15fe-4fee-ac41-386db9383364', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-846800874-subnet', 'tenant_id': 'f19de276d4f943ce8aa2bdc4930890d1', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=91686) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:21:21.732912 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-c3db815f-156d-4cb3-b8cb-a795a2d69a36 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:21:21.934393 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2649d32-9948-48d7-9579-158920e7ec5d admin admin] Pushing event updated for resources: {'Port': ['ID=aad390e4-f9e2-4bbe-9e64-7b390cc7f3b3,revision_number=2']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:21.956028 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-b2649d32-9948-48d7-9579-158920e7ec5d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.441s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:21.983240 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61ab26c4-7772-49e5-8a6f-a6c36e2b71a8 None None] Pushing event updated for resources: {'Port': ['ID=a51c67da-478f-4b96-ab49-4cd64c665710,revision_number=2']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:21.986203 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-c3db815f-156d-4cb3-b8cb-a795a2d69a36 admin admin] Usage tracker for resource:subnet and tenant:f19de276d4f943ce8aa2bdc4930890d1 is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:21:22.003753 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.82', 55074) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:21:22.005455 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvr_db [None req-2627ae6b-48a2-43a3-95fa-7e75008fcfd9 None None] Set router 34eeb764-2607-4d9f-96c4-89598b702500 gateway port host: dv-cinder-790910-4-iscsi {{(pid=91689) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:21:22.017264 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.managers [None req-fbdced15-c0db-4046-b63a-905c382e7a1d None None] Attempting to bind port a51c67da-478f-4b96-ab49-4cd64c665710 on host dv-cinder-790910-4-iscsi for vnic_type normal with profile  {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 04:21:22.019265 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-c3db815f-156d-4cb3-b8cb-a795a2d69a36 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:21:22.022000 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.managers [None req-fbdced15-c0db-4046-b63a-905c382e7a1d None None] Attempting to bind port a51c67da-478f-4b96-ab49-4cd64c665710 by drivers openvswitch,hyperv on host dv-cinder-790910-4-iscsi at level 0 using segments [{'id': '8df49ec5-3fb9-4715-bc9a-f4019a6b55f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90'}] {{(pid=91688) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 04:21:22.025506 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fbdced15-c0db-4046-b63a-905c382e7a1d None None] Attempting to bind port a51c67da-478f-4b96-ab49-4cd64c665710 on network aec557db-0c02-4008-8c9f-2efcd7462f90 {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:21:22.046033 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-61ab26c4-7772-49e5-8a6f-a6c36e2b71a8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.637s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:22.055312 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-c3db815f-156d-4cb3-b8cb-a795a2d69a36 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:21:22.063355 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fbdced15-c0db-4046-b63a-905c382e7a1d None None] Checking agent: {'id': '333121d4-1023-4a33-a54c-f4dd052e1612', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-790910-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 4, 13, 33), 'started_at': datetime.datetime(2021, 5, 20, 4, 14, 3), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 4, 21, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-790910-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 04:21:22.064000 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fbdced15-c0db-4046-b63a-905c382e7a1d None None] Checking segment: {'id': '8df49ec5-3fb9-4715-bc9a-f4019a6b55f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91688) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:21:22.064647 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-fbdced15-c0db-4046-b63a-905c382e7a1d None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:22.065356 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fbdced15-c0db-4046-b63a-905c382e7a1d None None] Bound using segment: {'id': '8df49ec5-3fb9-4715-bc9a-f4019a6b55f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90'} {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 04:21:22.066707 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.managers [None req-fbdced15-c0db-4046-b63a-905c382e7a1d None None] Bound port: a51c67da-478f-4b96-ab49-4cd64c665710, host: dv-cinder-790910-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8df49ec5-3fb9-4715-bc9a-f4019a6b55f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90'}}] {{(pid=91688) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 04:21:22.067326 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-fbdced15-c0db-4046-b63a-905c382e7a1d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:22.068799 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f90687d-d247-456e-a20b-287f17db1de2 admin admin] Pushing event updated for resources: {'Network': ['ID=0ce28fd5-15fe-4fee-ac41-386db9383364,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:22.088138 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-8f90687d-d247-456e-a20b-287f17db1de2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.447s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:22.139350 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c3db815f-156d-4cb3-b8cb-a795a2d69a36 admin admin] Made reservation on behalf of f19de276d4f943ce8aa2bdc4930890d1 for: {'subnet': 1} {{(pid=91686) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 04:21:22.153795 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-c3db815f-156d-4cb3-b8cb-a795a2d69a36 admin admin] Notify callbacks [] for subnet, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:22.171153 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b2649d32-9948-48d7-9579-158920e7ec5d admin admin] Network 21794e86-fda7-40a6-a5a8-db117c7eeb9d is already hosted by enough agents. {{(pid=91687) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:21:22.222785 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.base_scheduler [None req-b2649d32-9948-48d7-9579-158920e7ec5d admin admin] Resources bound (agent type, host, resource id):  {{(pid=91687) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:21:22.302566 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-fbdced15-c0db-4046-b63a-905c382e7a1d None None] For port a51c67da-478f-4b96-ab49-4cd64c665710, host dv-cinder-790910-4-iscsi, cleared binding levels {{(pid=91688) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 04:21:22.311847 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-fbdced15-c0db-4046-b63a-905c382e7a1d None None] For port a51c67da-478f-4b96-ab49-4cd64c665710, host dv-cinder-790910-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=a51c67da-478f-4b96-ab49-4cd64c665710,segment=NetworkSegment(8df49ec5-3fb9-4715-bc9a-f4019a6b55f9),segment_id=8df49ec5-3fb9-4715-bc9a-f4019a6b55f9)] {{(pid=91688) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 04:21:22.320670 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Network 0ce28fd5-15fe-4fee-ac41-386db9383364 details requested by agent ovs-agent-dv-cinder-790910-4-iscsi with host dv-cinder-790910-4-iscsi {{(pid=91688) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 20 04:21:22.385461 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 35216) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:21:22.391719 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-fbdced15-c0db-4046-b63a-905c382e7a1d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:22.438161 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a29b5ab6-2541-493f-a266-5f2fd459002a req-51e572af-17b9-403b-b564-12c1c3b82715 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:21:22.441305 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a29b5ab6-2541-493f-a266-5f2fd459002a req-51e572af-17b9-403b-b564-12c1c3b82715 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.82 "GET /v2.0/networks?id=4100b38a-1db4-4a6e-9c33-7bcf19c64d59 HTTP/1.1" status: 200  len: 812 time: 0.4342790
May 20 04:21:22.482419 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:22.532856 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [req-a29b5ab6-2541-493f-a266-5f2fd459002a req-22ef3c6e-af85-4ddf-bb7f-2c17e97927bf tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Request body: {'port': {'device_id': '20a6d6ed-f811-42fd-8b44-ab4c031330e7', 'network_id': '4100b38a-1db4-4a6e-9c33-7bcf19c64d59', 'admin_state_up': True, 'tenant_id': 'b6214ee7a3fe4823b9db71f53439835e'}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:21:22.810869 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 35222) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:21:22.838145 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [req-a29b5ab6-2541-493f-a266-5f2fd459002a req-22ef3c6e-af85-4ddf-bb7f-2c17e97927bf tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:21:22.942369 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-89dcd106-c2fe-49ae-bb5e-6461e3b498cd None None] Provisioning complete for port aad390e4-f9e2-4bbe-9e64-7b390cc7f3b3 triggered by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:21:22.943161 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-89dcd106-c2fe-49ae-bb5e-6461e3b498cd None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:23.004108 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b2649d32-9948-48d7-9579-158920e7ec5d admin admin] Router 34eeb764-2607-4d9f-96c4-89598b702500 has already been hosted by L3 agent 02733fc0-fc9c-4e29-bc03-c27a792d539d {{(pid=91687) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 04:21:23.011587 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-a29b5ab6-2541-493f-a266-5f2fd459002a req-22ef3c6e-af85-4ddf-bb7f-2c17e97927bf tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Usage tracker for resource:port and tenant:b6214ee7a3fe4823b9db71f53439835e is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:21:23.022821 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-a29b5ab6-2541-493f-a266-5f2fd459002a req-22ef3c6e-af85-4ddf-bb7f-2c17e97927bf tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Quota usage for port was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:21:23.044444 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [req-a29b5ab6-2541-493f-a266-5f2fd459002a req-22ef3c6e-af85-4ddf-bb7f-2c17e97927bf tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:21:23.051767 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-89dcd106-c2fe-49ae-bb5e-6461e3b498cd None None] Port aad390e4-f9e2-4bbe-9e64-7b390cc7f3b3 cannot update to ACTIVE because it is not bound. {{(pid=91688) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 20 04:21:23.069593 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fbdced15-c0db-4046-b63a-905c382e7a1d None None] Routers {'4ec3fa08-f3da-44bd-bf6b-4feab27e9b78'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91688) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:21:23.073160 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-fbdced15-c0db-4046-b63a-905c382e7a1d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced1b4de50>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:21:03Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['4ec3fa08-f3da-44bd-bf6b-4feab27e9b78'], 'active': True} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:21:23.162474 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-a29b5ab6-2541-493f-a266-5f2fd459002a req-22ef3c6e-af85-4ddf-bb7f-2c17e97927bf tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Made reservation on behalf of b6214ee7a3fe4823b9db71f53439835e for: {'port': 1} {{(pid=91687) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 04:21:23.169160 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-a29b5ab6-2541-493f-a266-5f2fd459002a req-22ef3c6e-af85-4ddf-bb7f-2c17e97927bf tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:23.202616 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-86d3114d-8ad3-4980-a2dc-8bf3a3469b6b admin admin] Notify callbacks [] for security_group, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:23.322735 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvr_db [None req-fbdced15-c0db-4046-b63a-905c382e7a1d None None] Set router 4ec3fa08-f3da-44bd-bf6b-4feab27e9b78 gateway port host: dv-cinder-790910-4-iscsi {{(pid=91688) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:21:23.496601 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-86d3114d-8ad3-4980-a2dc-8bf3a3469b6b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:21:23.531446 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-58f68fc4-610b-4305-b809-6b3f044d756f admin admin] Notify callbacks [] for security_group, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:23.545602 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-86d3114d-8ad3-4980-a2dc-8bf3a3469b6b admin admin] Usage tracker for resource:security_group_rule and tenant:2eb394ab14174b9c9e4a07242551388c is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:21:23.556327 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-58f68fc4-610b-4305-b809-6b3f044d756f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:21:23.572389 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-58f68fc4-610b-4305-b809-6b3f044d756f admin admin] Usage tracker for resource:security_group_rule and tenant:f53661468941456b9c69eebb664a401a is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:21:23.576597 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-58f68fc4-610b-4305-b809-6b3f044d756f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:21:23.584877 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-58f68fc4-610b-4305-b809-6b3f044d756f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:21:23.685008 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-58f68fc4-610b-4305-b809-6b3f044d756f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:23.689605 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-86d3114d-8ad3-4980-a2dc-8bf3a3469b6b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:21:23.704907 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61ab26c4-7772-49e5-8a6f-a6c36e2b71a8 None None] Pushing event updated for resources: {'Port': ['ID=a51c67da-478f-4b96-ab49-4cd64c665710,revision_number=3']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:23.727035 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-61ab26c4-7772-49e5-8a6f-a6c36e2b71a8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 1.244s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:23.737204 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-58f68fc4-610b-4305-b809-6b3f044d756f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:23.737777 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-2627ae6b-48a2-43a3-95fa-7e75008fcfd9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced246f5e0>, [{'id': '34eeb764-2607-4d9f-96c4-89598b702500', 'name': 'tempest-AttachVolumeShelveTestJSON-1895235554-router', 'tenant_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.72'}], 'enable_snat': True}, 'gw_port_id': '16508f6e-35a3-4301-9018-78e099969b00', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:21:10Z', 'updated_at': '2021-05-20T04:21:20Z', 'revision_number': 4, 'project_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'gw_port': {'id': '16508f6e-35a3-4301-9018-78e099969b00', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:e3:82', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '34eeb764-2607-4d9f-96c4-89598b702500', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:21:12Z', 'updated_at': '2021-05-20T04:21:20Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_interfaces': [{'id': 'aad390e4-f9e2-4bbe-9e64-7b390cc7f3b3', 'name': '', 'network_id': '21794e86-fda7-40a6-a5a8-db117c7eeb9d', 'tenant_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'mac_address': 'fa:16:3e:b2:b9:f0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '34eeb764-2607-4d9f-96c4-89598b702500', 'device_owner': 'network:router_interface', 'standard_attr_id': 88, 'fixed_ips': [{'subnet_id': '06f38702-3d3c-4e25-8f84-85483d1ddf28', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:21:18Z', 'updated_at': '2021-05-20T04:21:19Z', 'revision_number': 1, 'project_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'subnets': [{'id': '06f38702-3d3c-4e25-8f84-85483d1ddf28', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:21:23.752983 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2627ae6b-48a2-43a3-95fa-7e75008fcfd9 None None] The sync data for ids ['34eeb764-2607-4d9f-96c4-89598b702500'] in dv-cinder-790910-4-iscsi is: [{'id': '34eeb764-2607-4d9f-96c4-89598b702500', 'name': 'tempest-AttachVolumeShelveTestJSON-1895235554-router', 'tenant_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.72'}], 'enable_snat': True}, 'gw_port_id': '16508f6e-35a3-4301-9018-78e099969b00', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:21:10Z', 'updated_at': '2021-05-20T04:21:20Z', 'revision_number': 4, 'project_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'gw_port': {'id': '16508f6e-35a3-4301-9018-78e099969b00', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:e3:82', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '34eeb764-2607-4d9f-96c4-89598b702500', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:21:12Z', 'updated_at': '2021-05-20T04:21:20Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_interfaces': [{'id': 'aad390e4-f9e2-4bbe-9e64-7b390cc7f3b3', 'name': '', 'network_id': '21794e86-fda7-40a6-a5a8-db117c7eeb9d', 'tenant_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'mac_address': 'fa:16:3e:b2:b9:f0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '34eeb764-2607-4d9f-96c4-89598b702500', 'device_owner': 'network:router_interface', 'standard_attr_id': 88, 'fixed_ips': [{'subnet_id': '06f38702-3d3c-4e25-8f84-85483d1ddf28', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:21:18Z', 'updated_at': '2021-05-20T04:21:19Z', 'revision_number': 1, 'project_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'subnets': [{'id': '06f38702-3d3c-4e25-8f84-85483d1ddf28', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91689) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 04:21:23.861077 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-86d3114d-8ad3-4980-a2dc-8bf3a3469b6b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:21:23.943663 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-7420fe1a-ea76-41b4-84ef-ae1b9bda1701 req-1df3b2ad-2ff6-4e5d-8d72-a7c724e37db9 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/ports?device_id=20a6d6ed-f811-42fd-8b44-ab4c031330e7 HTTP/1.1" status: 200  len: 210 time: 0.4167757
May 20 04:21:24.026295 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-da741bb0-cf6e-48d4-b8da-5a67e1f53dfd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:24.272155 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-1160709a-ea08-4499-938a-151e538c5c0b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:24.325039 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-fbdced15-c0db-4046-b63a-905c382e7a1d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced1b4de50>, [{'id': '4ec3fa08-f3da-44bd-bf6b-4feab27e9b78', 'name': 'tempest-ServerRescueNegativeTestJSON-2060961621-router', 'tenant_id': 'b7d86d894a5f420e86f4c28d7772bd22', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.34'}], 'enable_snat': True}, 'gw_port_id': 'a51c67da-478f-4b96-ab49-4cd64c665710', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:21:09Z', 'updated_at': '2021-05-20T04:21:22Z', 'revision_number': 4, 'project_id': 'b7d86d894a5f420e86f4c28d7772bd22', 'gw_port': {'id': 'a51c67da-478f-4b96-ab49-4cd64c665710', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:d9:31:98', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4ec3fa08-f3da-44bd-bf6b-4feab27e9b78', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.34', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:21:12Z', 'updated_at': '2021-05-20T04:21:22Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_interfaces': [{'id': 'a4932092-c8bd-4cf6-88c2-2bbb4eb549b3', 'name': '', 'network_id': '348b2b0f-c826-45ab-ba85-8430235b9cac', 'tenant_id': 'b7d86d894a5f420e86f4c28d7772bd22', 'mac_address': 'fa:16:3e:20:99:67', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4ec3fa08-f3da-44bd-bf6b-4feab27e9b78', 'device_owner': 'network:router_interface', 'standard_attr_id': 94, 'fixed_ips': [{'subnet_id': 'b488dc7d-0e70-4e52-9179-7e6c3e4fb0a1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:21:19Z', 'updated_at': '2021-05-20T04:21:19Z', 'revision_number': 1, 'project_id': 'b7d86d894a5f420e86f4c28d7772bd22', 'subnets': [{'id': 'b488dc7d-0e70-4e52-9179-7e6c3e4fb0a1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:21:24.335936 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fbdced15-c0db-4046-b63a-905c382e7a1d None None] The sync data for ids ['4ec3fa08-f3da-44bd-bf6b-4feab27e9b78'] in dv-cinder-790910-4-iscsi is: [{'id': '4ec3fa08-f3da-44bd-bf6b-4feab27e9b78', 'name': 'tempest-ServerRescueNegativeTestJSON-2060961621-router', 'tenant_id': 'b7d86d894a5f420e86f4c28d7772bd22', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.34'}], 'enable_snat': True}, 'gw_port_id': 'a51c67da-478f-4b96-ab49-4cd64c665710', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:21:09Z', 'updated_at': '2021-05-20T04:21:22Z', 'revision_number': 4, 'project_id': 'b7d86d894a5f420e86f4c28d7772bd22', 'gw_port': {'id': 'a51c67da-478f-4b96-ab49-4cd64c665710', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:d9:31:98', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4ec3fa08-f3da-44bd-bf6b-4feab27e9b78', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.34', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:21:12Z', 'updated_at': '2021-05-20T04:21:22Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_interfaces': [{'id': 'a4932092-c8bd-4cf6-88c2-2bbb4eb549b3', 'name': '', 'network_id': '348b2b0f-c826-45ab-ba85-8430235b9cac', 'tenant_id': 'b7d86d894a5f420e86f4c28d7772bd22', 'mac_address': 'fa:16:3e:20:99:67', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4ec3fa08-f3da-44bd-bf6b-4feab27e9b78', 'device_owner': 'network:router_interface', 'standard_attr_id': 94, 'fixed_ips': [{'subnet_id': 'b488dc7d-0e70-4e52-9179-7e6c3e4fb0a1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:21:19Z', 'updated_at': '2021-05-20T04:21:19Z', 'revision_number': 1, 'project_id': 'b7d86d894a5f420e86f4c28d7772bd22', 'subnets': [{'id': 'b488dc7d-0e70-4e52-9179-7e6c3e4fb0a1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91688) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 04:21:24.341787 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58f68fc4-610b-4305-b809-6b3f044d756f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1f791abd-f0c7-4298-80ae-e27ed235caac,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:24.436514 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-58f68fc4-610b-4305-b809-6b3f044d756f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.164s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:24.518725 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.db_base_plugin_common [req-a29b5ab6-2541-493f-a266-5f2fd459002a req-22ef3c6e-af85-4ddf-bb7f-2c17e97927bf tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Allocated IP 172.20.0.5 (4100b38a-1db4-4a6e-9c33-7bcf19c64d59/88b525de-7494-46b7-a333-32b76e112ad7/49f0e77b-6589-4f2f-9f47-7eb071a38ce6) {{(pid=91687) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 04:21:24.587106 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-58f68fc4-610b-4305-b809-6b3f044d756f admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=f53661468941456b9c69eebb664a401a&name=default HTTP/1.1" status: 200  len: 2979 time: 1.7501903
May 20 04:21:24.590748 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 35292) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:21:24.599464 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b2649d32-9948-48d7-9579-158920e7ec5d admin admin] Notify agent at l3_agent.dv-cinder-790910-4-iscsi the message routers_updated {{(pid=91687) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 04:21:25.018466 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 35300) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:21:25.021372 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.db.resource_extend [None req-da741bb0-cf6e-48d4-b8da-5a67e1f53dfd admin admin] It took 0.19 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=91686) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}}
May 20 04:21:25.179405 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-a29b5ab6-2541-493f-a266-5f2fd459002a req-22ef3c6e-af85-4ddf-bb7f-2c17e97927bf tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Notify callbacks [] for port, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:25.197817 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-da741bb0-cf6e-48d4-b8da-5a67e1f53dfd admin admin] Notify callbacks [] for port, precommit_update {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:25.236141 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-a29b5ab6-2541-493f-a266-5f2fd459002a req-22ef3c6e-af85-4ddf-bb7f-2c17e97927bf tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8782892106231'] for port, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:25.269351 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-da741bb0-cf6e-48d4-b8da-5a67e1f53dfd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:25.276869 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-b2649d32-9948-48d7-9579-158920e7ec5d admin admin] 10.222.0.71 "PUT /v2.0/routers/34eeb764-2607-4d9f-96c4-89598b702500/add_router_interface HTTP/1.1" status: 200  len: 503 time: 8.4687877
May 20 04:21:25.300162 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-da741bb0-cf6e-48d4-b8da-5a67e1f53dfd admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1781412', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1716318'] for router_interface, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:25.303175 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-b2649d32-9948-48d7-9579-158920e7ec5d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:25.342996 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-bdd5281c-3df1-43f6-ba47-0410b7ae1203 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:25.488514 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-bdd5281c-3df1-43f6-ba47-0410b7ae1203 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:25.515903 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-a29b5ab6-2541-493f-a266-5f2fd459002a req-22ef3c6e-af85-4ddf-bb7f-2c17e97927bf tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Network 4100b38a-1db4-4a6e-9c33-7bcf19c64d59 is already hosted by enough agents. {{(pid=91687) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:21:25.578971 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.base_scheduler [req-a29b5ab6-2541-493f-a266-5f2fd459002a req-22ef3c6e-af85-4ddf-bb7f-2c17e97927bf tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Resources bound (agent type, host, resource id):  {{(pid=91687) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:21:25.638653 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-6add0f19-9a5f-4ec0-989e-ed338dc52cec admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:25.842185 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 16508f6e-35a3-4301-9018-78e099969b00 up at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:21:25.941426 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22ef3c6e-af85-4ddf-bb7f-2c17e97927bf tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Pushing event updated for resources: {'Port': ['ID=49f0e77b-6589-4f2f-9f47-7eb071a38ce6,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:25.994306 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.l3_dvrscheduler_db [req-a29b5ab6-2541-493f-a266-5f2fd459002a req-22ef3c6e-af85-4ddf-bb7f-2c17e97927bf tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Received port after_create {{(pid=91687) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 04:21:26.008437 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a29b5ab6-2541-493f-a266-5f2fd459002a req-22ef3c6e-af85-4ddf-bb7f-2c17e97927bf tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:21:26.019759 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-a29b5ab6-2541-493f-a266-5f2fd459002a req-22ef3c6e-af85-4ddf-bb7f-2c17e97927bf tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for port, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:26.137399 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning for port 16508f6e-35a3-4301-9018-78e099969b00 completed by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:21:26.151589 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning complete for port 16508f6e-35a3-4301-9018-78e099969b00 triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:21:26.154333 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:26.185290 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-86d3114d-8ad3-4980-a2dc-8bf3a3469b6b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:26.204416 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-22ef3c6e-af85-4ddf-bb7f-2c17e97927bf tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.901s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:26.239537 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6846674-efe2-483a-b32a-2661606e69d9 req-997e1027-3229-40f0-9699-27eee8990038 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:21:26.241481 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-b6846674-efe2-483a-b32a-2661606e69d9 req-997e1027-3229-40f0-9699-27eee8990038 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Synchronizing usage tracker for tenant:b6214ee7a3fe4823b9db71f53439835e on resource:port {{(pid=91687) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:21:26.251758 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-86d3114d-8ad3-4980-a2dc-8bf3a3469b6b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:26.252166 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-bdd5281c-3df1-43f6-ba47-0410b7ae1203 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:26.345779 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-2e0cadfd-ff2f-4864-9839-056543d095ae admin admin] Notify callbacks [] for security_group, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:26.369001 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-c3db815f-156d-4cb3-b8cb-a795a2d69a36 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-255887', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377'] for subnet, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:26.371355 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da741bb0-cf6e-48d4-b8da-5a67e1f53dfd admin admin] Pushing event updated for resources: {'Port': ['ID=a4932092-c8bd-4cf6-88c2-2bbb4eb549b3,revision_number=2']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:26.372257 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a29b5ab6-2541-493f-a266-5f2fd459002a req-22ef3c6e-af85-4ddf-bb7f-2c17e97927bf tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 3.8491435
May 20 04:21:26.374887 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-f34547a0-6513-4014-bf7d-1a0699e21e60 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:26.403250 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-da741bb0-cf6e-48d4-b8da-5a67e1f53dfd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.763s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:26.516349 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-86d3114d-8ad3-4980-a2dc-8bf3a3469b6b admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=2eb394ab14174b9c9e4a07242551388c&name=default HTTP/1.1" status: 200  len: 2979 time: 4.1287100
May 20 04:21:26.540432 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [req-a29b5ab6-2541-493f-a266-5f2fd459002a req-467a109d-fe8d-4999-8b7d-3a356ef5adeb tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] http://10.222.0.71:9696/v2.0/extensions returned with HTTP 200 {{(pid=91687) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 20 04:21:26.542725 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a29b5ab6-2541-493f-a266-5f2fd459002a req-467a109d-fe8d-4999-8b7d-3a356ef5adeb tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0242689
May 20 04:21:26.544236 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-e2d83481-aeba-4790-99de-07e5203a928e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.144s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:26.544411 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86d3114d-8ad3-4980-a2dc-8bf3a3469b6b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ce1cfce1-1a98-48cc-9f69-a5920c5f7632,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:26.563181 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-86d3114d-8ad3-4980-a2dc-8bf3a3469b6b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.189s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:26.567572 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-b6846674-efe2-483a-b32a-2661606e69d9 req-997e1027-3229-40f0-9699-27eee8990038 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Unset dirty status for tenant:b6214ee7a3fe4823b9db71f53439835e on resource:port {{(pid=91687) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:21:26.571011 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-b6846674-efe2-483a-b32a-2661606e69d9 req-997e1027-3229-40f0-9699-27eee8990038 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/ports?device_id=20a6d6ed-f811-42fd-8b44-ab4c031330e7 HTTP/1.1" status: 200  len: 931 time: 1.0923536
May 20 04:21:26.576083 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 35318) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:21:26.618367 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:26.653610 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-2e0cadfd-ff2f-4864-9839-056543d095ae admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:21:26.667704 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bdd5281c-3df1-43f6-ba47-0410b7ae1203 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1f791abd-f0c7-4298-80ae-e27ed235caac,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:26.684446 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-bdd5281c-3df1-43f6-ba47-0410b7ae1203 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.140s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:26.685295 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-d668b76c-5591-432e-b4be-31fe01b20f5c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.090s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:26.744821 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] For port 16508f6e-35a3-4301-9018-78e099969b00, host dv-cinder-790910-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=16508f6e-35a3-4301-9018-78e099969b00,segment=NetworkSegment(8df49ec5-3fb9-4715-bc9a-f4019a6b55f9),segment_id=8df49ec5-3fb9-4715-bc9a-f4019a6b55f9)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:21:26.750541 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-2e0cadfd-ff2f-4864-9839-056543d095ae admin admin] Usage tracker for resource:security_group_rule and tenant:30d5115f70ce4a6391654085c2e32cbd is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:21:26.766529 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-2e0cadfd-ff2f-4864-9839-056543d095ae admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:21:26.771261 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:26.779797 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-7e4fef98-0e21-48b0-af46-8ad2d7bf810f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:26.791974 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-2e0cadfd-ff2f-4864-9839-056543d095ae admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:21:26.977626 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-b6846674-efe2-483a-b32a-2661606e69d9 req-292a729c-18bb-4018-afc5-1a8db79c1094 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/security-groups?id=a5479633-0923-4a98-9c22-65615d7859f0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3851666
May 20 04:21:26.999410 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Pushing event updated for resources: {'Port': ['ID=16508f6e-35a3-4301-9018-78e099969b00,revision_number=4']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:27.013994 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.234s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:27.033085 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-2e0cadfd-ff2f-4864-9839-056543d095ae admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:27.055444 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-bdd5281c-3df1-43f6-ba47-0410b7ae1203 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:27.056885 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-bdd5281c-3df1-43f6-ba47-0410b7ae1203 admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/1f791abd-f0c7-4298-80ae-e27ed235caac HTTP/1.1" status: 204  len: 168 time: 2.4651265
May 20 04:21:27.128533 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-2e0cadfd-ff2f-4864-9839-056543d095ae admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:27.172020 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [req-a29b5ab6-2541-493f-a266-5f2fd459002a req-65867a9c-5f82-4e56-9c24-fbca72fa9124 service neutron] Request body: {'port': {'device_id': '20a6d6ed-f811-42fd-8b44-ab4c031330e7', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79091'}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:21:27.320671 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-2e0cadfd-ff2f-4864-9839-056543d095ae admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=30d5115f70ce4a6391654085c2e32cbd&name=default HTTP/1.1" status: 200  len: 2979 time: 2.2125947
May 20 04:21:27.326316 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 35332) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:21:27.336767 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c3db815f-156d-4cb3-b8cb-a795a2d69a36 admin admin] Checking segment: {'id': 'e789589d-281b-437d-a8a9-98ef763c6c9d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 850, 'network_id': '0ce28fd5-15fe-4fee-ac41-386db9383364'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91686) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:21:27.337580 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c3db815f-156d-4cb3-b8cb-a795a2d69a36 admin admin] Network hostable DHCP agents. Network: 0ce28fd5-15fe-4fee-ac41-386db9383364, hostable agents: ['36d27813-c368-4fd7-ae26-0f662e0a96fd'], hosted agents: [] {{(pid=91686) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 20 04:21:27.475394 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c3db815f-156d-4cb3-b8cb-a795a2d69a36 admin admin] Network 0ce28fd5-15fe-4fee-ac41-386db9383364 is scheduled to be hosted by DHCP agent 36d27813-c368-4fd7-ae26-0f662e0a96fd with binding_index 1 {{(pid=91686) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 20 04:21:27.489982 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3db815f-156d-4cb3-b8cb-a795a2d69a36 admin admin] Pushing event updated for resources: {'Subnet': ['ID=cbdd44eb-a446-4546-b003-926012adb1a8,revision_number=0']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:27.506194 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-c3db815f-156d-4cb3-b8cb-a795a2d69a36 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.821s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:27.508774 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.base_scheduler [None req-c3db815f-156d-4cb3-b8cb-a795a2d69a36 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-790910-4-iscsi, 0ce28fd5-15fe-4fee-ac41-386db9383364) {{(pid=91686) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:21:27.530094 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8d9d8a19-726d-485b-b694-b2e1734d1985 None None] Network 0ce28fd5-15fe-4fee-ac41-386db9383364 requested from dv-cinder-790910-4-iscsi {{(pid=91688) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 04:21:27.533479 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-0c33b8b7-e453-49b0-975d-523259f7466b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.213s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:27.541933 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c3db815f-156d-4cb3-b8cb-a795a2d69a36 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:21:27.553899 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-c3db815f-156d-4cb3-b8cb-a795a2d69a36 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for subnet, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:27.605033 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-da741bb0-cf6e-48d4-b8da-5a67e1f53dfd admin admin] Network 348b2b0f-c826-45ab-ba85-8430235b9cac is already hosted by enough agents. {{(pid=91686) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:21:27.639129 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-c3db815f-156d-4cb3-b8cb-a795a2d69a36 admin admin] 10.222.0.71 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 861 time: 5.9472330
May 20 04:21:27.641042 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.base_scheduler [None req-da741bb0-cf6e-48d4-b8da-5a67e1f53dfd admin admin] Resources bound (agent type, host, resource id):  {{(pid=91686) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:21:27.766321 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-a29b5ab6-2541-493f-a266-5f2fd459002a req-65867a9c-5f82-4e56-9c24-fbca72fa9124 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:27.831964 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-cec06234-ad55-40b4-ad57-d17b6c0c4e9b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:28.118761 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-cec06234-ad55-40b4-ad57-d17b6c0c4e9b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:28.249042 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 16508f6e-35a3-4301-9018-78e099969b00 up at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:21:28.356021 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-ead2fbea-7f2a-43f3-82be-9c91e4557460 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:28.418508 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e0cadfd-ff2f-4864-9839-056543d095ae admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0fc22df4-febd-4a8f-9edc-54ba5856e4d1,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:28.421190 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-cec06234-ad55-40b4-ad57-d17b6c0c4e9b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:28.444105 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-2e0cadfd-ff2f-4864-9839-056543d095ae admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.920s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:28.454595 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:28.490148 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-da741bb0-cf6e-48d4-b8da-5a67e1f53dfd admin admin] Router 4ec3fa08-f3da-44bd-bf6b-4feab27e9b78 has already been hosted by L3 agent 02733fc0-fc9c-4e29-bc03-c27a792d539d {{(pid=91686) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 04:21:28.498218 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 35350) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:21:28.525176 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.v2.base [None req-a2e8308e-bc15-42a4-a715-c2f5131d3764 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Request body: {'security_group': {'name': 'tempest-securitygroup--590129347', 'description': 'tempest-description--1949129863'}} {{(pid=91686) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:21:28.564900 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 35356) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:21:28.605106 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-a2e8308e-bc15-42a4-a715-c2f5131d3764 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:21:28.621445 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cec06234-ad55-40b4-ad57-d17b6c0c4e9b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ce1cfce1-1a98-48cc-9f69-a5920c5f7632,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:28.628380 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-cec06234-ad55-40b4-ad57-d17b6c0c4e9b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.174s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:28.651745 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-ead2fbea-7f2a-43f3-82be-9c91e4557460 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:28.772628 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.agents_db [None req-92d61f12-17bc-4bf9-9eab-8a69b8c6da2f None None] Agent healthcheck: found 6 active agents {{(pid=91689) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 04:21:28.805476 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-a2e8308e-bc15-42a4-a715-c2f5131d3764 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Usage tracker for resource:security_group and tenant:ef3bec4745b14484ac8e21cd16cbd11d is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:21:28.818751 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-a2e8308e-bc15-42a4-a715-c2f5131d3764 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:21:29.004663 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning complete for port 16508f6e-35a3-4301-9018-78e099969b00 triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:21:29.006208 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:29.266884 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f052581b-e695-4899-9115-d5504110ac62 None None] Network 0ce28fd5-15fe-4fee-ac41-386db9383364 requested from dv-cinder-790910-4-iscsi {{(pid=91688) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 04:21:29.546586 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-da741bb0-cf6e-48d4-b8da-5a67e1f53dfd admin admin] Notify agent at l3_agent.dv-cinder-790910-4-iscsi the message routers_updated {{(pid=91686) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 04:21:29.550260 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-a2e8308e-bc15-42a4-a715-c2f5131d3764 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:21:29.571045 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b7883dce-b54f-4a26-9c8c-12d3efd59a05 None None] Sync routers for ids ['4ec3fa08-f3da-44bd-bf6b-4feab27e9b78'] in dv-cinder-790910-4-iscsi {{(pid=91689) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 04:21:29.620770 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b7883dce-b54f-4a26-9c8c-12d3efd59a05 None None] Routers {'4ec3fa08-f3da-44bd-bf6b-4feab27e9b78'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91689) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:21:29.622245 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-b7883dce-b54f-4a26-9c8c-12d3efd59a05 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced246fe80>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:21:03Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['4ec3fa08-f3da-44bd-bf6b-4feab27e9b78'], 'active': True} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:21:29.629223 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-da741bb0-cf6e-48d4-b8da-5a67e1f53dfd admin admin] 10.222.0.71 "PUT /v2.0/routers/4ec3fa08-f3da-44bd-bf6b-4feab27e9b78/add_router_interface HTTP/1.1" status: 200  len: 503 time: 12.4062977
May 20 04:21:29.635432 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.db_base_plugin_v2 [None req-8b132c02-8fa5-4fa4-8caf-965e8f1b4386 admin admin] Deleting subnet 8056a6e8-a142-41c5-912d-67dac326144f {{(pid=91687) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 20 04:21:29.641173 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-a2e8308e-bc15-42a4-a715-c2f5131d3764 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks [] for security_group, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:29.666671 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-cec06234-ad55-40b4-ad57-d17b6c0c4e9b admin admin] Notify callbacks [] for security_group, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:29.689861 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-cec06234-ad55-40b4-ad57-d17b6c0c4e9b admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/ce1cfce1-1a98-48cc-9f69-a5920c5f7632 HTTP/1.1" status: 204  len: 168 time: 3.1092718
May 20 04:21:29.742037 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-ead2fbea-7f2a-43f3-82be-9c91e4557460 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:29.768078 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-8b132c02-8fa5-4fa4-8caf-965e8f1b4386 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:29.793506 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:29.836990 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-ead2fbea-7f2a-43f3-82be-9c91e4557460 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:29.848572 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-ead2fbea-7f2a-43f3-82be-9c91e4557460 admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/0fc22df4-febd-4a8f-9edc-54ba5856e4d1 HTTP/1.1" status: 204  len: 168 time: 2.5046160
May 20 04:21:29.910252 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-a2e8308e-bc15-42a4-a715-c2f5131d3764 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:21:29.912240 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device a51c67da-478f-4b96-ab49-4cd64c665710 up at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:21:29.921572 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ead2fbea-7f2a-43f3-82be-9c91e4557460 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0fc22df4-febd-4a8f-9edc-54ba5856e4d1,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:29.926421 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-ead2fbea-7f2a-43f3-82be-9c91e4557460 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.133s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:29.927509 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-a2e8308e-bc15-42a4-a715-c2f5131d3764 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Usage tracker for resource:security_group_rule and tenant:ef3bec4745b14484ac8e21cd16cbd11d is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:21:29.942019 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-a2e8308e-bc15-42a4-a715-c2f5131d3764 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:21:29.950288 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-a2e8308e-bc15-42a4-a715-c2f5131d3764 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:21:30.057743 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-04ef7d34-b12b-4904-bf65-6213ce80bf0f None None] Sync routers for ids ['34eeb764-2607-4d9f-96c4-89598b702500'] in dv-cinder-790910-4-iscsi {{(pid=91688) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 04:21:30.147260 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-a2e8308e-bc15-42a4-a715-c2f5131d3764 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks [] for security_group, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:30.156184 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-a2e8308e-bc15-42a4-a715-c2f5131d3764 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:30.161484 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:30.219278 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-8b132c02-8fa5-4fa4-8caf-965e8f1b4386 admin admin] Notify callbacks [] for subnet, precommit_delete_associations {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:30.236115 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2e8308e-bc15-42a4-a715-c2f5131d3764 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Pushing event updated for resources: {'SecurityGroup': ['ID=4cd34759-6d12-41a3-acb1-798752999d4f,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:30.247608 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-a2e8308e-bc15-42a4-a715-c2f5131d3764 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:30.294303 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74673ea7-7702-4485-863f-a9bcefc158e7 req-0994ca71-f0d8-49f5-914b-e5f2616e2b6f tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:21:30.297112 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-a2e8308e-bc15-42a4-a715-c2f5131d3764 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks [] for security_group, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:30.299191 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-a2e8308e-bc15-42a4-a715-c2f5131d3764 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1779 time: 1.7980843
May 20 04:21:30.301025 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-74673ea7-7702-4485-863f-a9bcefc158e7 req-0994ca71-f0d8-49f5-914b-e5f2616e2b6f tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/ports?device_id=20a6d6ed-f811-42fd-8b44-ab4c031330e7 HTTP/1.1" status: 200  len: 931 time: 1.3668256
May 20 04:21:30.302102 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 35384) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:21:30.307924 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.v2.base [None req-8307489f-28cf-4cbe-832f-46b8cfdb51ab tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Request body: {'security_group_rule': {'security_group_id': '4cd34759-6d12-41a3-acb1-798752999d4f', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=91686) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:21:30.313717 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-8b132c02-8fa5-4fa4-8caf-965e8f1b4386 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1504133'] for subnet, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:30.321975 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-8307489f-28cf-4cbe-832f-46b8cfdb51ab tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:21:30.338852 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-8307489f-28cf-4cbe-832f-46b8cfdb51ab tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Usage tracker for resource:security_group_rule and tenant:ef3bec4745b14484ac8e21cd16cbd11d is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:21:30.342925 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-8307489f-28cf-4cbe-832f-46b8cfdb51ab tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:21:30.386357 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-8307489f-28cf-4cbe-832f-46b8cfdb51ab tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:21:30.402445 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-8307489f-28cf-4cbe-832f-46b8cfdb51ab tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:30.520472 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvr_db [None req-b7883dce-b54f-4a26-9c8c-12d3efd59a05 None None] Set router 4ec3fa08-f3da-44bd-bf6b-4feab27e9b78 gateway port host: dv-cinder-790910-4-iscsi {{(pid=91689) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:21:30.567187 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-8307489f-28cf-4cbe-832f-46b8cfdb51ab tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:30.580770 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-8307489f-28cf-4cbe-832f-46b8cfdb51ab tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1597377'] for security_group_rule, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:30.584438 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:30.638364 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8307489f-28cf-4cbe-832f-46b8cfdb51ab tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2643d368-2cdf-4e5d-84bc-87f06bf81355,revision_number=0']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:30.651942 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-8307489f-28cf-4cbe-832f-46b8cfdb51ab tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.066s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:30.701107 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-8307489f-28cf-4cbe-832f-46b8cfdb51ab tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:30.703702 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-8307489f-28cf-4cbe-832f-46b8cfdb51ab tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.3998294
May 20 04:21:30.707230 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 35392) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:21:30.743543 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.v2.base [None req-429e9f6c-de23-41bc-9802-fd61d223990c tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Request body: {'security_group_rule': {'security_group_id': '4cd34759-6d12-41a3-acb1-798752999d4f', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=91686) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:21:30.780227 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-429e9f6c-de23-41bc-9802-fd61d223990c tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:21:30.796856 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-429e9f6c-de23-41bc-9802-fd61d223990c tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Usage tracker for resource:security_group_rule and tenant:ef3bec4745b14484ac8e21cd16cbd11d is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:21:30.808536 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-429e9f6c-de23-41bc-9802-fd61d223990c tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:21:30.829539 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-429e9f6c-de23-41bc-9802-fd61d223990c tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:21:30.841459 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-04ef7d34-b12b-4904-bf65-6213ce80bf0f None None] Routers {'34eeb764-2607-4d9f-96c4-89598b702500'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91688) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:21:30.842683 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-04ef7d34-b12b-4904-bf65-6213ce80bf0f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced1787b80>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:21:03Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['34eeb764-2607-4d9f-96c4-89598b702500'], 'active': True} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:21:30.901974 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-429e9f6c-de23-41bc-9802-fd61d223990c tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:30.918056 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-74673ea7-7702-4485-863f-a9bcefc158e7 req-9304526d-3da1-40ac-b7e2-795d0c4e01fa tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/security-groups?id=a5479633-0923-4a98-9c22-65615d7859f0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.5435064
May 20 04:21:30.960669 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.db.resource_extend [req-a29b5ab6-2541-493f-a266-5f2fd459002a req-65867a9c-5f82-4e56-9c24-fbca72fa9124 service neutron] It took 0.48 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=91687) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}}
May 20 04:21:31.131674 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-429e9f6c-de23-41bc-9802-fd61d223990c tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:31.144314 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-429e9f6c-de23-41bc-9802-fd61d223990c tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1597377'] for security_group_rule, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:31.146890 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:31.157361 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-0217f3a0-dd64-4c41-9a36-83d53462289d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:31.244360 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-429e9f6c-de23-41bc-9802-fd61d223990c tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7352ec3c-c66b-463d-adf3-7e9ee9b01610,revision_number=0']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:31.267649 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-429e9f6c-de23-41bc-9802-fd61d223990c tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:31.376807 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-429e9f6c-de23-41bc-9802-fd61d223990c tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:31.385988 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-429e9f6c-de23-41bc-9802-fd61d223990c tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.6724350
May 20 04:21:31.387285 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 35408) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:21:31.431290 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.v2.base [None req-9e95cf86-6b6b-4903-bd41-b6946cacf5a5 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Request body: {'floatingip': {'floating_network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90'}} {{(pid=91686) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:21:31.490336 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-8b132c02-8fa5-4fa4-8caf-965e8f1b4386 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1504178', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-255887', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377'] for subnet, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:31.492565 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-9e95cf86-6b6b-4903-bd41-b6946cacf5a5 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:21:31.527692 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-9e95cf86-6b6b-4903-bd41-b6946cacf5a5 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Usage tracker for resource:floatingip and tenant:ef3bec4745b14484ac8e21cd16cbd11d is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:21:31.548399 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-9e95cf86-6b6b-4903-bd41-b6946cacf5a5 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:21:31.595913 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-9e95cf86-6b6b-4903-bd41-b6946cacf5a5 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:21:31.597454 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-8c6a0267-5110-4ac4-85d2-5930cf2ed9de admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:31.637368 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning for port a51c67da-478f-4b96-ab49-4cd64c665710 completed by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:21:31.654833 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning complete for port a51c67da-478f-4b96-ab49-4cd64c665710 triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:21:31.655167 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:31.678778 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-9e95cf86-6b6b-4903-bd41-b6946cacf5a5 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks [] for floatingip, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:31.730057 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-8b132c02-8fa5-4fa4-8caf-965e8f1b4386 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for subnet, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:31.809742 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvr_db [None req-04ef7d34-b12b-4904-bf65-6213ce80bf0f None None] Set router 34eeb764-2607-4d9f-96c4-89598b702500 gateway port host: dv-cinder-790910-4-iscsi {{(pid=91688) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:21:31.856947 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.notifiers.nova [req-a29b5ab6-2541-493f-a266-5f2fd459002a req-65867a9c-5f82-4e56-9c24-fbca72fa9124 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 49f0e77b-6589-4f2f-9f47-7eb071a38ce6 {{(pid=91687) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 04:21:32.224729 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-8b132c02-8fa5-4fa4-8caf-965e8f1b4386 admin admin] 10.222.0.71 "DELETE /v2.0/subnets/8056a6e8-a142-41c5-912d-67dac326144f HTTP/1.1" status: 204  len: 168 time: 3.6551712
May 20 04:21:32.228682 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b132c02-8fa5-4fa4-8caf-965e8f1b4386 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=8056a6e8-a142-41c5-912d-67dac326144f,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:32.232632 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 35426) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:21:32.246466 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-8b132c02-8fa5-4fa4-8caf-965e8f1b4386 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.650s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:32.248735 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-a29b5ab6-2541-493f-a266-5f2fd459002a req-65867a9c-5f82-4e56-9c24-fbca72fa9124 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:32.299565 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.provisioning_blocks [req-a29b5ab6-2541-493f-a266-5f2fd459002a req-65867a9c-5f82-4e56-9c24-fbca72fa9124 service neutron] Transition to ACTIVE for port object 49f0e77b-6589-4f2f-9f47-7eb071a38ce6 will not be triggered until provisioned by entity L2. {{(pid=91687) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:21:32.313569 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-a29b5ab6-2541-493f-a266-5f2fd459002a req-65867a9c-5f82-4e56-9c24-fbca72fa9124 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:32.321494 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-2153d097-ea28-4280-b639-7c93adfa12b7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:32.370968 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-b7883dce-b54f-4a26-9c8c-12d3efd59a05 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced246fe80>, [{'id': '4ec3fa08-f3da-44bd-bf6b-4feab27e9b78', 'name': 'tempest-ServerRescueNegativeTestJSON-2060961621-router', 'tenant_id': 'b7d86d894a5f420e86f4c28d7772bd22', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.34'}], 'enable_snat': True}, 'gw_port_id': 'a51c67da-478f-4b96-ab49-4cd64c665710', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:21:09Z', 'updated_at': '2021-05-20T04:21:22Z', 'revision_number': 4, 'project_id': 'b7d86d894a5f420e86f4c28d7772bd22', 'gw_port': {'id': 'a51c67da-478f-4b96-ab49-4cd64c665710', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:d9:31:98', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4ec3fa08-f3da-44bd-bf6b-4feab27e9b78', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.34', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:21:12Z', 'updated_at': '2021-05-20T04:21:22Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_interfaces': [{'id': 'a4932092-c8bd-4cf6-88c2-2bbb4eb549b3', 'name': '', 'network_id': '348b2b0f-c826-45ab-ba85-8430235b9cac', 'tenant_id': 'b7d86d894a5f420e86f4c28d7772bd22', 'mac_address': 'fa:16:3e:20:99:67', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4ec3fa08-f3da-44bd-bf6b-4feab27e9b78', 'device_owner': 'network:router_interface', 'standard_attr_id': 94, 'fixed_ips': [{'subnet_id': 'b488dc7d-0e70-4e52-9179-7e6c3e4fb0a1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:21:19Z', 'updated_at': '2021-05-20T04:21:24Z', 'revision_number': 2, 'project_id': 'b7d86d894a5f420e86f4c28d7772bd22', 'subnets': [{'id': 'b488dc7d-0e70-4e52-9179-7e6c3e4fb0a1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:21:32.388460 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b7883dce-b54f-4a26-9c8c-12d3efd59a05 None None] Checking router: 4ec3fa08-f3da-44bd-bf6b-4feab27e9b78 for host: dv-cinder-790910-4-iscsi {{(pid=91689) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 04:21:32.395189 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b7883dce-b54f-4a26-9c8c-12d3efd59a05 None None] Updating router 4ec3fa08-f3da-44bd-bf6b-4feab27e9b78 port a4932092-c8bd-4cf6-88c2-2bbb4eb549b3 binding host dv-cinder-790910-4-iscsi {{(pid=91689) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 20 04:21:32.579345 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron_lib.callbacks.manager [None req-b7883dce-b54f-4a26-9c8c-12d3efd59a05 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:32.730538 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:32.801529 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] For port a51c67da-478f-4b96-ab49-4cd64c665710, host dv-cinder-790910-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=a51c67da-478f-4b96-ab49-4cd64c665710,segment=NetworkSegment(8df49ec5-3fb9-4715-bc9a-f4019a6b55f9),segment_id=8df49ec5-3fb9-4715-bc9a-f4019a6b55f9)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:21:32.915949 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-9d29f2c2-88ff-4165-8b22-3e60a042181c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-593149'] for network, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:32.918952 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:32.954308 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-aad9ef34-d62d-4fb9-b027-6d9ca14d151f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:33.014832 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65867a9c-5f82-4e56-9c24-fbca72fa9124 service neutron] Pushing event updated for resources: {'Port': ['ID=49f0e77b-6589-4f2f-9f47-7eb071a38ce6,revision_number=2']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:33.027204 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-9e95cf86-6b6b-4903-bd41-b6946cacf5a5 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:33.038014 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-65867a9c-5f82-4e56-9c24-fbca72fa9124 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.717s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:33.249109 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:33.279710 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-e0c5894b-0651-47f7-b5c9-18f5eabf3b57 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:33.291350 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.managers [req-a29b5ab6-2541-493f-a266-5f2fd459002a req-65867a9c-5f82-4e56-9c24-fbca72fa9124 service neutron] Attempting to bind port 49f0e77b-6589-4f2f-9f47-7eb071a38ce6 on host hv-cinder-79091 for vnic_type normal with profile  {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 04:21:33.293385 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.managers [req-a29b5ab6-2541-493f-a266-5f2fd459002a req-65867a9c-5f82-4e56-9c24-fbca72fa9124 service neutron] Attempting to bind port 49f0e77b-6589-4f2f-9f47-7eb071a38ce6 by drivers openvswitch,hyperv on host hv-cinder-79091 at level 0 using segments [{'id': '743e4a81-111b-4929-b0d4-50516fe60014', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 879, 'network_id': '4100b38a-1db4-4a6e-9c33-7bcf19c64d59'}] {{(pid=91687) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 04:21:33.294565 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a29b5ab6-2541-493f-a266-5f2fd459002a req-65867a9c-5f82-4e56-9c24-fbca72fa9124 service neutron] Attempting to bind port 49f0e77b-6589-4f2f-9f47-7eb071a38ce6 on network 4100b38a-1db4-4a6e-9c33-7bcf19c64d59 {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:21:33.305316 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a29b5ab6-2541-493f-a266-5f2fd459002a req-65867a9c-5f82-4e56-9c24-fbca72fa9124 service neutron] Port 49f0e77b-6589-4f2f-9f47-7eb071a38ce6 on network 4100b38a-1db4-4a6e-9c33-7bcf19c64d59 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79091 {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 20 04:21:33.311368 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a29b5ab6-2541-493f-a266-5f2fd459002a req-65867a9c-5f82-4e56-9c24-fbca72fa9124 service neutron] Attempting to bind port 49f0e77b-6589-4f2f-9f47-7eb071a38ce6 on network 4100b38a-1db4-4a6e-9c33-7bcf19c64d59 {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:21:33.329328 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a29b5ab6-2541-493f-a266-5f2fd459002a req-65867a9c-5f82-4e56-9c24-fbca72fa9124 service neutron] Checking agent: {'id': '7cc947fd-92eb-4d43-ad6b-ea002afff217', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79091', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 4, 19, 34), 'started_at': datetime.datetime(2021, 5, 20, 4, 19, 34), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 4, 21, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 04:21:33.334487 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a29b5ab6-2541-493f-a266-5f2fd459002a req-65867a9c-5f82-4e56-9c24-fbca72fa9124 service neutron] Checking segment: {'id': '743e4a81-111b-4929-b0d4-50516fe60014', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 879, 'network_id': '4100b38a-1db4-4a6e-9c33-7bcf19c64d59'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91687) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:21:33.336129 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a29b5ab6-2541-493f-a266-5f2fd459002a req-65867a9c-5f82-4e56-9c24-fbca72fa9124 service neutron] Bound using segment: {'id': '743e4a81-111b-4929-b0d4-50516fe60014', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 879, 'network_id': '4100b38a-1db4-4a6e-9c33-7bcf19c64d59'} {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 04:21:33.351531 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.managers [req-a29b5ab6-2541-493f-a266-5f2fd459002a req-65867a9c-5f82-4e56-9c24-fbca72fa9124 service neutron] Bound port: 49f0e77b-6589-4f2f-9f47-7eb071a38ce6, host: hv-cinder-79091, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '743e4a81-111b-4929-b0d4-50516fe60014', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 879, 'network_id': '4100b38a-1db4-4a6e-9c33-7bcf19c64d59'}}] {{(pid=91687) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 04:21:33.353533 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-a29b5ab6-2541-493f-a266-5f2fd459002a req-65867a9c-5f82-4e56-9c24-fbca72fa9124 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:33.412645 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.db_base_plugin_common [None req-9e95cf86-6b6b-4903-bd41-b6946cacf5a5 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Allocated IP 172.27.1.199 (aec557db-0c02-4008-8c9f-2efcd7462f90/217f4b55-4415-4d57-8b43-2ff4c8ac8e81/45825bf1-08bb-4366-9e8e-1a2c04255a18) {{(pid=91686) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 04:21:33.417381 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Pushing event updated for resources: {'Port': ['ID=a51c67da-478f-4b96-ab49-4cd64c665710,revision_number=4']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:33.427856 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.474s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:33.434583 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ea4803bd-878f-47d5-9084-1ec41953c9db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:33.525758 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cb02e37-d508-4905-9dce-621591648150 req-a05571b1-9c1d-43e1-ba5d-835612076cf7 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:21:33.540997 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-8cb02e37-d508-4905-9dce-621591648150 req-a05571b1-9c1d-43e1-ba5d-835612076cf7 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/ports?device_id=20a6d6ed-f811-42fd-8b44-ab4c031330e7 HTTP/1.1" status: 200  len: 943 time: 0.9891443
May 20 04:21:33.673918 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:33.675557 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-8cb02e37-d508-4905-9dce-621591648150 req-3a439c6b-50b2-4530-aa3a-3675048191f0 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/security-groups?id=a5479633-0923-4a98-9c22-65615d7859f0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1298301
May 20 04:21:33.688144 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-04ef7d34-b12b-4904-bf65-6213ce80bf0f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced1787b80>, [{'id': '34eeb764-2607-4d9f-96c4-89598b702500', 'name': 'tempest-AttachVolumeShelveTestJSON-1895235554-router', 'tenant_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.72'}], 'enable_snat': True}, 'gw_port_id': '16508f6e-35a3-4301-9018-78e099969b00', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:21:10Z', 'updated_at': '2021-05-20T04:21:20Z', 'revision_number': 4, 'project_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'gw_port': {'id': '16508f6e-35a3-4301-9018-78e099969b00', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:e3:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '34eeb764-2607-4d9f-96c4-89598b702500', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:21:12Z', 'updated_at': '2021-05-20T04:21:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_interfaces': [{'id': 'aad390e4-f9e2-4bbe-9e64-7b390cc7f3b3', 'name': '', 'network_id': '21794e86-fda7-40a6-a5a8-db117c7eeb9d', 'tenant_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'mac_address': 'fa:16:3e:b2:b9:f0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '34eeb764-2607-4d9f-96c4-89598b702500', 'device_owner': 'network:router_interface', 'standard_attr_id': 88, 'fixed_ips': [{'subnet_id': '06f38702-3d3c-4e25-8f84-85483d1ddf28', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:21:18Z', 'updated_at': '2021-05-20T04:21:20Z', 'revision_number': 2, 'project_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'subnets': [{'id': '06f38702-3d3c-4e25-8f84-85483d1ddf28', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:21:33.704691 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-04ef7d34-b12b-4904-bf65-6213ce80bf0f None None] Checking router: 34eeb764-2607-4d9f-96c4-89598b702500 for host: dv-cinder-790910-4-iscsi {{(pid=91688) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 04:21:33.705173 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-04ef7d34-b12b-4904-bf65-6213ce80bf0f None None] Updating router 34eeb764-2607-4d9f-96c4-89598b702500 port aad390e4-f9e2-4bbe-9e64-7b390cc7f3b3 binding host dv-cinder-790910-4-iscsi {{(pid=91688) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 20 04:21:33.798883 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [req-a29b5ab6-2541-493f-a266-5f2fd459002a req-65867a9c-5f82-4e56-9c24-fbca72fa9124 service neutron] For port 49f0e77b-6589-4f2f-9f47-7eb071a38ce6, host hv-cinder-79091, cleared binding levels {{(pid=91687) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 04:21:33.807700 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [req-a29b5ab6-2541-493f-a266-5f2fd459002a req-65867a9c-5f82-4e56-9c24-fbca72fa9124 service neutron] For port 49f0e77b-6589-4f2f-9f47-7eb071a38ce6, host hv-cinder-79091, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=49f0e77b-6589-4f2f-9f47-7eb071a38ce6,segment=NetworkSegment(743e4a81-111b-4929-b0d4-50516fe60014),segment_id=743e4a81-111b-4929-b0d4-50516fe60014)] {{(pid=91687) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 04:21:33.814123 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-a29b5ab6-2541-493f-a266-5f2fd459002a req-65867a9c-5f82-4e56-9c24-fbca72fa9124 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:33.818795 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:33.828238 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-04ef7d34-b12b-4904-bf65-6213ce80bf0f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:33.861104 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-9e95cf86-6b6b-4903-bd41-b6946cacf5a5 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks [] for port, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:34.011752 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a29b5ab6-2541-493f-a266-5f2fd459002a req-65867a9c-5f82-4e56-9c24-fbca72fa9124 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:21:34.012677 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-a29b5ab6-2541-493f-a266-5f2fd459002a req-65867a9c-5f82-4e56-9c24-fbca72fa9124 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for port, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:34.014426 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a29b5ab6-2541-493f-a266-5f2fd459002a req-65867a9c-5f82-4e56-9c24-fbca72fa9124 service neutron] 10.222.0.82 "PUT /v2.0/ports/49f0e77b-6589-4f2f-9f47-7eb071a38ce6 HTTP/1.1" status: 200  len: 1093 time: 7.1866727
May 20 04:21:34.015777 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '20a6d6ed-f811-42fd-8b44-ab4c031330e7', 'tag': '49f0e77b-6589-4f2f-9f47-7eb071a38ce6'}] {{(pid=91687) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:21:34.076565 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron_lib.callbacks.manager [None req-b7883dce-b54f-4a26-9c8c-12d3efd59a05 None None] Notify callbacks [] for port, precommit_update {{(pid=91689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:34.112465 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65867a9c-5f82-4e56-9c24-fbca72fa9124 service neutron] Pushing event updated for resources: {'Port': ['ID=49f0e77b-6589-4f2f-9f47-7eb071a38ce6,revision_number=3']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:34.116761 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-65867a9c-5f82-4e56-9c24-fbca72fa9124 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.298s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:34.144108 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-9e95cf86-6b6b-4903-bd41-b6946cacf5a5 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8782892106231'] for port, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:34.163324 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.provisioning_blocks [None req-b7883dce-b54f-4a26-9c8c-12d3efd59a05 None None] Transition to ACTIVE for port object a4932092-c8bd-4cf6-88c2-2bbb4eb549b3 will not be triggered until provisioned by entity L2. {{(pid=91689) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:21:34.183235 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron_lib.callbacks.manager [None req-b7883dce-b54f-4a26-9c8c-12d3efd59a05 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:34.205383 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG oslo_concurrency.lockutils [None req-a9f95531-ee5d-4065-9923-cf5ce920a47a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:34.379140 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-da741bb0-cf6e-48d4-b8da-5a67e1f53dfd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:34.484905 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11bf997e-acdf-4d42-a7ff-1c2f72a29d58 None None] Pushing event updated for resources: {'Port': ['ID=a4932092-c8bd-4cf6-88c2-2bbb4eb549b3,revision_number=3']} {{(pid=91689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:34.503662 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG oslo_concurrency.lockutils [None req-11bf997e-acdf-4d42-a7ff-1c2f72a29d58 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.303s {{(pid=91689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:35.034229 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e95cf86-6b6b-4903-bd41-b6946cacf5a5 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Pushing event updated for resources: {'Port': ['ID=45825bf1-08bb-4366-9e8e-1a2c04255a18,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:35.057101 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9e95cf86-6b6b-4903-bd41-b6946cacf5a5 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Network aec557db-0c02-4008-8c9f-2efcd7462f90 is already hosted by enough agents. {{(pid=91686) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:21:35.058365 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-9e95cf86-6b6b-4903-bd41-b6946cacf5a5 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.680s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:35.078624 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-04ef7d34-b12b-4904-bf65-6213ce80bf0f None None] Notify callbacks [] for port, precommit_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:35.116144 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.base_scheduler [None req-9e95cf86-6b6b-4903-bd41-b6946cacf5a5 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Resources bound (agent type, host, resource id):  {{(pid=91686) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:21:35.137791 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9e95cf86-6b6b-4903-bd41-b6946cacf5a5 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Received port after_create {{(pid=91686) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 04:21:35.153621 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-04ef7d34-b12b-4904-bf65-6213ce80bf0f None None] Transition to ACTIVE for port object aad390e4-f9e2-4bbe-9e64-7b390cc7f3b3 will not be triggered until provisioned by entity L2. {{(pid=91688) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:21:35.219654 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.managers [None req-b7883dce-b54f-4a26-9c8c-12d3efd59a05 None None] Attempting to bind port a4932092-c8bd-4cf6-88c2-2bbb4eb549b3 on host dv-cinder-790910-4-iscsi for vnic_type normal with profile  {{(pid=91689) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 04:21:35.220472 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.managers [None req-b7883dce-b54f-4a26-9c8c-12d3efd59a05 None None] Attempting to bind port a4932092-c8bd-4cf6-88c2-2bbb4eb549b3 by drivers openvswitch,hyperv on host dv-cinder-790910-4-iscsi at level 0 using segments [{'id': '9d2ee761-256d-4e66-82a3-ef6e5bd352c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '348b2b0f-c826-45ab-ba85-8430235b9cac'}] {{(pid=91689) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 04:21:35.225553 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b7883dce-b54f-4a26-9c8c-12d3efd59a05 None None] Attempting to bind port a4932092-c8bd-4cf6-88c2-2bbb4eb549b3 on network 348b2b0f-c826-45ab-ba85-8430235b9cac {{(pid=91689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:21:35.253230 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-04ef7d34-b12b-4904-bf65-6213ce80bf0f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:35.258544 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b7883dce-b54f-4a26-9c8c-12d3efd59a05 None None] Checking agent: {'id': '333121d4-1023-4a33-a54c-f4dd052e1612', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-790910-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 4, 13, 33), 'started_at': datetime.datetime(2021, 5, 20, 4, 14, 3), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 4, 21, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-790910-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 04:21:35.267180 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b7883dce-b54f-4a26-9c8c-12d3efd59a05 None None] Checking segment: {'id': '9d2ee761-256d-4e66-82a3-ef6e5bd352c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '348b2b0f-c826-45ab-ba85-8430235b9cac'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91689) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:21:35.268126 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron_lib.callbacks.manager [None req-b7883dce-b54f-4a26-9c8c-12d3efd59a05 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:35.271242 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b7883dce-b54f-4a26-9c8c-12d3efd59a05 None None] Bound using segment: {'id': '9d2ee761-256d-4e66-82a3-ef6e5bd352c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '348b2b0f-c826-45ab-ba85-8430235b9cac'} {{(pid=91689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 04:21:35.272269 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.managers [None req-b7883dce-b54f-4a26-9c8c-12d3efd59a05 None None] Bound port: a4932092-c8bd-4cf6-88c2-2bbb4eb549b3, host: dv-cinder-790910-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9d2ee761-256d-4e66-82a3-ef6e5bd352c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '348b2b0f-c826-45ab-ba85-8430235b9cac'}}] {{(pid=91689) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 04:21:35.277916 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron_lib.callbacks.manager [None req-b7883dce-b54f-4a26-9c8c-12d3efd59a05 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:35.296554 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:35.385637 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-9d29f2c2-88ff-4165-8b22-3e60a042181c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1505550', 'neutron.services.segments.db._delete_segments_for_network-8782892550274'] for network, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:35.401458 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17edafa6-f960-48d0-a5fe-9cbd53a05171 req-70571c04-448a-408f-9c09-93f867201668 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:21:35.412589 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-17edafa6-f960-48d0-a5fe-9cbd53a05171 req-70571c04-448a-408f-9c09-93f867201668 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/ports?device_id=20a6d6ed-f811-42fd-8b44-ab4c031330e7 HTTP/1.1" status: 200  len: 943 time: 0.4143834
May 20 04:21:35.462214 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device a51c67da-478f-4b96-ab49-4cd64c665710 up at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:21:35.615915 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-17edafa6-f960-48d0-a5fe-9cbd53a05171 req-b0037aaa-8272-4292-8a8a-03d8b59c9500 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/security-groups?id=a5479633-0923-4a98-9c22-65615d7859f0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2021570
May 20 04:21:35.661328 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-9d29f2c2-88ff-4165-8b22-3e60a042181c admin admin] Subscribe: <bound method Plugin._prevent_segment_delete_with_subnet_associated of <neutron.services.segments.plugin.Plugin object at 0x7fced11af460>> segment before_delete 55550000 {{(pid=91686) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:21:35.662581 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-9d29f2c2-88ff-4165-8b22-3e60a042181c admin admin] Subscribe: <bound method Plugin._validate_auto_address_subnet_delete of <neutron.services.segments.plugin.Plugin object at 0x7fced11af460>> subnet precommit_delete_associations 55550000 {{(pid=91686) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:21:35.665426 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-9d29f2c2-88ff-4165-8b22-3e60a042181c admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_host_addition_to_aggregate of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fced0fac340>> segment_host_mapping after_create 55550000 {{(pid=91686) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:21:35.666257 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-9d29f2c2-88ff-4165-8b22-3e60a042181c admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fced0fac340>> port after_create 55550000 {{(pid=91686) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:21:35.667382 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-9d29f2c2-88ff-4165-8b22-3e60a042181c admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fced0fac340>> port after_delete 55550000 {{(pid=91686) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:21:35.667941 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-9d29f2c2-88ff-4165-8b22-3e60a042181c admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fced0fac340>> port after_update 55550000 {{(pid=91686) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:21:35.668445 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-9d29f2c2-88ff-4165-8b22-3e60a042181c admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_segment_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fced0fac340>> segment after_delete 55550000 {{(pid=91686) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:21:35.668988 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-9d29f2c2-88ff-4165-8b22-3e60a042181c admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_created of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fced0fac340>> subnet after_create 55550000 {{(pid=91686) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:21:35.669498 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-9d29f2c2-88ff-4165-8b22-3e60a042181c admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fced0fac340>> subnet after_delete 55550000 {{(pid=91686) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:21:35.670005 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-9d29f2c2-88ff-4165-8b22-3e60a042181c admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fced0fac340>> subnet after_update 55550000 {{(pid=91686) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:21:35.686225 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a833570-0998-49d4-b6d8-01b7360e7752 None None] Pushing event updated for resources: {'Port': ['ID=aad390e4-f9e2-4bbe-9e64-7b390cc7f3b3,revision_number=3']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:35.690224 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f21320cc-6a25-4ec1-8a32-8b119b35fd55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:35.707742 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-8a833570-0998-49d4-b6d8-01b7360e7752 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.411s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:35.725379 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.db [None req-b7883dce-b54f-4a26-9c8c-12d3efd59a05 None None] For port a4932092-c8bd-4cf6-88c2-2bbb4eb549b3, host dv-cinder-790910-4-iscsi, cleared binding levels {{(pid=91689) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 04:21:35.746847 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.db [None req-b7883dce-b54f-4a26-9c8c-12d3efd59a05 None None] For port a4932092-c8bd-4cf6-88c2-2bbb4eb549b3, host dv-cinder-790910-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=a4932092-c8bd-4cf6-88c2-2bbb4eb549b3,segment=NetworkSegment(9d2ee761-256d-4e66-82a3-ef6e5bd352c1),segment_id=9d2ee761-256d-4e66-82a3-ef6e5bd352c1)] {{(pid=91689) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 04:21:35.839665 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron_lib.callbacks.manager [None req-b7883dce-b54f-4a26-9c8c-12d3efd59a05 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:35.877283 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:36.008887 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.managers [None req-04ef7d34-b12b-4904-bf65-6213ce80bf0f None None] Attempting to bind port aad390e4-f9e2-4bbe-9e64-7b390cc7f3b3 on host dv-cinder-790910-4-iscsi for vnic_type normal with profile  {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 04:21:36.009647 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.managers [None req-04ef7d34-b12b-4904-bf65-6213ce80bf0f None None] Attempting to bind port aad390e4-f9e2-4bbe-9e64-7b390cc7f3b3 by drivers openvswitch,hyperv on host dv-cinder-790910-4-iscsi at level 0 using segments [{'id': '9521f383-6017-4b4d-9f47-cff4ed54cb57', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 864, 'network_id': '21794e86-fda7-40a6-a5a8-db117c7eeb9d'}] {{(pid=91688) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 04:21:36.012117 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-04ef7d34-b12b-4904-bf65-6213ce80bf0f None None] Attempting to bind port aad390e4-f9e2-4bbe-9e64-7b390cc7f3b3 on network 21794e86-fda7-40a6-a5a8-db117c7eeb9d {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:21:36.026098 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-04ef7d34-b12b-4904-bf65-6213ce80bf0f None None] Checking agent: {'id': '333121d4-1023-4a33-a54c-f4dd052e1612', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-790910-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 4, 13, 33), 'started_at': datetime.datetime(2021, 5, 20, 4, 14, 3), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 4, 21, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-790910-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 04:21:36.026542 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-04ef7d34-b12b-4904-bf65-6213ce80bf0f None None] Checking segment: {'id': '9521f383-6017-4b4d-9f47-cff4ed54cb57', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 864, 'network_id': '21794e86-fda7-40a6-a5a8-db117c7eeb9d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91688) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:21:36.026923 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-04ef7d34-b12b-4904-bf65-6213ce80bf0f None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:36.027334 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-04ef7d34-b12b-4904-bf65-6213ce80bf0f None None] Bound using segment: {'id': '9521f383-6017-4b4d-9f47-cff4ed54cb57', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 864, 'network_id': '21794e86-fda7-40a6-a5a8-db117c7eeb9d'} {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 04:21:36.027930 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.managers [None req-04ef7d34-b12b-4904-bf65-6213ce80bf0f None None] Bound port: aad390e4-f9e2-4bbe-9e64-7b390cc7f3b3, host: dv-cinder-790910-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9521f383-6017-4b4d-9f47-cff4ed54cb57', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 864, 'network_id': '21794e86-fda7-40a6-a5a8-db117c7eeb9d'}}] {{(pid=91688) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 04:21:36.028322 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-04ef7d34-b12b-4904-bf65-6213ce80bf0f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:36.116040 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b7883dce-b54f-4a26-9c8c-12d3efd59a05 None None] Routers {'4ec3fa08-f3da-44bd-bf6b-4feab27e9b78'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91689) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:21:36.119636 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-b7883dce-b54f-4a26-9c8c-12d3efd59a05 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced246fe80>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:21:33Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['4ec3fa08-f3da-44bd-bf6b-4feab27e9b78'], 'active': True} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:21:36.247715 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-9d29f2c2-88ff-4165-8b22-3e60a042181c admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_after_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7fced0a54520>> subnet after_create 55550000 {{(pid=91686) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:21:36.248109 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-9d29f2c2-88ff-4165-8b22-3e60a042181c admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_after_delete of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7fced0a54520>> subnet after_delete 55550000 {{(pid=91686) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:21:36.248402 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-9d29f2c2-88ff-4165-8b22-3e60a042181c admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_before_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7fced0a54520>> subnet before_create 55550000 {{(pid=91686) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:21:36.248735 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-9d29f2c2-88ff-4165-8b22-3e60a042181c admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_before_update of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7fced0a54520>> subnet before_update 55550000 {{(pid=91686) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:21:36.249127 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.services.segments.db [None req-9d29f2c2-88ff-4165-8b22-3e60a042181c admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fced0fac880>,) {'filters': {'network_id': ['8f3c5439-7e79-4f14-a1a4-1c62e4ffee6f']}} {{(pid=91686) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:21:36.265932 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning complete for port a51c67da-478f-4b96-ab49-4cd64c665710 triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:21:36.266840 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:36.470573 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '20a6d6ed-f811-42fd-8b44-ab4c031330e7', 'tag': '49f0e77b-6589-4f2f-9f47-7eb071a38ce6', 'status': 'completed', 'code': 200}
May 20 04:21:36.574576 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-04ef7d34-b12b-4904-bf65-6213ce80bf0f None None] For port aad390e4-f9e2-4bbe-9e64-7b390cc7f3b3, host dv-cinder-790910-4-iscsi, cleared binding levels {{(pid=91688) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 04:21:36.579858 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-04ef7d34-b12b-4904-bf65-6213ce80bf0f None None] For port aad390e4-f9e2-4bbe-9e64-7b390cc7f3b3, host dv-cinder-790910-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=aad390e4-f9e2-4bbe-9e64-7b390cc7f3b3,segment=NetworkSegment(9521f383-6017-4b4d-9f47-cff4ed54cb57),segment_id=9521f383-6017-4b4d-9f47-cff4ed54cb57)] {{(pid=91688) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 04:21:36.640832 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11bf997e-acdf-4d42-a7ff-1c2f72a29d58 None None] Pushing event updated for resources: {'Port': ['ID=a4932092-c8bd-4cf6-88c2-2bbb4eb549b3,revision_number=4']} {{(pid=91689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:36.650883 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-04ef7d34-b12b-4904-bf65-6213ce80bf0f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:36.663226 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG oslo_concurrency.lockutils [None req-11bf997e-acdf-4d42-a7ff-1c2f72a29d58 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.786s {{(pid=91689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:36.673058 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c77c87b-f274-48c4-8347-baadd43022b7 req-3e86e857-c696-4d22-9540-8fee150e4153 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:21:36.687853 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-0c77c87b-f274-48c4-8347-baadd43022b7 req-3e86e857-c696-4d22-9540-8fee150e4153 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/networks?id=348b2b0f-c826-45ab-ba85-8430235b9cac HTTP/1.1" status: 200  len: 819 time: 3.6852257
May 20 04:21:36.708137 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.services.segments.db [None req-9d29f2c2-88ff-4165-8b22-3e60a042181c admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fced0fac880>, '04a1687e-8456-4751-bf61-29951b14a5c9') {'for_net_delete': True} {{(pid=91686) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:21:36.709226 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.services.segments.db [None req-9d29f2c2-88ff-4165-8b22-3e60a042181c admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fced0fac880>, '04a1687e-8456-4751-bf61-29951b14a5c9') {} {{(pid=91686) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:21:36.720166 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:36.771017 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-0c77c87b-f274-48c4-8347-baadd43022b7 req-6a482d95-0636-4669-94e5-90c7c7e59f56 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/quotas/b7d86d894a5f420e86f4c28d7772bd22 HTTP/1.1" status: 200  len: 375 time: 0.0780816
May 20 04:21:36.843260 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvr_db [None req-b7883dce-b54f-4a26-9c8c-12d3efd59a05 None None] Set router 4ec3fa08-f3da-44bd-bf6b-4feab27e9b78 gateway port host: dv-cinder-790910-4-iscsi {{(pid=91689) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:21:36.964838 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-9d29f2c2-88ff-4165-8b22-3e60a042181c admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8782892560523', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4081441'] for segment, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:37.001474 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-04ef7d34-b12b-4904-bf65-6213ce80bf0f None None] Routers {'34eeb764-2607-4d9f-96c4-89598b702500'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91688) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:21:37.002159 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-04ef7d34-b12b-4904-bf65-6213ce80bf0f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced1787b80>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:21:33Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['34eeb764-2607-4d9f-96c4-89598b702500'], 'active': True} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:21:37.026571 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10d91ee6-82ee-42c9-9912-38588d243ad4 req-e679900e-7577-464b-ba61-9e95b85c56b8 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:21:37.056775 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-10d91ee6-82ee-42c9-9912-38588d243ad4 req-e679900e-7577-464b-ba61-9e95b85c56b8 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/ports?device_id=20a6d6ed-f811-42fd-8b44-ab4c031330e7 HTTP/1.1" status: 200  len: 943 time: 0.2299232
May 20 04:21:37.141742 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-9e95cf86-6b6b-4903-bd41-b6946cacf5a5 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks [] for floatingip, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:37.183209 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a833570-0998-49d4-b6d8-01b7360e7752 None None] Pushing event updated for resources: {'Port': ['ID=aad390e4-f9e2-4bbe-9e64-7b390cc7f3b3,revision_number=4']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:37.193198 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-8a833570-0998-49d4-b6d8-01b7360e7752 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.470s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:37.195663 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 35536) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:21:37.264441 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-9d29f2c2-88ff-4165-8b22-3e60a042181c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1501910'] for segment, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:37.297250 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-10d91ee6-82ee-42c9-9912-38588d243ad4 req-bce4bcbe-47c6-4606-ac05-91c1bee9ddab tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/security-groups?id=a5479633-0923-4a98-9c22-65615d7859f0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2221594
May 20 04:21:37.305705 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device a4932092-c8bd-4cf6-88c2-2bbb4eb549b3 up at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:21:37.447251 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9d29f2c2-88ff-4165-8b22-3e60a042181c admin admin] Releasing vlan 899 on physical network physnet1 to pool {{(pid=91686) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 20 04:21:37.452045 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-9d29f2c2-88ff-4165-8b22-3e60a042181c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1501910', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2145121'] for segment, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:37.486011 dv-cinder-790910-4-iscsi neutron-server[91686]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead
May 20 04:21:37.486011 dv-cinder-790910-4-iscsi neutron-server[91686]:   from cryptography.utils import int_from_bytes
May 20 04:21:37.486011 dv-cinder-790910-4-iscsi neutron-server[91686]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead
May 20 04:21:37.486011 dv-cinder-790910-4-iscsi neutron-server[91686]:   from cryptography.utils import int_from_bytes
May 20 04:21:37.486011 dv-cinder-790910-4-iscsi neutron-server[91686]: Traceback (most recent call last):
May 20 04:21:37.486011 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 20 04:21:37.486011 dv-cinder-790910-4-iscsi neutron-server[91686]:     timer()
May 20 04:21:37.486011 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 20 04:21:37.486011 dv-cinder-790910-4-iscsi neutron-server[91686]:     cb(*args, **kw)
May 20 04:21:37.486011 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 20 04:21:37.486011 dv-cinder-790910-4-iscsi neutron-server[91686]:     return func(*args, **kwargs)
May 20 04:21:37.486011 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 20 04:21:37.486011 dv-cinder-790910-4-iscsi neutron-server[91686]:     self._notify()
May 20 04:21:37.486011 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 20 04:21:37.486011 dv-cinder-790910-4-iscsi neutron-server[91686]:     self.callback(batched_events)
May 20 04:21:37.486011 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 20 04:21:37.486011 dv-cinder-790910-4-iscsi neutron-server[91686]:     event.method(event)
May 20 04:21:37.486011 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 20 04:21:37.486011 dv-cinder-790910-4-iscsi neutron-server[91686]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 20 04:21:37.486011 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 20 04:21:37.486011 dv-cinder-790910-4-iscsi neutron-server[91686]:     aggregate_uuid = self.p_client.list_aggregates(
May 20 04:21:37.486011 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 20 04:21:37.486011 dv-cinder-790910-4-iscsi neutron-server[91686]:     return f(self, *a, **k)
May 20 04:21:37.486011 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 20 04:21:37.486011 dv-cinder-790910-4-iscsi neutron-server[91686]:     return self._get(url).json()
May 20 04:21:37.486011 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 20 04:21:37.486011 dv-cinder-790910-4-iscsi neutron-server[91686]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 20 04:21:37.486011 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 20 04:21:37.486011 dv-cinder-790910-4-iscsi neutron-server[91686]:     return self.request(url, 'GET', **kwargs)
May 20 04:21:37.486011 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 20 04:21:37.486011 dv-cinder-790910-4-iscsi neutron-server[91686]:     base_url = self.get_endpoint(auth, allow=allow,
May 20 04:21:37.486011 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 20 04:21:37.486011 dv-cinder-790910-4-iscsi neutron-server[91686]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 20 04:21:37.486011 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 20 04:21:37.486011 dv-cinder-790910-4-iscsi neutron-server[91686]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 20 04:21:37.486011 dv-cinder-790910-4-iscsi neutron-server[91686]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 20 04:21:37.747246 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvr_db [None req-04ef7d34-b12b-4904-bf65-6213ce80bf0f None None] Set router 34eeb764-2607-4d9f-96c4-89598b702500 gateway port host: dv-cinder-790910-4-iscsi {{(pid=91688) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:21:37.784093 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-9e95cf86-6b6b-4903-bd41-b6946cacf5a5 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:38.004480 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [req-0c77c87b-f274-48c4-8347-baadd43022b7 req-eee85b65-6b35-4e37-bb3e-833a3796380a tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Synchronizing usage tracker for tenant:b7d86d894a5f420e86f4c28d7772bd22 on resource:port {{(pid=91686) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:21:38.101005 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-b7883dce-b54f-4a26-9c8c-12d3efd59a05 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced246fe80>, [{'id': '4ec3fa08-f3da-44bd-bf6b-4feab27e9b78', 'name': 'tempest-ServerRescueNegativeTestJSON-2060961621-router', 'tenant_id': 'b7d86d894a5f420e86f4c28d7772bd22', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.34'}], 'enable_snat': True}, 'gw_port_id': 'a51c67da-478f-4b96-ab49-4cd64c665710', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:21:09Z', 'updated_at': '2021-05-20T04:21:22Z', 'revision_number': 4, 'project_id': 'b7d86d894a5f420e86f4c28d7772bd22', 'gw_port': {'id': 'a51c67da-478f-4b96-ab49-4cd64c665710', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:d9:31:98', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4ec3fa08-f3da-44bd-bf6b-4feab27e9b78', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.34', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:21:12Z', 'updated_at': '2021-05-20T04:21:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_interfaces': [{'id': 'a4932092-c8bd-4cf6-88c2-2bbb4eb549b3', 'name': '', 'network_id': '348b2b0f-c826-45ab-ba85-8430235b9cac', 'tenant_id': 'b7d86d894a5f420e86f4c28d7772bd22', 'mac_address': 'fa:16:3e:20:99:67', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4ec3fa08-f3da-44bd-bf6b-4feab27e9b78', 'device_owner': 'network:router_interface', 'standard_attr_id': 94, 'fixed_ips': [{'subnet_id': 'b488dc7d-0e70-4e52-9179-7e6c3e4fb0a1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:21:19Z', 'updated_at': '2021-05-20T04:21:35Z', 'revision_number': 4, 'project_id': 'b7d86d894a5f420e86f4c28d7772bd22', 'subnets': [{'id': 'b488dc7d-0e70-4e52-9179-7e6c3e4fb0a1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:21:38.105512 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-ad2b0843-8bb0-4117-9bdc-1cbbedf5967f admin admin] Notify callbacks [] for security_group, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:38.114645 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b7883dce-b54f-4a26-9c8c-12d3efd59a05 None None] The sync data for ids ['4ec3fa08-f3da-44bd-bf6b-4feab27e9b78'] in dv-cinder-790910-4-iscsi is: [{'id': '4ec3fa08-f3da-44bd-bf6b-4feab27e9b78', 'name': 'tempest-ServerRescueNegativeTestJSON-2060961621-router', 'tenant_id': 'b7d86d894a5f420e86f4c28d7772bd22', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.34'}], 'enable_snat': True}, 'gw_port_id': 'a51c67da-478f-4b96-ab49-4cd64c665710', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:21:09Z', 'updated_at': '2021-05-20T04:21:22Z', 'revision_number': 4, 'project_id': 'b7d86d894a5f420e86f4c28d7772bd22', 'gw_port': {'id': 'a51c67da-478f-4b96-ab49-4cd64c665710', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:d9:31:98', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4ec3fa08-f3da-44bd-bf6b-4feab27e9b78', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.34', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:21:12Z', 'updated_at': '2021-05-20T04:21:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_interfaces': [{'id': 'a4932092-c8bd-4cf6-88c2-2bbb4eb549b3', 'name': '', 'network_id': '348b2b0f-c826-45ab-ba85-8430235b9cac', 'tenant_id': 'b7d86d894a5f420e86f4c28d7772bd22', 'mac_address': 'fa:16:3e:20:99:67', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4ec3fa08-f3da-44bd-bf6b-4feab27e9b78', 'device_owner': 'network:router_interface', 'standard_attr_id': 94, 'fixed_ips': [{'subnet_id': 'b488dc7d-0e70-4e52-9179-7e6c3e4fb0a1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:21:19Z', 'updated_at': '2021-05-20T04:21:35Z', 'revision_number': 4, 'project_id': 'b7d86d894a5f420e86f4c28d7772bd22', 'subnets': [{'id': 'b488dc7d-0e70-4e52-9179-7e6c3e4fb0a1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91689) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 04:21:38.159521 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-9d29f2c2-88ff-4165-8b22-3e60a042181c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1505543', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1590664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1781430', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1713996'] for network, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:38.187278 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning for port a4932092-c8bd-4cf6-88c2-2bbb4eb549b3 completed by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:21:38.219761 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-ad2b0843-8bb0-4117-9bdc-1cbbedf5967f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:21:38.223288 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-8f90687d-d247-456e-a20b-287f17db1de2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:38.227882 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning complete for port a4932092-c8bd-4cf6-88c2-2bbb4eb549b3 triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:21:38.228286 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:38.335277 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-9d29f2c2-88ff-4165-8b22-3e60a042181c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for network, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:38.338610 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-ad2b0843-8bb0-4117-9bdc-1cbbedf5967f admin admin] Usage tracker for resource:security_group_rule and tenant:555fe43f67514d918c6524b3cd91495c is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:21:38.385248 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d29f2c2-88ff-4165-8b22-3e60a042181c admin admin] Pushing event deleted for resources: {'Network': ['ID=8f3c5439-7e79-4f14-a1a4-1c62e4ffee6f,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:38.400371 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-ad2b0843-8bb0-4117-9bdc-1cbbedf5967f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:21:38.450717 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [req-0c77c87b-f274-48c4-8347-baadd43022b7 req-eee85b65-6b35-4e37-bb3e-833a3796380a tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Unset dirty status for tenant:b7d86d894a5f420e86f4c28d7772bd22 on resource:port {{(pid=91686) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:21:38.468535 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-0c77c87b-f274-48c4-8347-baadd43022b7 req-eee85b65-6b35-4e37-bb3e-833a3796380a tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?tenant_id=b7d86d894a5f420e86f4c28d7772bd22&fields=id HTTP/1.1" status: 200  len: 255 time: 1.6955743
May 20 04:21:38.473949 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-9d29f2c2-88ff-4165-8b22-3e60a042181c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.250s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:38.536802 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-ad2b0843-8bb0-4117-9bdc-1cbbedf5967f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:21:38.709129 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-9d29f2c2-88ff-4165-8b22-3e60a042181c admin admin] 10.222.0.71 "DELETE /v2.0/networks/8f3c5439-7e79-4f14-a1a4-1c62e4ffee6f HTTP/1.1" status: 204  len: 168 time: 6.4565432
May 20 04:21:38.715598 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 35570) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:21:38.978778 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e85389e2-37af-4b9d-b2b8-f91f471035e5 req-3ee80a7f-1ee0-4a65-8d91-f4c72055f203 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:21:38.986775 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-e85389e2-37af-4b9d-b2b8-f91f471035e5 req-3ee80a7f-1ee0-4a65-8d91-f4c72055f203 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/ports?device_id=20a6d6ed-f811-42fd-8b44-ab4c031330e7 HTTP/1.1" status: 200  len: 943 time: 0.4571273
May 20 04:21:39.082963 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-e85389e2-37af-4b9d-b2b8-f91f471035e5 req-e89ae769-905e-4229-a80e-e553bc434084 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/security-groups?id=a5479633-0923-4a98-9c22-65615d7859f0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0948501
May 20 04:21:39.123877 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.db_base_plugin_v2 [None req-699d2abb-8396-4b86-8b76-11ca5810a279 admin admin] Deleting subnet cbdd44eb-a446-4546-b003-926012adb1a8 {{(pid=91687) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 20 04:21:39.139499 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-699d2abb-8396-4b86-8b76-11ca5810a279 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:39.344783 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:39.410856 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] For port a4932092-c8bd-4cf6-88c2-2bbb4eb549b3, host dv-cinder-790910-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=a4932092-c8bd-4cf6-88c2-2bbb4eb549b3,segment=NetworkSegment(9d2ee761-256d-4e66-82a3-ef6e5bd352c1),segment_id=9d2ee761-256d-4e66-82a3-ef6e5bd352c1)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:21:39.426803 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:39.440931 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-fd976232-d52a-4095-83ed-1c0d0221cf33 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:39.551075 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-699d2abb-8396-4b86-8b76-11ca5810a279 admin admin] Notify callbacks [] for subnet, precommit_delete_associations {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:39.571455 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-699d2abb-8396-4b86-8b76-11ca5810a279 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1504133'] for subnet, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:39.654394 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-04ef7d34-b12b-4904-bf65-6213ce80bf0f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced1787b80>, [{'id': '34eeb764-2607-4d9f-96c4-89598b702500', 'name': 'tempest-AttachVolumeShelveTestJSON-1895235554-router', 'tenant_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.72'}], 'enable_snat': True}, 'gw_port_id': '16508f6e-35a3-4301-9018-78e099969b00', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:21:10Z', 'updated_at': '2021-05-20T04:21:20Z', 'revision_number': 4, 'project_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'gw_port': {'id': '16508f6e-35a3-4301-9018-78e099969b00', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:e3:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '34eeb764-2607-4d9f-96c4-89598b702500', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:21:12Z', 'updated_at': '2021-05-20T04:21:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_interfaces': [{'id': 'aad390e4-f9e2-4bbe-9e64-7b390cc7f3b3', 'name': '', 'network_id': '21794e86-fda7-40a6-a5a8-db117c7eeb9d', 'tenant_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'mac_address': 'fa:16:3e:b2:b9:f0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '34eeb764-2607-4d9f-96c4-89598b702500', 'device_owner': 'network:router_interface', 'standard_attr_id': 88, 'fixed_ips': [{'subnet_id': '06f38702-3d3c-4e25-8f84-85483d1ddf28', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:21:18Z', 'updated_at': '2021-05-20T04:21:36Z', 'revision_number': 4, 'project_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'subnets': [{'id': '06f38702-3d3c-4e25-8f84-85483d1ddf28', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:21:39.701329 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device aad390e4-f9e2-4bbe-9e64-7b390cc7f3b3 up at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:21:39.724430 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5610b8b2-1185-4cec-baf8-01c5df425a13 req-d38e6085-0658-490c-a8a5-29461ad97b88 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:21:39.727853 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-5610b8b2-1185-4cec-baf8-01c5df425a13 req-d38e6085-0658-490c-a8a5-29461ad97b88 service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=b6214ee7a3fe4823b9db71f53439835e&device_id=20a6d6ed-f811-42fd-8b44-ab4c031330e7 HTTP/1.1" status: 200  len: 1096 time: 0.4714468
May 20 04:21:39.758733 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-0c77c87b-f274-48c4-8347-baadd43022b7 req-e12ff3db-07b8-43b2-8238-e6a3cc13449a service neutron] 10.222.0.71 "GET /v2.0/networks/348b2b0f-c826-45ab-ba85-8430235b9cac?fields=segments HTTP/1.1" status: 200  len: 212 time: 1.2279963
May 20 04:21:39.883660 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-04ef7d34-b12b-4904-bf65-6213ce80bf0f None None] The sync data for ids ['34eeb764-2607-4d9f-96c4-89598b702500'] in dv-cinder-790910-4-iscsi is: [{'id': '34eeb764-2607-4d9f-96c4-89598b702500', 'name': 'tempest-AttachVolumeShelveTestJSON-1895235554-router', 'tenant_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.72'}], 'enable_snat': True}, 'gw_port_id': '16508f6e-35a3-4301-9018-78e099969b00', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:21:10Z', 'updated_at': '2021-05-20T04:21:20Z', 'revision_number': 4, 'project_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'gw_port': {'id': '16508f6e-35a3-4301-9018-78e099969b00', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:e3:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '34eeb764-2607-4d9f-96c4-89598b702500', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:21:12Z', 'updated_at': '2021-05-20T04:21:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_interfaces': [{'id': 'aad390e4-f9e2-4bbe-9e64-7b390cc7f3b3', 'name': '', 'network_id': '21794e86-fda7-40a6-a5a8-db117c7eeb9d', 'tenant_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'mac_address': 'fa:16:3e:b2:b9:f0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '34eeb764-2607-4d9f-96c4-89598b702500', 'device_owner': 'network:router_interface', 'standard_attr_id': 88, 'fixed_ips': [{'subnet_id': '06f38702-3d3c-4e25-8f84-85483d1ddf28', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:21:18Z', 'updated_at': '2021-05-20T04:21:36Z', 'revision_number': 4, 'project_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'subnets': [{'id': '06f38702-3d3c-4e25-8f84-85483d1ddf28', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91688) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 04:21:39.957086 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning for port aad390e4-f9e2-4bbe-9e64-7b390cc7f3b3 completed by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:21:39.961624 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning complete for port aad390e4-f9e2-4bbe-9e64-7b390cc7f3b3 triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:21:39.962399 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:40.017460 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-9e95cf86-6b6b-4903-bd41-b6946cacf5a5 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks [] for port, precommit_update {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:40.078905 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Pushing event updated for resources: {'Port': ['ID=a4932092-c8bd-4cf6-88c2-2bbb4eb549b3,revision_number=5']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:40.106495 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.665s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:40.146780 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-9e95cf86-6b6b-4903-bd41-b6946cacf5a5 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2145029'] for port, after_update {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:40.417723 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-da741bb0-cf6e-48d4-b8da-5a67e1f53dfd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:40.674121 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:40.818311 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] For port aad390e4-f9e2-4bbe-9e64-7b390cc7f3b3, host dv-cinder-790910-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=aad390e4-f9e2-4bbe-9e64-7b390cc7f3b3,segment=NetworkSegment(9521f383-6017-4b4d-9f47-cff4ed54cb57),segment_id=9521f383-6017-4b4d-9f47-cff4ed54cb57)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:21:40.828070 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:40.835851 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:40.930721 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e95cf86-6b6b-4903-bd41-b6946cacf5a5 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Pushing event updated for resources: {'Port': ['ID=45825bf1-08bb-4366-9e8e-1a2c04255a18,revision_number=2']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:40.965054 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-9e95cf86-6b6b-4903-bd41-b6946cacf5a5 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.548s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:40.995478 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-9e95cf86-6b6b-4903-bd41-b6946cacf5a5 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1716406'] for floatingip, after_update {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:41.027628 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-0c77c87b-f274-48c4-8347-baadd43022b7 req-e541a7e9-523e-4a7f-a66c-db26792ae627 service neutron] 10.222.0.71 "GET /v2.0/networks/348b2b0f-c826-45ab-ba85-8430235b9cac?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 1.0057864
May 20 04:21:41.131422 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-ad2b0843-8bb0-4117-9bdc-1cbbedf5967f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:41.144580 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-9e95cf86-6b6b-4903-bd41-b6946cacf5a5 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for floatingip, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:41.161386 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-9e95cf86-6b6b-4903-bd41-b6946cacf5a5 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 693 time: 9.7695215
May 20 04:21:41.162966 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Pushing event updated for resources: {'Port': ['ID=aad390e4-f9e2-4bbe-9e64-7b390cc7f3b3,revision_number=5']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:41.174625 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-ad2b0843-8bb0-4117-9bdc-1cbbedf5967f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:41.186798 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.351s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:41.237100 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-0f5929d0-455a-4f4d-89b6-401ed193e430 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:41.248420 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5610b8b2-1185-4cec-baf8-01c5df425a13 req-5c81d5bb-b837-45ac-bcc7-9f273c590d98 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:21:41.267607 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-5610b8b2-1185-4cec-baf8-01c5df425a13 req-5c81d5bb-b837-45ac-bcc7-9f273c590d98 service neutron] 10.222.0.82 "GET /v2.0/networks?tenant_id=b6214ee7a3fe4823b9db71f53439835e&shared=False HTTP/1.1" status: 200  len: 913 time: 1.3957055
May 20 04:21:41.328238 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-ad2b0843-8bb0-4117-9bdc-1cbbedf5967f admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=555fe43f67514d918c6524b3cd91495c&name=default HTTP/1.1" status: 200  len: 2979 time: 4.0562453
May 20 04:21:41.337411 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 35612) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:21:41.436052 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad2b0843-8bb0-4117-9bdc-1cbbedf5967f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0241db59-294d-4d4e-94a0-b636802ab2cb,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:41.471393 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-ad2b0843-8bb0-4117-9bdc-1cbbedf5967f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.234s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:41.700548 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-51aa7b91-bb0d-4b3e-a0cd-a328c2bec925 req-80cd9402-0efb-419b-acd4-71beea1eda78 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 210 time: 0.1592348
May 20 04:21:41.803184 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-f46585a9-73be-4e0d-987f-4472845d220c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:41.845190 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device aad390e4-f9e2-4bbe-9e64-7b390cc7f3b3 up at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:21:42.043373 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-f46585a9-73be-4e0d-987f-4472845d220c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:42.122725 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-565c5c37-d541-43b5-8021-477802c78e05 req-11f0375b-a471-4b31-b3a2-c723a6a540eb tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:21:42.135024 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-565c5c37-d541-43b5-8021-477802c78e05 req-11f0375b-a471-4b31-b3a2-c723a6a540eb tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/ports?device_id=20a6d6ed-f811-42fd-8b44-ab4c031330e7 HTTP/1.1" status: 200  len: 943 time: 1.7947648
May 20 04:21:42.213660 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-699d2abb-8396-4b86-8b76-11ca5810a279 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1504178', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-255887', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377'] for subnet, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:42.249965 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5610b8b2-1185-4cec-baf8-01c5df425a13 req-da8f0ae5-9114-42ee-8c20-f5b3dafbb92e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:21:42.252694 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-5610b8b2-1185-4cec-baf8-01c5df425a13 req-da8f0ae5-9114-42ee-8c20-f5b3dafbb92e service neutron] 10.222.0.82 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.9832098
May 20 04:21:42.257352 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:42.287468 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [req-08a19c1e-311e-4bc1-a3fc-5754bbbd701e req-d66d8816-2d0d-4af4-afe7-4113e3fd054b tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Synchronizing usage tracker for tenant:ef3bec4745b14484ac8e21cd16cbd11d on resource:security_group {{(pid=91686) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:21:42.335118 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-565c5c37-d541-43b5-8021-477802c78e05 req-bb641cfb-e140-4044-b3ec-1968b4bc2347 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/security-groups?id=a5479633-0923-4a98-9c22-65615d7859f0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1980431
May 20 04:21:42.339682 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-699d2abb-8396-4b86-8b76-11ca5810a279 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=cbdd44eb-a446-4546-b003-926012adb1a8,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:42.348551 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-699d2abb-8396-4b86-8b76-11ca5810a279 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:42.369342 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-699d2abb-8396-4b86-8b76-11ca5810a279 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for subnet, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:42.388291 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-699d2abb-8396-4b86-8b76-11ca5810a279 admin admin] 10.222.0.71 "DELETE /v2.0/subnets/cbdd44eb-a446-4546-b003-926012adb1a8 HTTP/1.1" status: 204  len: 168 time: 3.6340959
May 20 04:21:42.390334 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 35666) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:21:42.443835 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning complete for port aad390e4-f9e2-4bbe-9e64-7b390cc7f3b3 triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:21:42.445793 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:42.472262 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [req-08a19c1e-311e-4bc1-a3fc-5754bbbd701e req-d66d8816-2d0d-4af4-afe7-4113e3fd054b tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Unset dirty status for tenant:ef3bec4745b14484ac8e21cd16cbd11d on resource:security_group {{(pid=91686) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:21:42.484225 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-08a19c1e-311e-4bc1-a3fc-5754bbbd701e req-d66d8816-2d0d-4af4-afe7-4113e3fd054b tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?name=tempest-securitygroup--590129347&fields=id&tenant_id=ef3bec4745b14484ac8e21cd16cbd11d HTTP/1.1" status: 200  len: 267 time: 0.3654110
May 20 04:21:42.785665 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-57d6e772-476f-4bfd-9416-1c8b269c497d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-593149'] for network, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:42.845093 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-f46585a9-73be-4e0d-987f-4472845d220c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:42.874242 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-bdd5281c-3df1-43f6-ba47-0410b7ae1203 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:42.935444 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f46585a9-73be-4e0d-987f-4472845d220c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0241db59-294d-4d4e-94a0-b636802ab2cb,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:42.958847 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-f46585a9-73be-4e0d-987f-4472845d220c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:43.002126 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-f46585a9-73be-4e0d-987f-4472845d220c admin admin] Notify callbacks [] for security_group, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:43.009499 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-f46585a9-73be-4e0d-987f-4472845d220c admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/0241db59-294d-4d4e-94a0-b636802ab2cb HTTP/1.1" status: 204  len: 168 time: 1.6692116
May 20 04:21:43.035202 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08a19c1e-311e-4bc1-a3fc-5754bbbd701e req-f4906130-7bff-4c26-bced-4b81a0e59d50 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:21:43.036624 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-08a19c1e-311e-4bc1-a3fc-5754bbbd701e req-f4906130-7bff-4c26-bced-4b81a0e59d50 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/networks?id=21794e86-fda7-40a6-a5a8-db117c7eeb9d HTTP/1.1" status: 200  len: 817 time: 0.5469201
May 20 04:21:43.038535 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device a4932092-c8bd-4cf6-88c2-2bbb4eb549b3 up at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:21:43.071660 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-08a19c1e-311e-4bc1-a3fc-5754bbbd701e req-459c2001-711e-45fa-bfcc-9132e759330b tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/quotas/ef3bec4745b14484ac8e21cd16cbd11d HTTP/1.1" status: 200  len: 375 time: 0.0176528
May 20 04:21:43.265036 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning complete for port a4932092-c8bd-4cf6-88c2-2bbb4eb549b3 triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:21:43.265737 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:43.288344 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-08a19c1e-311e-4bc1-a3fc-5754bbbd701e req-5ef3ddba-8922-41b4-b9e3-f44dbda86513 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?tenant_id=ef3bec4745b14484ac8e21cd16cbd11d&fields=id HTTP/1.1" status: 200  len: 348 time: 0.2097735
May 20 04:21:43.451175 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-57d6e772-476f-4bfd-9416-1c8b269c497d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1505550', 'neutron.services.segments.db._delete_segments_for_network-8782892550274'] for network, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:43.472314 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-57d6e772-476f-4bfd-9416-1c8b269c497d admin admin] Subscribe: <bound method Plugin._prevent_segment_delete_with_subnet_associated of <neutron.services.segments.plugin.Plugin object at 0x7fced21a2ca0>> segment before_delete 55550000 {{(pid=91687) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:21:43.473113 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-57d6e772-476f-4bfd-9416-1c8b269c497d admin admin] Subscribe: <bound method Plugin._validate_auto_address_subnet_delete of <neutron.services.segments.plugin.Plugin object at 0x7fced21a2ca0>> subnet precommit_delete_associations 55550000 {{(pid=91687) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:21:43.474598 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-57d6e772-476f-4bfd-9416-1c8b269c497d admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_host_addition_to_aggregate of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fced1095b80>> segment_host_mapping after_create 55550000 {{(pid=91687) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:21:43.475223 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-57d6e772-476f-4bfd-9416-1c8b269c497d admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fced1095b80>> port after_create 55550000 {{(pid=91687) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:21:43.475764 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-57d6e772-476f-4bfd-9416-1c8b269c497d admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fced1095b80>> port after_delete 55550000 {{(pid=91687) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:21:43.476304 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-57d6e772-476f-4bfd-9416-1c8b269c497d admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fced1095b80>> port after_update 55550000 {{(pid=91687) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:21:43.477161 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-57d6e772-476f-4bfd-9416-1c8b269c497d admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_segment_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fced1095b80>> segment after_delete 55550000 {{(pid=91687) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:21:43.478353 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-57d6e772-476f-4bfd-9416-1c8b269c497d admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_created of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fced1095b80>> subnet after_create 55550000 {{(pid=91687) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:21:43.479162 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-57d6e772-476f-4bfd-9416-1c8b269c497d admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fced1095b80>> subnet after_delete 55550000 {{(pid=91687) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:21:43.479696 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-57d6e772-476f-4bfd-9416-1c8b269c497d admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fced1095b80>> subnet after_update 55550000 {{(pid=91687) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:21:43.670936 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-08a19c1e-311e-4bc1-a3fc-5754bbbd701e req-8ab482b8-67d6-4c42-8e80-ee4b0243fb0d service neutron] 10.222.0.71 "GET /v2.0/networks/21794e86-fda7-40a6-a5a8-db117c7eeb9d?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3758283
May 20 04:21:43.747599 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-57d6e772-476f-4bfd-9416-1c8b269c497d admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_after_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7fced2587bb0>> subnet after_create 55550000 {{(pid=91687) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:21:43.748165 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-57d6e772-476f-4bfd-9416-1c8b269c497d admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_after_delete of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7fced2587bb0>> subnet after_delete 55550000 {{(pid=91687) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:21:43.749609 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-57d6e772-476f-4bfd-9416-1c8b269c497d admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_before_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7fced2587bb0>> subnet before_create 55550000 {{(pid=91687) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:21:43.752722 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-57d6e772-476f-4bfd-9416-1c8b269c497d admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_before_update of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7fced2587bb0>> subnet before_update 55550000 {{(pid=91687) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 20 04:21:43.755726 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.services.segments.db [None req-57d6e772-476f-4bfd-9416-1c8b269c497d admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fced1095520>,) {'filters': {'network_id': ['0ce28fd5-15fe-4fee-ac41-386db9383364']}} {{(pid=91687) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:21:43.801943 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.services.segments.db [None req-57d6e772-476f-4bfd-9416-1c8b269c497d admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fced1095520>, 'e789589d-281b-437d-a8a9-98ef763c6c9d') {'for_net_delete': True} {{(pid=91687) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:21:43.802438 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.services.segments.db [None req-57d6e772-476f-4bfd-9416-1c8b269c497d admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fced1095520>, 'e789589d-281b-437d-a8a9-98ef763c6c9d') {} {{(pid=91687) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:21:43.838908 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-57d6e772-476f-4bfd-9416-1c8b269c497d admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8782892560523', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-936621'] for segment, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:43.870813 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-57d6e772-476f-4bfd-9416-1c8b269c497d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1501910'] for segment, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:43.925936 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c886a56-584b-461b-9575-e692d7d651ff req-ff2ce4a5-52db-4f53-85f6-9ecd973bb90d tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:21:43.926776 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-4c886a56-584b-461b-9575-e692d7d651ff req-ff2ce4a5-52db-4f53-85f6-9ecd973bb90d tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Synchronizing usage tracker for tenant:b7d86d894a5f420e86f4c28d7772bd22 on resource:network {{(pid=91687) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:21:43.932323 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-57d6e772-476f-4bfd-9416-1c8b269c497d admin admin] Releasing vlan 850 on physical network physnet1 to pool {{(pid=91687) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 20 04:21:43.932872 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-57d6e772-476f-4bfd-9416-1c8b269c497d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1501910', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-4162285'] for segment, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:43.956090 dv-cinder-790910-4-iscsi neutron-server[91687]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead
May 20 04:21:43.956090 dv-cinder-790910-4-iscsi neutron-server[91687]:   from cryptography.utils import int_from_bytes
May 20 04:21:43.956090 dv-cinder-790910-4-iscsi neutron-server[91687]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead
May 20 04:21:43.956090 dv-cinder-790910-4-iscsi neutron-server[91687]:   from cryptography.utils import int_from_bytes
May 20 04:21:43.956090 dv-cinder-790910-4-iscsi neutron-server[91687]: Traceback (most recent call last):
May 20 04:21:43.956090 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 20 04:21:43.956090 dv-cinder-790910-4-iscsi neutron-server[91687]:     timer()
May 20 04:21:43.956090 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 20 04:21:43.956090 dv-cinder-790910-4-iscsi neutron-server[91687]:     cb(*args, **kw)
May 20 04:21:43.956090 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 20 04:21:43.956090 dv-cinder-790910-4-iscsi neutron-server[91687]:     return func(*args, **kwargs)
May 20 04:21:43.956090 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 20 04:21:43.956090 dv-cinder-790910-4-iscsi neutron-server[91687]:     self._notify()
May 20 04:21:43.956090 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 20 04:21:43.956090 dv-cinder-790910-4-iscsi neutron-server[91687]:     self.callback(batched_events)
May 20 04:21:43.956090 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 20 04:21:43.956090 dv-cinder-790910-4-iscsi neutron-server[91687]:     event.method(event)
May 20 04:21:43.956090 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 20 04:21:43.956090 dv-cinder-790910-4-iscsi neutron-server[91687]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 20 04:21:43.956090 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 20 04:21:43.956090 dv-cinder-790910-4-iscsi neutron-server[91687]:     aggregate_uuid = self.p_client.list_aggregates(
May 20 04:21:43.956090 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 20 04:21:43.956090 dv-cinder-790910-4-iscsi neutron-server[91687]:     return f(self, *a, **k)
May 20 04:21:43.956090 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 20 04:21:43.956090 dv-cinder-790910-4-iscsi neutron-server[91687]:     return self._get(url).json()
May 20 04:21:43.956090 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 20 04:21:43.956090 dv-cinder-790910-4-iscsi neutron-server[91687]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 20 04:21:43.956090 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 20 04:21:43.956090 dv-cinder-790910-4-iscsi neutron-server[91687]:     return self.request(url, 'GET', **kwargs)
May 20 04:21:43.956090 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 20 04:21:43.956090 dv-cinder-790910-4-iscsi neutron-server[91687]:     base_url = self.get_endpoint(auth, allow=allow,
May 20 04:21:43.956090 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 20 04:21:43.956090 dv-cinder-790910-4-iscsi neutron-server[91687]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 20 04:21:43.956090 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 20 04:21:43.956090 dv-cinder-790910-4-iscsi neutron-server[91687]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 20 04:21:43.956090 dv-cinder-790910-4-iscsi neutron-server[91687]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 20 04:21:43.974877 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 35754) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:21:44.000293 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-b9a5c3a7-7ee2-4595-a5e3-9292c0e2a317 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:44.147916 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-b9a5c3a7-7ee2-4595-a5e3-9292c0e2a317 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:21:44.160049 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-4c886a56-584b-461b-9575-e692d7d651ff req-ff2ce4a5-52db-4f53-85f6-9ecd973bb90d tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Unset dirty status for tenant:b7d86d894a5f420e86f4c28d7772bd22 on resource:network {{(pid=91687) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:21:44.172646 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4c886a56-584b-461b-9575-e692d7d651ff req-ff2ce4a5-52db-4f53-85f6-9ecd973bb90d tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/networks?id=348b2b0f-c826-45ab-ba85-8430235b9cac HTTP/1.1" status: 200  len: 819 time: 1.3718812
May 20 04:21:44.192311 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-b9a5c3a7-7ee2-4595-a5e3-9292c0e2a317 admin admin] Usage tracker for resource:security_group_rule and tenant:a9b094418f954baa95c839dceed73650 is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:21:44.197258 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-08a19c1e-311e-4bc1-a3fc-5754bbbd701e req-933e15d9-266d-47cb-90b1-4870aa4ce70a service neutron] 10.222.0.71 "GET /v2.0/networks/21794e86-fda7-40a6-a5a8-db117c7eeb9d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.5159912
May 20 04:21:44.210182 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4c886a56-584b-461b-9575-e692d7d651ff req-589355a1-4121-4f36-afa5-9878315306d6 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/quotas/b7d86d894a5f420e86f4c28d7772bd22 HTTP/1.1" status: 200  len: 375 time: 0.0357773
May 20 04:21:44.217084 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-b9a5c3a7-7ee2-4595-a5e3-9292c0e2a317 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:21:44.337193 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-57d6e772-476f-4bfd-9416-1c8b269c497d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1505543', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1590664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1781430', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1713996'] for network, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:44.340231 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-b9a5c3a7-7ee2-4595-a5e3-9292c0e2a317 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:21:44.386379 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-25c3ba7c-b49d-44f8-b540-7ea6373ee96b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:44.436615 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-57d6e772-476f-4bfd-9416-1c8b269c497d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for network, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:44.457155 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57d6e772-476f-4bfd-9416-1c8b269c497d admin admin] Pushing event deleted for resources: {'Network': ['ID=0ce28fd5-15fe-4fee-ac41-386db9383364,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:44.478948 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-57d6e772-476f-4bfd-9416-1c8b269c497d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:44.490872 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-57d6e772-476f-4bfd-9416-1c8b269c497d admin admin] 10.222.0.71 "DELETE /v2.0/networks/0ce28fd5-15fe-4fee-ac41-386db9383364 HTTP/1.1" status: 204  len: 168 time: 2.0989392
May 20 04:21:44.573908 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4c886a56-584b-461b-9575-e692d7d651ff req-5f447be9-199e-4592-a702-0901df80e19d tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?tenant_id=b7d86d894a5f420e86f4c28d7772bd22&fields=id HTTP/1.1" status: 200  len: 255 time: 0.3398495
May 20 04:21:44.722548 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e296758e-1212-4ed3-b929-64e3374201fa req-3f6c1184-10c5-406a-b119-2026d2e71825 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:21:44.743220 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-e296758e-1212-4ed3-b929-64e3374201fa req-3f6c1184-10c5-406a-b119-2026d2e71825 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/ports?device_id=20a6d6ed-f811-42fd-8b44-ab4c031330e7 HTTP/1.1" status: 200  len: 943 time: 0.2191734
May 20 04:21:44.772138 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-b9a5c3a7-7ee2-4595-a5e3-9292c0e2a317 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:44.785043 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-b9a5c3a7-7ee2-4595-a5e3-9292c0e2a317 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:44.825465 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:44.862925 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 35788) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:21:44.863461 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-b9a5c3a7-7ee2-4595-a5e3-9292c0e2a317 admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=a9b094418f954baa95c839dceed73650&name=default HTTP/1.1" status: 200  len: 2979 time: 0.8875074
May 20 04:21:44.883519 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 35794) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:21:44.906177 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a5c3a7-7ee2-4595-a5e3-9292c0e2a317 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f9bca23c-88fa-4066-823e-cc45504cbea9,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:44.912289 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-b9a5c3a7-7ee2-4595-a5e3-9292c0e2a317 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:44.924284 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [req-e296758e-1212-4ed3-b929-64e3374201fa req-01ba56a9-a236-4ae7-ac90-d9bf979a72da tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Synchronizing usage tracker for tenant:b6214ee7a3fe4823b9db71f53439835e on resource:security_group {{(pid=91686) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:21:45.010104 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-3f9b5bad-b0b8-4729-bb73-473e91de1191 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:45.017671 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-52f0bf26-d2c3-47f3-aacc-17c161b2bc88 admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=67505d01c5a94fe5aa463aefc8bec9da&name=default HTTP/1.1" status: 200  len: 2975 time: 0.1512818
May 20 04:21:45.020224 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [req-e296758e-1212-4ed3-b929-64e3374201fa req-01ba56a9-a236-4ae7-ac90-d9bf979a72da tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Unset dirty status for tenant:b6214ee7a3fe4823b9db71f53439835e on resource:security_group {{(pid=91686) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:21:45.031855 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 35800) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:21:45.034723 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-e296758e-1212-4ed3-b929-64e3374201fa req-01ba56a9-a236-4ae7-ac90-d9bf979a72da tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/security-groups?id=a5479633-0923-4a98-9c22-65615d7859f0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2877817
May 20 04:21:45.091289 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-3f9b5bad-b0b8-4729-bb73-473e91de1191 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:45.190477 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-d8a3058a-fbe0-4b0e-b32e-24fd5201e9c7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:45.197622 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [req-4c886a56-584b-461b-9575-e692d7d651ff req-bd01b6a5-e073-42a2-b40c-3ad5b66a6cbc service neutron] http://10.222.0.71:9696/v2.0/extensions returned with HTTP 200 {{(pid=91687) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 20 04:21:45.198811 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4c886a56-584b-461b-9575-e692d7d651ff req-bd01b6a5-e073-42a2-b40c-3ad5b66a6cbc service neutron] 10.222.0.71 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.3265138
May 20 04:21:45.258526 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-3f9b5bad-b0b8-4729-bb73-473e91de1191 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:45.275974 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-d8a3058a-fbe0-4b0e-b32e-24fd5201e9c7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:45.301273 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-7826a9ec-9154-4811-95bd-fd77f77372a3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:45.336090 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f9b5bad-b0b8-4729-bb73-473e91de1191 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f9bca23c-88fa-4066-823e-cc45504cbea9,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:45.402578 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-3f9b5bad-b0b8-4729-bb73-473e91de1191 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:45.404288 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-e1874ecc-1127-453f-a9cb-7c0bb1b6a493 req-efc3422f-0000-44b2-9f9e-cf13e7c310e5 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 210 time: 0.2220175
May 20 04:21:45.430794 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-3f9b5bad-b0b8-4729-bb73-473e91de1191 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:45.436043 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-3f9b5bad-b0b8-4729-bb73-473e91de1191 admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/f9bca23c-88fa-4066-823e-cc45504cbea9 HTTP/1.1" status: 204  len: 168 time: 0.5446720
May 20 04:21:45.500792 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4c886a56-584b-461b-9575-e692d7d651ff req-b2641b57-5838-4878-99f8-cc96f3e9e2c3 service neutron] 10.222.0.71 "GET /v2.0/networks/348b2b0f-c826-45ab-ba85-8430235b9cac?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2748604
May 20 04:21:45.517563 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 35814) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:21:45.547162 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-d8a3058a-fbe0-4b0e-b32e-24fd5201e9c7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:45.568414 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:45.650310 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8a3058a-fbe0-4b0e-b32e-24fd5201e9c7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=de1a690a-0045-412a-b705-2cf7abe6681b,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:45.657693 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-d8a3058a-fbe0-4b0e-b32e-24fd5201e9c7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:45.661720 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-d8a3058a-fbe0-4b0e-b32e-24fd5201e9c7 admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/de1a690a-0045-412a-b705-2cf7abe6681b HTTP/1.1" status: 204  len: 168 time: 0.6287487
May 20 04:21:45.665463 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-d8a3058a-fbe0-4b0e-b32e-24fd5201e9c7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.097s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:45.734913 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4c886a56-584b-461b-9575-e692d7d651ff req-d9deff0d-a527-40c4-8620-f480feaec3b9 service neutron] 10.222.0.71 "GET /v2.0/networks/348b2b0f-c826-45ab-ba85-8430235b9cac?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2216885
May 20 04:21:45.760873 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-8cc9b601-41b7-4373-a29c-633640204d64 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:45.783182 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-8cc9b601-41b7-4373-a29c-633640204d64 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:21:45.792034 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-8cc9b601-41b7-4373-a29c-633640204d64 admin admin] Usage tracker for resource:security_group_rule and tenant:2b7654b2f2f7487e891e1b4c4f76f80a is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:21:45.806542 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-8cc9b601-41b7-4373-a29c-633640204d64 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:21:45.818761 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-8cc9b601-41b7-4373-a29c-633640204d64 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:21:46.024994 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-8cc9b601-41b7-4373-a29c-633640204d64 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:46.034299 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-8cc9b601-41b7-4373-a29c-633640204d64 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:46.058089 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:46.142884 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-8cc9b601-41b7-4373-a29c-633640204d64 admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=2b7654b2f2f7487e891e1b4c4f76f80a&name=default HTTP/1.1" status: 200  len: 2979 time: 0.6238971
May 20 04:21:46.145682 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8cc9b601-41b7-4373-a29c-633640204d64 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=53891c77-9b53-4978-b4a7-202433b41a47,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:46.146399 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 35846) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:21:46.149934 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-8cc9b601-41b7-4373-a29c-633640204d64 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:46.388079 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-5684b413-b616-4e60-b567-ef2ce16504e4 req-908c3d54-321d-4157-8345-e03698489012 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 210 time: 0.1695683
May 20 04:21:46.421078 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-fef1e47c-3250-41c9-892b-b418ccc6784a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:46.436651 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 35854) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:21:46.544414 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-fef1e47c-3250-41c9-892b-b418ccc6784a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:46.644919 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-aa561ecb-496a-47b1-8079-8e4a5622fc32 req-dd44239a-e3d4-4957-9907-2a48d3f09da1 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Synchronizing usage tracker for tenant:ef3bec4745b14484ac8e21cd16cbd11d on resource:port {{(pid=91687) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:21:46.699535 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-aa561ecb-496a-47b1-8079-8e4a5622fc32 req-dd44239a-e3d4-4957-9907-2a48d3f09da1 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Unset dirty status for tenant:ef3bec4745b14484ac8e21cd16cbd11d on resource:port {{(pid=91687) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:21:46.701574 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-aa561ecb-496a-47b1-8079-8e4a5622fc32 req-dd44239a-e3d4-4957-9907-2a48d3f09da1 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 210 time: 0.1402996
May 20 04:21:46.731748 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 35866) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:21:46.742709 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-7304a650-4692-424c-bd6e-940e1b0ed862 admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=f19de276d4f943ce8aa2bdc4930890d1&name=default HTTP/1.1" status: 200  len: 2975 time: 0.3022065
May 20 04:21:46.761702 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-fef1e47c-3250-41c9-892b-b418ccc6784a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:46.773203 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-86d3114d-8ad3-4980-a2dc-8bf3a3469b6b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:46.803878 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fef1e47c-3250-41c9-892b-b418ccc6784a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=53891c77-9b53-4978-b4a7-202433b41a47,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:46.805578 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20e2320d-fdd4-4b43-b4a4-9207a696b6c6 req-e59d50eb-4561-4c05-bebf-a4b0c7bc0f40 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:21:46.813269 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-20e2320d-fdd4-4b43-b4a4-9207a696b6c6 req-e59d50eb-4561-4c05-bebf-a4b0c7bc0f40 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/ports?device_id=20a6d6ed-f811-42fd-8b44-ab4c031330e7 HTTP/1.1" status: 200  len: 943 time: 0.3407478
May 20 04:21:46.826608 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-fef1e47c-3250-41c9-892b-b418ccc6784a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:46.952010 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-20e2320d-fdd4-4b43-b4a4-9207a696b6c6 req-f34f0664-ca35-4034-a686-ed6ff631e0cc tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/security-groups?id=a5479633-0923-4a98-9c22-65615d7859f0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0978060
May 20 04:21:46.987420 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-fef1e47c-3250-41c9-892b-b418ccc6784a admin admin] Notify callbacks [] for security_group, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:46.991555 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-fef1e47c-3250-41c9-892b-b418ccc6784a admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/53891c77-9b53-4978-b4a7-202433b41a47 HTTP/1.1" status: 204  len: 168 time: 0.8413677
May 20 04:21:47.076915 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-082fd6a9-3ec5-4d5b-b4ba-9d0321203ea4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:47.119129 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-082fd6a9-3ec5-4d5b-b4ba-9d0321203ea4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:47.143714 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a29b5ab6-2541-493f-a266-5f2fd459002a req-0e87e91f-adab-4b8f-b3ba-45c6b1d98f71 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:21:47.145385 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a29b5ab6-2541-493f-a266-5f2fd459002a req-0e87e91f-adab-4b8f-b3ba-45c6b1d98f71 service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=b6214ee7a3fe4823b9db71f53439835e&device_id=20a6d6ed-f811-42fd-8b44-ab4c031330e7 HTTP/1.1" status: 200  len: 1096 time: 0.3177032
May 20 04:21:47.192016 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-082fd6a9-3ec5-4d5b-b4ba-9d0321203ea4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:47.196246 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:47.292232 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a29b5ab6-2541-493f-a266-5f2fd459002a req-1566c4f5-13c4-4a39-aacc-7149437b01a6 service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=49f0e77b-6589-4f2f-9f47-7eb071a38ce6 HTTP/1.1" status: 200  len: 217 time: 0.0734239
May 20 04:21:47.295591 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-082fd6a9-3ec5-4d5b-b4ba-9d0321203ea4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f0a915f3-6df1-4ca9-a949-1a6838dd4596,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:47.299666 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-082fd6a9-3ec5-4d5b-b4ba-9d0321203ea4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:47.315399 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-082fd6a9-3ec5-4d5b-b4ba-9d0321203ea4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:47.316633 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-082fd6a9-3ec5-4d5b-b4ba-9d0321203ea4 admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/f0a915f3-6df1-4ca9-a949-1a6838dd4596 HTTP/1.1" status: 204  len: 168 time: 0.5823433
May 20 04:21:47.396115 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a29b5ab6-2541-493f-a266-5f2fd459002a req-f0f8d77a-ab37-4630-8fbe-592404e94c0b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:21:47.397559 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a29b5ab6-2541-493f-a266-5f2fd459002a req-f0f8d77a-ab37-4630-8fbe-592404e94c0b service neutron] 10.222.0.82 "GET /v2.0/subnets?id=88b525de-7494-46b7-a333-32b76e112ad7 HTTP/1.1" status: 200  len: 852 time: 0.0840154
May 20 04:21:47.538889 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a29b5ab6-2541-493f-a266-5f2fd459002a req-8ac37699-a15a-44ce-91de-dc80812a27a7 service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=4100b38a-1db4-4a6e-9c33-7bcf19c64d59&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1336799
May 20 04:21:47.720075 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-1a66d2bd-eaac-4472-8630-7562629ed074 req-289a496d-f830-4fc7-b23e-1bb059966e54 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 210 time: 0.0669858
May 20 04:21:47.793017 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a29b5ab6-2541-493f-a266-5f2fd459002a req-a7ef91da-59e3-4b3a-8f15-0f0e160f7836 service neutron] 10.222.0.82 "GET /v2.0/networks/4100b38a-1db4-4a6e-9c33-7bcf19c64d59?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2446921
May 20 04:21:47.928773 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 35902) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:21:47.932938 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-0eb4ec85-12f4-459f-95e3-4377d857b2a5 req-f5aede14-2ab0-4331-862b-86278422b7f2 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 210 time: 0.0659869
May 20 04:21:47.957408 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-0ebe9990-3f21-4241-806c-3f17f9d6adf2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:47.977124 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-0ebe9990-3f21-4241-806c-3f17f9d6adf2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:21:47.982565 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-0ebe9990-3f21-4241-806c-3f17f9d6adf2 admin admin] Usage tracker for resource:security_group_rule and tenant:be46a75356f344e39f7be0238d275f5d is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:21:47.987346 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-0ebe9990-3f21-4241-806c-3f17f9d6adf2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:21:47.996819 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-0ebe9990-3f21-4241-806c-3f17f9d6adf2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:21:48.055714 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a29b5ab6-2541-493f-a266-5f2fd459002a req-23be1419-69f2-4d9f-884e-8de04addb49e service neutron] 10.222.0.82 "GET /v2.0/networks/4100b38a-1db4-4a6e-9c33-7bcf19c64d59?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2546542
May 20 04:21:48.307076 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-0ebe9990-3f21-4241-806c-3f17f9d6adf2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:48.313414 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-0ebe9990-3f21-4241-806c-3f17f9d6adf2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:48.325747 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:48.362876 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ebe9990-3f21-4241-806c-3f17f9d6adf2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e65b9b23-fdd0-4583-8520-ae62b9f0a9c1,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:48.369092 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-0ebe9990-3f21-4241-806c-3f17f9d6adf2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:48.393175 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-0ebe9990-3f21-4241-806c-3f17f9d6adf2 admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=be46a75356f344e39f7be0238d275f5d&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4559324
May 20 04:21:48.394876 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 35922) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:21:48.519503 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59467013-ccf1-4956-9a58-7be9d028b61d req-6a8f45d3-34c8-4d39-855c-d65828071065 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:21:48.521317 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-59467013-ccf1-4956-9a58-7be9d028b61d req-6a8f45d3-34c8-4d39-855c-d65828071065 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/ports?device_id=20a6d6ed-f811-42fd-8b44-ab4c031330e7 HTTP/1.1" status: 200  len: 943 time: 0.3019757
May 20 04:21:48.530947 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-8a65cde3-2942-44fe-b807-af84727eb604 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:48.533303 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08a19c1e-311e-4bc1-a3fc-5754bbbd701e req-40fa3d1d-3350-4625-bc38-89113fc24ae0 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:21:48.534614 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-08a19c1e-311e-4bc1-a3fc-5754bbbd701e req-40fa3d1d-3350-4625-bc38-89113fc24ae0 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Synchronizing usage tracker for tenant:ef3bec4745b14484ac8e21cd16cbd11d on resource:network {{(pid=91687) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:21:48.615836 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-59467013-ccf1-4956-9a58-7be9d028b61d req-d758d540-57b4-4ffe-8b5b-10383529d93f tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/security-groups?id=a5479633-0923-4a98-9c22-65615d7859f0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0756586
May 20 04:21:48.619601 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-08a19c1e-311e-4bc1-a3fc-5754bbbd701e req-40fa3d1d-3350-4625-bc38-89113fc24ae0 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Unset dirty status for tenant:ef3bec4745b14484ac8e21cd16cbd11d on resource:network {{(pid=91687) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:21:48.624111 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-8a65cde3-2942-44fe-b807-af84727eb604 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:48.624619 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-08a19c1e-311e-4bc1-a3fc-5754bbbd701e req-40fa3d1d-3350-4625-bc38-89113fc24ae0 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.82 "GET /v2.0/networks?id=21794e86-fda7-40a6-a5a8-db117c7eeb9d HTTP/1.1" status: 200  len: 817 time: 0.3380594
May 20 04:21:48.756817 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-8a65cde3-2942-44fe-b807-af84727eb604 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:48.762043 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:48.777997 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-08a19c1e-311e-4bc1-a3fc-5754bbbd701e req-52c7b86a-3c4c-485e-86b6-bbaca32add05 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Synchronizing usage tracker for tenant:ef3bec4745b14484ac8e21cd16cbd11d on resource:security_group {{(pid=91687) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:21:48.806839 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a65cde3-2942-44fe-b807-af84727eb604 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e65b9b23-fdd0-4583-8520-ae62b9f0a9c1,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:48.813263 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-8a65cde3-2942-44fe-b807-af84727eb604 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:48.828713 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-8a65cde3-2942-44fe-b807-af84727eb604 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:48.830190 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-8a65cde3-2942-44fe-b807-af84727eb604 admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/e65b9b23-fdd0-4583-8520-ae62b9f0a9c1 HTTP/1.1" status: 204  len: 168 time: 0.4356999
May 20 04:21:48.894263 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-08a19c1e-311e-4bc1-a3fc-5754bbbd701e req-52c7b86a-3c4c-485e-86b6-bbaca32add05 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Unset dirty status for tenant:ef3bec4745b14484ac8e21cd16cbd11d on resource:security_group {{(pid=91687) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:21:48.903831 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-08a19c1e-311e-4bc1-a3fc-5754bbbd701e req-52c7b86a-3c4c-485e-86b6-bbaca32add05 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.82 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=ef3bec4745b14484ac8e21cd16cbd11d HTTP/1.1" status: 200  len: 379 time: 0.2706916
May 20 04:21:48.929128 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [req-08a19c1e-311e-4bc1-a3fc-5754bbbd701e req-a5eec27f-4f55-4b60-92aa-299802a3c9f8 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Request body: {'port': {'device_id': 'f32b55e5-d82f-4c9e-a67f-08d83c24cf4d', 'network_id': '21794e86-fda7-40a6-a5a8-db117c7eeb9d', 'admin_state_up': True, 'tenant_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'security_groups': ['4cd34759-6d12-41a3-acb1-798752999d4f']}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:21:49.058211 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-ba28389c-cbd5-4e06-b0fb-e43d0cf90bdf req-15e443bc-22ad-47d2-9fe0-7352ab9514ef tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 210 time: 0.0631564
May 20 04:21:49.342715 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.82', 55101) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:21:49.600297 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c77c87b-f274-48c4-8347-baadd43022b7 req-c757ad2d-8bd5-4217-a92a-7e332af2832c tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:21:49.603518 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-0c77c87b-f274-48c4-8347-baadd43022b7 req-c757ad2d-8bd5-4217-a92a-7e332af2832c tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.82 "GET /v2.0/networks?id=348b2b0f-c826-45ab-ba85-8430235b9cac HTTP/1.1" status: 200  len: 819 time: 0.2579260
May 20 04:21:49.641333 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-5d76b0ad-20f5-45ac-83b4-e658e695dc8e req-70980b4e-fa8e-4a83-9b40-bb0783da78cb tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 210 time: 0.2171559
May 20 04:21:49.664938 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.v2.base [req-0c77c87b-f274-48c4-8347-baadd43022b7 req-aeb1e64d-3311-487d-9486-4ddea3c06c4c tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Request body: {'port': {'device_id': '7fb31908-b5c9-44dd-ab7c-bb06a577e1c8', 'network_id': '348b2b0f-c826-45ab-ba85-8430235b9cac', 'admin_state_up': True, 'tenant_id': 'b7d86d894a5f420e86f4c28d7772bd22'}} {{(pid=91686) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:21:49.773176 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [req-08a19c1e-311e-4bc1-a3fc-5754bbbd701e req-a5eec27f-4f55-4b60-92aa-299802a3c9f8 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:21:49.808747 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [req-08a19c1e-311e-4bc1-a3fc-5754bbbd701e req-a5eec27f-4f55-4b60-92aa-299802a3c9f8 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:21:49.828838 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-08a19c1e-311e-4bc1-a3fc-5754bbbd701e req-a5eec27f-4f55-4b60-92aa-299802a3c9f8 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Made reservation on behalf of ef3bec4745b14484ac8e21cd16cbd11d for: {'port': 1} {{(pid=91687) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 04:21:49.846616 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-08a19c1e-311e-4bc1-a3fc-5754bbbd701e req-a5eec27f-4f55-4b60-92aa-299802a3c9f8 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:50.120724 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [req-0c77c87b-f274-48c4-8347-baadd43022b7 req-aeb1e64d-3311-487d-9486-4ddea3c06c4c tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:21:50.161916 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [req-0c77c87b-f274-48c4-8347-baadd43022b7 req-aeb1e64d-3311-487d-9486-4ddea3c06c4c tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:21:50.207814 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-0c77c87b-f274-48c4-8347-baadd43022b7 req-aeb1e64d-3311-487d-9486-4ddea3c06c4c tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Made reservation on behalf of b7d86d894a5f420e86f4c28d7772bd22 for: {'port': 1} {{(pid=91686) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 04:21:50.212634 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [req-0c77c87b-f274-48c4-8347-baadd43022b7 req-aeb1e64d-3311-487d-9486-4ddea3c06c4c tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:50.221811 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.82', 55106) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:21:50.282838 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-560ee098-253b-4875-bf7c-49b04f55ab93 req-1b7f85f1-c636-4f5b-b5aa-09d977481552 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:21:50.294513 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-560ee098-253b-4875-bf7c-49b04f55ab93 req-1b7f85f1-c636-4f5b-b5aa-09d977481552 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/ports?device_id=20a6d6ed-f811-42fd-8b44-ab4c031330e7 HTTP/1.1" status: 200  len: 943 time: 0.3985374
May 20 04:21:50.536404 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-560ee098-253b-4875-bf7c-49b04f55ab93 req-66c62c2b-13a7-41fb-aae5-79d32d9e29bf tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/security-groups?id=a5479633-0923-4a98-9c22-65615d7859f0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2386711
May 20 04:21:50.592399 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-63f90f0d-14fd-4ab0-a967-93b0028e84d6 req-b3a91ccd-4aff-48cc-95c4-2b5d4fb46a6d tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 210 time: 0.2437978
May 20 04:21:50.619701 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.db_base_plugin_common [req-08a19c1e-311e-4bc1-a3fc-5754bbbd701e req-a5eec27f-4f55-4b60-92aa-299802a3c9f8 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Allocated IP 172.20.0.14 (21794e86-fda7-40a6-a5a8-db117c7eeb9d/06f38702-3d3c-4e25-8f84-85483d1ddf28/115e1bac-cc4d-40b5-b860-798c85c78924) {{(pid=91687) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 04:21:50.780420 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c886a56-584b-461b-9575-e692d7d651ff req-c02bf458-55b2-4f35-b1c7-001648aa7b8d tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:21:50.786950 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4c886a56-584b-461b-9575-e692d7d651ff req-c02bf458-55b2-4f35-b1c7-001648aa7b8d tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.82 "GET /v2.0/networks?id=348b2b0f-c826-45ab-ba85-8430235b9cac HTTP/1.1" status: 200  len: 819 time: 0.5638154
May 20 04:21:50.853416 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.db_base_plugin_common [req-0c77c87b-f274-48c4-8347-baadd43022b7 req-aeb1e64d-3311-487d-9486-4ddea3c06c4c tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Allocated IP 172.20.0.8 (348b2b0f-c826-45ab-ba85-8430235b9cac/b488dc7d-0e70-4e52-9179-7e6c3e4fb0a1/65d523e1-f132-4819-aa42-995ded4a1ad8) {{(pid=91686) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 04:21:50.909612 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [req-4c886a56-584b-461b-9575-e692d7d651ff req-e21289de-30fc-4017-9bee-726c32938eae tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Request body: {'port': {'device_id': '2d35fcf1-2045-41ad-8d43-0b244e5b4d20', 'network_id': '348b2b0f-c826-45ab-ba85-8430235b9cac', 'admin_state_up': True, 'tenant_id': 'b7d86d894a5f420e86f4c28d7772bd22'}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:21:51.044316 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-29812582-dbc7-4fde-bf74-cb56e444315a req-1c3f4f82-67dc-4979-9872-749f50ca26c6 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 210 time: 0.1222060
May 20 04:21:51.449823 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-08a19c1e-311e-4bc1-a3fc-5754bbbd701e req-a5eec27f-4f55-4b60-92aa-299802a3c9f8 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks [] for port, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:51.474082 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [req-4c886a56-584b-461b-9575-e692d7d651ff req-e21289de-30fc-4017-9bee-726c32938eae tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:21:51.496525 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [req-4c886a56-584b-461b-9575-e692d7d651ff req-e21289de-30fc-4017-9bee-726c32938eae tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:21:51.503184 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.provisioning_blocks [req-08a19c1e-311e-4bc1-a3fc-5754bbbd701e req-a5eec27f-4f55-4b60-92aa-299802a3c9f8 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Transition to ACTIVE for port object 115e1bac-cc4d-40b5-b860-798c85c78924 will not be triggered until provisioned by entity DHCP. {{(pid=91687) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:21:51.533471 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-4c886a56-584b-461b-9575-e692d7d651ff req-e21289de-30fc-4017-9bee-726c32938eae tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Made reservation on behalf of b7d86d894a5f420e86f4c28d7772bd22 for: {'port': 1} {{(pid=91687) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 04:21:51.543321 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-4c886a56-584b-461b-9575-e692d7d651ff req-e21289de-30fc-4017-9bee-726c32938eae tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:51.712266 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [req-0c77c87b-f274-48c4-8347-baadd43022b7 req-aeb1e64d-3311-487d-9486-4ddea3c06c4c tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Notify callbacks [] for port, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:51.815808 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-08a19c1e-311e-4bc1-a3fc-5754bbbd701e req-a5eec27f-4f55-4b60-92aa-299802a3c9f8 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8782892106231', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4162192'] for port, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:51.844530 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [req-0c77c87b-f274-48c4-8347-baadd43022b7 req-aeb1e64d-3311-487d-9486-4ddea3c06c4c tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8782892106231', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2145052'] for port, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:51.867485 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:51.913076 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:52.279366 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-08a19c1e-311e-4bc1-a3fc-5754bbbd701e req-a5eec27f-4f55-4b60-92aa-299802a3c9f8 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Network 21794e86-fda7-40a6-a5a8-db117c7eeb9d is already hosted by enough agents. {{(pid=91687) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:21:52.331649 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.base_scheduler [req-08a19c1e-311e-4bc1-a3fc-5754bbbd701e req-a5eec27f-4f55-4b60-92aa-299802a3c9f8 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Resources bound (agent type, host, resource id):  {{(pid=91687) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:21:52.356019 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.l3_dvrscheduler_db [req-08a19c1e-311e-4bc1-a3fc-5754bbbd701e req-a5eec27f-4f55-4b60-92aa-299802a3c9f8 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Received port after_create {{(pid=91687) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 04:21:52.490730 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5eec27f-4f55-4b60-92aa-299802a3c9f8 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Pushing event updated for resources: {'Port': ['ID=115e1bac-cc4d-40b5-b860-798c85c78924,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:52.550165 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-a5eec27f-4f55-4b60-92aa-299802a3c9f8 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.682s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:52.567456 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-0c77c87b-f274-48c4-8347-baadd43022b7 req-aeb1e64d-3311-487d-9486-4ddea3c06c4c tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Network 348b2b0f-c826-45ab-ba85-8430235b9cac is already hosted by enough agents. {{(pid=91686) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:21:52.600680 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.base_scheduler [req-0c77c87b-f274-48c4-8347-baadd43022b7 req-aeb1e64d-3311-487d-9486-4ddea3c06c4c tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Resources bound (agent type, host, resource id):  {{(pid=91686) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:21:52.610304 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-0636341e-41ff-4f19-9742-c356603e9c55 req-6f4aeae6-f77a-44ef-9967-f4fba2db2d21 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 210 time: 0.2735181
May 20 04:21:52.611586 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.l3_dvrscheduler_db [req-0c77c87b-f274-48c4-8347-baadd43022b7 req-aeb1e64d-3311-487d-9486-4ddea3c06c4c tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Received port after_create {{(pid=91686) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 04:21:52.694104 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08a19c1e-311e-4bc1-a3fc-5754bbbd701e req-a5eec27f-4f55-4b60-92aa-299802a3c9f8 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:21:52.694841 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-08a19c1e-311e-4bc1-a3fc-5754bbbd701e req-a5eec27f-4f55-4b60-92aa-299802a3c9f8 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for port, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:52.733479 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.db.api [req-4c886a56-584b-461b-9575-e692d7d651ff req-e21289de-30fc-4017-9bee-726c32938eae tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Retry wrapper got retriable exception: Failed to create a duplicate IpamAllocation: for attribute(s) ['ipamallocations.PRIMARY'] with value(s) 172.20.0.8-50835203-4a9d-4e50-81cf-ffbd662dd4c2 {{(pid=91687) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}}
May 20 04:21:52.733973 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_db.api [req-4c886a56-584b-461b-9575-e692d7d651ff req-e21289de-30fc-4017-9bee-726c32938eae tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.create_port {{(pid=91687) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}}
May 20 04:21:52.740646 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-08a19c1e-311e-4bc1-a3fc-5754bbbd701e req-a5eec27f-4f55-4b60-92aa-299802a3c9f8 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 3.8308525
May 20 04:21:52.759722 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b75725d-8e51-4f22-96f7-95225be4ca33 req-0891fc32-3004-4147-a52d-5c694976483f tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:21:52.762475 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aeb1e64d-3311-487d-9486-4ddea3c06c4c tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Pushing event updated for resources: {'Port': ['ID=65d523e1-f132-4819-aa42-995ded4a1ad8,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:52.770263 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4b75725d-8e51-4f22-96f7-95225be4ca33 req-0891fc32-3004-4147-a52d-5c694976483f tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/ports?device_id=20a6d6ed-f811-42fd-8b44-ab4c031330e7 HTTP/1.1" status: 200  len: 943 time: 0.7737081
May 20 04:21:52.773457 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-aeb1e64d-3311-487d-9486-4ddea3c06c4c tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.860s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:52.845632 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4b75725d-8e51-4f22-96f7-95225be4ca33 req-a8dff7fa-e35f-4980-8b87-8d7a984d2e75 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/security-groups?id=a5479633-0923-4a98-9c22-65615d7859f0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0739233
May 20 04:21:52.865761 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-5a5ab8a9-48f0-479a-84a6-af9c7698ffb2 None None] Provisioning for port 115e1bac-cc4d-40b5-b860-798c85c78924 completed by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:21:52.872735 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-5a5ab8a9-48f0-479a-84a6-af9c7698ffb2 None None] Provisioning complete for port 115e1bac-cc4d-40b5-b860-798c85c78924 triggered by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:21:52.873343 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-5a5ab8a9-48f0-479a-84a6-af9c7698ffb2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:52.884140 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c77c87b-f274-48c4-8347-baadd43022b7 req-aeb1e64d-3311-487d-9486-4ddea3c06c4c tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:21:52.884789 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [req-0c77c87b-f274-48c4-8347-baadd43022b7 req-aeb1e64d-3311-487d-9486-4ddea3c06c4c tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for port, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:52.939780 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-0c77c87b-f274-48c4-8347-baadd43022b7 req-aeb1e64d-3311-487d-9486-4ddea3c06c4c tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 3.2795122
May 20 04:21:52.952482 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb83a4bc-878d-4729-8722-74f242ba794c req-ced33fc8-ae86-4b3e-b1e9-5fbadf0415d6 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:21:52.960274 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-bb83a4bc-878d-4729-8722-74f242ba794c req-ced33fc8-ae86-4b3e-b1e9-5fbadf0415d6 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 932 time: 0.1679826
May 20 04:21:53.002555 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-5a5ab8a9-48f0-479a-84a6-af9c7698ffb2 None None] Port 115e1bac-cc4d-40b5-b860-798c85c78924 cannot update to ACTIVE because it is not bound. {{(pid=91688) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 20 04:21:53.018147 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-bb83a4bc-878d-4729-8722-74f242ba794c req-b82dec46-00ba-4c2b-9339-3906a205a55c tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0563049
May 20 04:21:53.084264 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 36104) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:21:53.236012 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-4c886a56-584b-461b-9575-e692d7d651ff req-e21289de-30fc-4017-9bee-726c32938eae tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:53.380552 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 49f0e77b-6589-4f2f-9f47-7eb071a38ce6 details requested by agent hyperv_hv-cinder-79091 with host hv-cinder-79091 {{(pid=91688) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 20 04:21:53.424866 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-c5f829d9-d469-45a3-8975-b699ce84af96 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:53.445225 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-c5f829d9-d469-45a3-8975-b699ce84af96 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:21:53.449406 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-c5f829d9-d469-45a3-8975-b699ce84af96 admin admin] Usage tracker for resource:security_group_rule and tenant:98073ae035a84b3da0046386bffbf616 is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:21:53.452732 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-c5f829d9-d469-45a3-8975-b699ce84af96 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:21:53.460291 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-c5f829d9-d469-45a3-8975-b699ce84af96 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:21:53.560602 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.db_base_plugin_common [req-4c886a56-584b-461b-9575-e692d7d651ff req-e21289de-30fc-4017-9bee-726c32938eae tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Allocated IP 172.20.0.7 (348b2b0f-c826-45ab-ba85-8430235b9cac/b488dc7d-0e70-4e52-9179-7e6c3e4fb0a1/10fe1059-aa07-4700-a931-76bcfa45b119) {{(pid=91687) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 04:21:53.740836 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port 49f0e77b-6589-4f2f-9f47-7eb071a38ce6, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=49f0e77b-6589-4f2f-9f47-7eb071a38ce6,segment=NetworkSegment(743e4a81-111b-4929-b0d4-50516fe60014),segment_id=743e4a81-111b-4929-b0d4-50516fe60014)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:21:53.801208 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 36130) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:21:53.804284 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Returning: {'device': '49f0e77b-6589-4f2f-9f47-7eb071a38ce6', 'network_id': '4100b38a-1db4-4a6e-9c33-7bcf19c64d59', 'port_id': '49f0e77b-6589-4f2f-9f47-7eb071a38ce6', 'mac_address': 'fa:16:3e:b8:f4:2e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 879, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '88b525de-7494-46b7-a333-32b76e112ad7', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91688) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 20 04:21:53.909051 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:53.948451 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.notifiers.nova [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 49f0e77b-6589-4f2f-9f47-7eb071a38ce6 {{(pid=91688) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 04:21:53.998121 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port 49f0e77b-6589-4f2f-9f47-7eb071a38ce6, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=49f0e77b-6589-4f2f-9f47-7eb071a38ce6,segment=NetworkSegment(743e4a81-111b-4929-b0d4-50516fe60014),segment_id=743e4a81-111b-4929-b0d4-50516fe60014)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:21:54.009993 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:54.013725 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:54.033599 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-16c63a3b-e040-4862-9cf0-fb4a4ed9ddfe admin admin] Notify callbacks [] for security_group, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:54.099333 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Pushing event updated for resources: {'Port': ['ID=49f0e77b-6589-4f2f-9f47-7eb071a38ce6,revision_number=4']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:54.100412 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-16c63a3b-e040-4862-9cf0-fb4a4ed9ddfe admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:21:54.103234 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:54.120345 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-16c63a3b-e040-4862-9cf0-fb4a4ed9ddfe admin admin] Usage tracker for resource:security_group_rule and tenant:764b26e302064cb8b040de821fe6f1cc is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:21:54.128667 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-16c63a3b-e040-4862-9cf0-fb4a4ed9ddfe admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:21:54.158637 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-2beec6c9-f448-4c31-ac2e-33be450bc51f req-931d593f-50e8-4d64-84dc-ca08473c2a91 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Synchronizing usage tracker for tenant:b7d86d894a5f420e86f4c28d7772bd22 on resource:port {{(pid=91687) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:21:54.202365 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-c5f829d9-d469-45a3-8975-b699ce84af96 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:54.203688 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-16c63a3b-e040-4862-9cf0-fb4a4ed9ddfe admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:21:54.212483 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-c5f829d9-d469-45a3-8975-b699ce84af96 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:54.227418 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-082fd6a9-3ec5-4d5b-b4ba-9d0321203ea4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:54.238932 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-2beec6c9-f448-4c31-ac2e-33be450bc51f req-931d593f-50e8-4d64-84dc-ca08473c2a91 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Unset dirty status for tenant:b7d86d894a5f420e86f4c28d7772bd22 on resource:port {{(pid=91687) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:21:54.240136 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-2beec6c9-f448-4c31-ac2e-33be450bc51f req-931d593f-50e8-4d64-84dc-ca08473c2a91 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 210 time: 0.3219564
May 20 04:21:54.311158 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-4c886a56-584b-461b-9575-e692d7d651ff req-e21289de-30fc-4017-9bee-726c32938eae tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Notify callbacks [] for port, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:54.315058 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5f829d9-d469-45a3-8975-b699ce84af96 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0c3d5863-b52c-473d-8db5-3991747ce310,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:54.320985 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-c5f829d9-d469-45a3-8975-b699ce84af96 admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=98073ae035a84b3da0046386bffbf616&name=default HTTP/1.1" status: 200  len: 2979 time: 1.2354085
May 20 04:21:54.322075 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-c5f829d9-d469-45a3-8975-b699ce84af96 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:54.324879 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 36140) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:21:54.353356 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dff44334-a193-4515-ae65-09f0e7139ceb req-de332ad3-c29d-4c57-8d2b-449cd9d40be3 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:21:54.361304 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-dff44334-a193-4515-ae65-09f0e7139ceb req-de332ad3-c29d-4c57-8d2b-449cd9d40be3 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/ports?device_id=20a6d6ed-f811-42fd-8b44-ab4c031330e7 HTTP/1.1" status: 200  len: 944 time: 0.2349424
May 20 04:21:54.365125 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [req-08a19c1e-311e-4bc1-a3fc-5754bbbd701e req-16df77b6-9316-41df-a571-139cc955c831 service neutron] Request body: {'port': {'device_id': 'f32b55e5-d82f-4c9e-a67f-08d83c24cf4d', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79091'}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:21:54.407608 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.v2.base [req-0c77c87b-f274-48c4-8347-baadd43022b7 req-d4420ce5-551e-4faf-a49e-dda3d9cfacd1 service neutron] Request body: {'port': {'device_id': '7fb31908-b5c9-44dd-ab7c-bb06a577e1c8', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79091'}} {{(pid=91686) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:21:54.513464 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-11a703ba-85d0-45ef-8ded-c856a4f4b6b9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:54.518962 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-4c886a56-584b-461b-9575-e692d7d651ff req-e21289de-30fc-4017-9bee-726c32938eae tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8782892106231', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4162192'] for port, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:54.545018 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:54.558380 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-dff44334-a193-4515-ae65-09f0e7139ceb req-9cafb2b8-3db5-4d6a-b0a3-25596fc68b01 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/security-groups?id=a5479633-0923-4a98-9c22-65615d7859f0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1961384
May 20 04:21:54.588717 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-16c63a3b-e040-4862-9cf0-fb4a4ed9ddfe admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:54.589955 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [req-0c77c87b-f274-48c4-8347-baadd43022b7 req-d4420ce5-551e-4faf-a49e-dda3d9cfacd1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:54.602706 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-16c63a3b-e040-4862-9cf0-fb4a4ed9ddfe admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:54.616886 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:54.663004 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-08a19c1e-311e-4bc1-a3fc-5754bbbd701e req-16df77b6-9316-41df-a571-139cc955c831 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:54.691079 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-11a703ba-85d0-45ef-8ded-c856a4f4b6b9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:54.718272 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-16c63a3b-e040-4862-9cf0-fb4a4ed9ddfe admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=764b26e302064cb8b040de821fe6f1cc&name=default HTTP/1.1" status: 200  len: 2979 time: 0.9111192
May 20 04:21:54.720603 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 36146) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:21:54.723545 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16c63a3b-e040-4862-9cf0-fb4a4ed9ddfe admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7904f0e6-f68d-4ff4-a652-87db2712f394,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:54.740561 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-16c63a3b-e040-4862-9cf0-fb4a4ed9ddfe admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:54.768706 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-4c886a56-584b-461b-9575-e692d7d651ff req-e21289de-30fc-4017-9bee-726c32938eae tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Network 348b2b0f-c826-45ab-ba85-8430235b9cac is already hosted by enough agents. {{(pid=91687) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:21:54.872752 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.base_scheduler [req-4c886a56-584b-461b-9575-e692d7d651ff req-e21289de-30fc-4017-9bee-726c32938eae tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Resources bound (agent type, host, resource id):  {{(pid=91687) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:21:54.875256 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e21289de-30fc-4017-9bee-726c32938eae tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Pushing event updated for resources: {'Port': ['ID=10fe1059-aa07-4700-a931-76bcfa45b119,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:54.912412 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-e21289de-30fc-4017-9bee-726c32938eae tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.367s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:54.913584 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.l3_dvrscheduler_db [req-4c886a56-584b-461b-9575-e692d7d651ff req-e21289de-30fc-4017-9bee-726c32938eae tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Received port after_create {{(pid=91687) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 04:21:55.025414 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-11a703ba-85d0-45ef-8ded-c856a4f4b6b9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:55.052140 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:55.110242 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-10ae8269-cdbf-4738-a1a0-9f76c284be9a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:55.117921 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c886a56-584b-461b-9575-e692d7d651ff req-e21289de-30fc-4017-9bee-726c32938eae tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:21:55.118732 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-4c886a56-584b-461b-9575-e692d7d651ff req-e21289de-30fc-4017-9bee-726c32938eae tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for port, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:55.130383 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59f999ab-5b11-4ff7-b1d8-f45954891d72 req-061aebb9-1489-4c26-8df3-5ad3512d9f28 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:21:55.131166 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-59f999ab-5b11-4ff7-b1d8-f45954891d72 req-061aebb9-1489-4c26-8df3-5ad3512d9f28 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Synchronizing usage tracker for tenant:ef3bec4745b14484ac8e21cd16cbd11d on resource:port {{(pid=91687) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:21:55.140744 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11a703ba-85d0-45ef-8ded-c856a4f4b6b9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0c3d5863-b52c-473d-8db5-3991747ce310,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:55.161907 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-11a703ba-85d0-45ef-8ded-c856a4f4b6b9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:55.168325 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-11a703ba-85d0-45ef-8ded-c856a4f4b6b9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:55.173712 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-11a703ba-85d0-45ef-8ded-c856a4f4b6b9 admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/0c3d5863-b52c-473d-8db5-3991747ce310 HTTP/1.1" status: 204  len: 168 time: 0.8440309
May 20 04:21:55.187611 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4c886a56-584b-461b-9575-e692d7d651ff req-e21289de-30fc-4017-9bee-726c32938eae tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 4.3196251
May 20 04:21:55.216132 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-59f999ab-5b11-4ff7-b1d8-f45954891d72 req-061aebb9-1489-4c26-8df3-5ad3512d9f28 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Unset dirty status for tenant:ef3bec4745b14484ac8e21cd16cbd11d on resource:port {{(pid=91687) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:21:55.223090 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-59f999ab-5b11-4ff7-b1d8-f45954891d72 req-061aebb9-1489-4c26-8df3-5ad3512d9f28 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 932 time: 0.6846461
May 20 04:21:55.230996 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-10ae8269-cdbf-4738-a1a0-9f76c284be9a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:55.405693 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.notifiers.nova [req-0c77c87b-f274-48c4-8347-baadd43022b7 req-d4420ce5-551e-4faf-a49e-dda3d9cfacd1 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 65d523e1-f132-4819-aa42-995ded4a1ad8 {{(pid=91686) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 04:21:55.422586 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [req-0c77c87b-f274-48c4-8347-baadd43022b7 req-d4420ce5-551e-4faf-a49e-dda3d9cfacd1 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:55.445793 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-59f999ab-5b11-4ff7-b1d8-f45954891d72 req-fd1c140a-1bf8-43bc-a8aa-49c76c1ef14d tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.2182918
May 20 04:21:55.552545 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.provisioning_blocks [req-0c77c87b-f274-48c4-8347-baadd43022b7 req-d4420ce5-551e-4faf-a49e-dda3d9cfacd1 service neutron] Transition to ACTIVE for port object 65d523e1-f132-4819-aa42-995ded4a1ad8 will not be triggered until provisioned by entity L2. {{(pid=91686) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:21:55.580116 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [req-0c77c87b-f274-48c4-8347-baadd43022b7 req-d4420ce5-551e-4faf-a49e-dda3d9cfacd1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2145029'] for port, after_update {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:55.598003 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:55.772287 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 36178) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:21:55.808688 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.notifiers.nova [req-08a19c1e-311e-4bc1-a3fc-5754bbbd701e req-16df77b6-9316-41df-a571-139cc955c831 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 115e1bac-cc4d-40b5-b860-798c85c78924 {{(pid=91687) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 04:21:55.819275 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-5a5b1279-621d-4345-b99e-1f126d68a250 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:55.831003 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-08a19c1e-311e-4bc1-a3fc-5754bbbd701e req-16df77b6-9316-41df-a571-139cc955c831 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:55.859723 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [req-4c886a56-584b-461b-9575-e692d7d651ff req-58ec3c4d-2fce-4f74-91c4-6ecd46daf319 service neutron] Request body: {'port': {'device_id': '2d35fcf1-2045-41ad-8d43-0b244e5b4d20', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79091'}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:21:55.895917 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.provisioning_blocks [req-08a19c1e-311e-4bc1-a3fc-5754bbbd701e req-16df77b6-9316-41df-a571-139cc955c831 service neutron] Transition to ACTIVE for port object 115e1bac-cc4d-40b5-b860-798c85c78924 will not be triggered until provisioned by entity L2. {{(pid=91687) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:21:55.905568 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-5a5b1279-621d-4345-b99e-1f126d68a250 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:21:55.915193 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-08a19c1e-311e-4bc1-a3fc-5754bbbd701e req-16df77b6-9316-41df-a571-139cc955c831 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4162185'] for port, after_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:55.916424 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-10ae8269-cdbf-4738-a1a0-9f76c284be9a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:55.932457 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-5a5b1279-621d-4345-b99e-1f126d68a250 admin admin] Usage tracker for resource:security_group_rule and tenant:be64ed363cb647e29d494fb95246a74d is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:21:55.939891 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-5a5b1279-621d-4345-b99e-1f126d68a250 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:21:55.945255 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:56.025335 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16df77b6-9316-41df-a571-139cc955c831 service neutron] Pushing event updated for resources: {'Port': ['ID=115e1bac-cc4d-40b5-b860-798c85c78924,revision_number=2']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:56.030416 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-5a5b1279-621d-4345-b99e-1f126d68a250 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:21:56.042856 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-16df77b6-9316-41df-a571-139cc955c831 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:56.177157 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4420ce5-551e-4faf-a49e-dda3d9cfacd1 service neutron] Pushing event updated for resources: {'Port': ['ID=65d523e1-f132-4819-aa42-995ded4a1ad8,revision_number=2']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:56.182973 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-d4420ce5-551e-4faf-a49e-dda3d9cfacd1 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.586s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:56.195778 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.245s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:56.207786 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-4c886a56-584b-461b-9575-e692d7d651ff req-58ec3c4d-2fce-4f74-91c4-6ecd46daf319 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:56.213032 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-10ae8269-cdbf-4738-a1a0-9f76c284be9a admin admin] Notify callbacks [] for security_group, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:56.215553 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-10ae8269-cdbf-4738-a1a0-9f76c284be9a admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/7904f0e6-f68d-4ff4-a652-87db2712f394 HTTP/1.1" status: 204  len: 168 time: 1.4937549
May 20 04:21:56.257746 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10ae8269-cdbf-4738-a1a0-9f76c284be9a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7904f0e6-f68d-4ff4-a652-87db2712f394,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:56.263081 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-10ae8269-cdbf-4738-a1a0-9f76c284be9a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.067s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:56.293643 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3a3f515-5058-41f1-b45f-4428eefbff52 req-22b0050e-b4b6-4618-9f0d-d2431b0c9403 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:21:56.308145 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-c3a3f515-5058-41f1-b45f-4428eefbff52 req-22b0050e-b4b6-4618-9f0d-d2431b0c9403 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/ports?device_id=20a6d6ed-f811-42fd-8b44-ab4c031330e7 HTTP/1.1" status: 200  len: 944 time: 0.5851564
May 20 04:21:56.335029 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf843369-b0f5-46cd-b6ce-bdefa517426e req-a2c9dd38-d9cb-42b3-8691-4f8ce8343d55 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:21:56.336926 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [req-cf843369-b0f5-46cd-b6ce-bdefa517426e req-a2c9dd38-d9cb-42b3-8691-4f8ce8343d55 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Synchronizing usage tracker for tenant:b7d86d894a5f420e86f4c28d7772bd22 on resource:port {{(pid=91686) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:21:56.413047 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [req-cf843369-b0f5-46cd-b6ce-bdefa517426e req-a2c9dd38-d9cb-42b3-8691-4f8ce8343d55 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Unset dirty status for tenant:b7d86d894a5f420e86f4c28d7772bd22 on resource:port {{(pid=91686) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:21:56.415379 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-cf843369-b0f5-46cd-b6ce-bdefa517426e req-a2c9dd38-d9cb-42b3-8691-4f8ce8343d55 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 931 time: 0.9340370
May 20 04:21:56.431263 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.managers [req-0c77c87b-f274-48c4-8347-baadd43022b7 req-d4420ce5-551e-4faf-a49e-dda3d9cfacd1 service neutron] Attempting to bind port 65d523e1-f132-4819-aa42-995ded4a1ad8 on host hv-cinder-79091 for vnic_type normal with profile  {{(pid=91686) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 04:21:56.431932 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.managers [req-0c77c87b-f274-48c4-8347-baadd43022b7 req-d4420ce5-551e-4faf-a49e-dda3d9cfacd1 service neutron] Attempting to bind port 65d523e1-f132-4819-aa42-995ded4a1ad8 by drivers openvswitch,hyperv on host hv-cinder-79091 at level 0 using segments [{'id': '9d2ee761-256d-4e66-82a3-ef6e5bd352c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '348b2b0f-c826-45ab-ba85-8430235b9cac'}] {{(pid=91686) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 04:21:56.432424 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0c77c87b-f274-48c4-8347-baadd43022b7 req-d4420ce5-551e-4faf-a49e-dda3d9cfacd1 service neutron] Attempting to bind port 65d523e1-f132-4819-aa42-995ded4a1ad8 on network 348b2b0f-c826-45ab-ba85-8430235b9cac {{(pid=91686) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:21:56.475266 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0c77c87b-f274-48c4-8347-baadd43022b7 req-d4420ce5-551e-4faf-a49e-dda3d9cfacd1 service neutron] Port 65d523e1-f132-4819-aa42-995ded4a1ad8 on network 348b2b0f-c826-45ab-ba85-8430235b9cac not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79091 {{(pid=91686) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 20 04:21:56.476294 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0c77c87b-f274-48c4-8347-baadd43022b7 req-d4420ce5-551e-4faf-a49e-dda3d9cfacd1 service neutron] Attempting to bind port 65d523e1-f132-4819-aa42-995ded4a1ad8 on network 348b2b0f-c826-45ab-ba85-8430235b9cac {{(pid=91686) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:21:56.492986 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0c77c87b-f274-48c4-8347-baadd43022b7 req-d4420ce5-551e-4faf-a49e-dda3d9cfacd1 service neutron] Checking agent: {'id': '7cc947fd-92eb-4d43-ad6b-ea002afff217', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79091', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 4, 19, 34), 'started_at': datetime.datetime(2021, 5, 20, 4, 19, 34), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 4, 21, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91686) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 04:21:56.493559 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0c77c87b-f274-48c4-8347-baadd43022b7 req-d4420ce5-551e-4faf-a49e-dda3d9cfacd1 service neutron] Checking segment: {'id': '9d2ee761-256d-4e66-82a3-ef6e5bd352c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '348b2b0f-c826-45ab-ba85-8430235b9cac'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91686) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:21:56.494472 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0c77c87b-f274-48c4-8347-baadd43022b7 req-d4420ce5-551e-4faf-a49e-dda3d9cfacd1 service neutron] Bound using segment: {'id': '9d2ee761-256d-4e66-82a3-ef6e5bd352c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '348b2b0f-c826-45ab-ba85-8430235b9cac'} {{(pid=91686) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 04:21:56.495267 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.managers [req-0c77c87b-f274-48c4-8347-baadd43022b7 req-d4420ce5-551e-4faf-a49e-dda3d9cfacd1 service neutron] Bound port: 65d523e1-f132-4819-aa42-995ded4a1ad8, host: hv-cinder-79091, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '9d2ee761-256d-4e66-82a3-ef6e5bd352c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '348b2b0f-c826-45ab-ba85-8430235b9cac'}}] {{(pid=91686) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 04:21:56.495851 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [req-0c77c87b-f274-48c4-8347-baadd43022b7 req-d4420ce5-551e-4faf-a49e-dda3d9cfacd1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:56.605291 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-cf843369-b0f5-46cd-b6ce-bdefa517426e req-94beb8b6-a07f-4855-b5e2-5ac665befbff tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1753247
May 20 04:21:56.607614 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-c3a3f515-5058-41f1-b45f-4428eefbff52 req-28e067a3-8c7c-4f52-90f9-fd2eda9535da tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/security-groups?id=a5479633-0923-4a98-9c22-65615d7859f0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2984185
May 20 04:21:56.768224 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.db [req-0c77c87b-f274-48c4-8347-baadd43022b7 req-d4420ce5-551e-4faf-a49e-dda3d9cfacd1 service neutron] For port 65d523e1-f132-4819-aa42-995ded4a1ad8, host hv-cinder-79091, cleared binding levels {{(pid=91686) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 04:21:56.779688 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.db [req-0c77c87b-f274-48c4-8347-baadd43022b7 req-d4420ce5-551e-4faf-a49e-dda3d9cfacd1 service neutron] For port 65d523e1-f132-4819-aa42-995ded4a1ad8, host hv-cinder-79091, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=65d523e1-f132-4819-aa42-995ded4a1ad8,segment=NetworkSegment(9d2ee761-256d-4e66-82a3-ef6e5bd352c1),segment_id=9d2ee761-256d-4e66-82a3-ef6e5bd352c1)] {{(pid=91686) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 04:21:56.789037 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [req-0c77c87b-f274-48c4-8347-baadd43022b7 req-d4420ce5-551e-4faf-a49e-dda3d9cfacd1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2145029'] for port, after_update {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:56.803722 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:56.813821 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] get_ports_and_sgs() called for port_ids ['49f0e77b-6589-4f2f-9f47-7eb071a38ce6'] {{(pid=91688) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 04:21:56.906295 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c77c87b-f274-48c4-8347-baadd43022b7 req-d4420ce5-551e-4faf-a49e-dda3d9cfacd1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:21:56.907421 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [req-0c77c87b-f274-48c4-8347-baadd43022b7 req-d4420ce5-551e-4faf-a49e-dda3d9cfacd1 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for port, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:56.909285 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-0c77c87b-f274-48c4-8347-baadd43022b7 req-d4420ce5-551e-4faf-a49e-dda3d9cfacd1 service neutron] 10.222.0.82 "PUT /v2.0/ports/65d523e1-f132-4819-aa42-995ded4a1ad8 HTTP/1.1" status: 200  len: 1093 time: 2.5438876
May 20 04:21:56.910097 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7fb31908-b5c9-44dd-ab7c-bb06a577e1c8', 'tag': '65d523e1-f132-4819-aa42-995ded4a1ad8'}] {{(pid=91686) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:21:57.089346 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 36200) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:21:57.126217 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4420ce5-551e-4faf-a49e-dda3d9cfacd1 service neutron] Pushing event updated for resources: {'Port': ['ID=65d523e1-f132-4819-aa42-995ded4a1ad8,revision_number=3']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:57.282241 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-d4420ce5-551e-4faf-a49e-dda3d9cfacd1 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.478s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:57.304177 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-13027643-ab6e-465b-ad4a-9937d69103db admin admin] Notify callbacks [] for security_group, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:57.306020 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.managers [req-08a19c1e-311e-4bc1-a3fc-5754bbbd701e req-16df77b6-9316-41df-a571-139cc955c831 service neutron] Attempting to bind port 115e1bac-cc4d-40b5-b860-798c85c78924 on host hv-cinder-79091 for vnic_type normal with profile  {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 04:21:57.306810 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.managers [req-08a19c1e-311e-4bc1-a3fc-5754bbbd701e req-16df77b6-9316-41df-a571-139cc955c831 service neutron] Attempting to bind port 115e1bac-cc4d-40b5-b860-798c85c78924 by drivers openvswitch,hyperv on host hv-cinder-79091 at level 0 using segments [{'id': '9521f383-6017-4b4d-9f47-cff4ed54cb57', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 864, 'network_id': '21794e86-fda7-40a6-a5a8-db117c7eeb9d'}] {{(pid=91687) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 04:21:57.308017 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-08a19c1e-311e-4bc1-a3fc-5754bbbd701e req-16df77b6-9316-41df-a571-139cc955c831 service neutron] Attempting to bind port 115e1bac-cc4d-40b5-b860-798c85c78924 on network 21794e86-fda7-40a6-a5a8-db117c7eeb9d {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:21:57.324006 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-5a5b1279-621d-4345-b99e-1f126d68a250 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:57.327170 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-13027643-ab6e-465b-ad4a-9937d69103db admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:21:57.336243 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-08a19c1e-311e-4bc1-a3fc-5754bbbd701e req-16df77b6-9316-41df-a571-139cc955c831 service neutron] Port 115e1bac-cc4d-40b5-b860-798c85c78924 on network 21794e86-fda7-40a6-a5a8-db117c7eeb9d not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79091 {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 20 04:21:57.336740 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-08a19c1e-311e-4bc1-a3fc-5754bbbd701e req-16df77b6-9316-41df-a571-139cc955c831 service neutron] Attempting to bind port 115e1bac-cc4d-40b5-b860-798c85c78924 on network 21794e86-fda7-40a6-a5a8-db117c7eeb9d {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:21:57.347344 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-13027643-ab6e-465b-ad4a-9937d69103db admin admin] Usage tracker for resource:security_group_rule and tenant:2d52d985777b481b9607a7241a1d3541 is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:21:57.349855 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-5a5b1279-621d-4345-b99e-1f126d68a250 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:57.351910 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-13027643-ab6e-465b-ad4a-9937d69103db admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:21:57.358983 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-08a19c1e-311e-4bc1-a3fc-5754bbbd701e req-16df77b6-9316-41df-a571-139cc955c831 service neutron] Checking agent: {'id': '7cc947fd-92eb-4d43-ad6b-ea002afff217', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79091', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 4, 19, 34), 'started_at': datetime.datetime(2021, 5, 20, 4, 19, 34), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 4, 21, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 04:21:57.359513 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-08a19c1e-311e-4bc1-a3fc-5754bbbd701e req-16df77b6-9316-41df-a571-139cc955c831 service neutron] Checking segment: {'id': '9521f383-6017-4b4d-9f47-cff4ed54cb57', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 864, 'network_id': '21794e86-fda7-40a6-a5a8-db117c7eeb9d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91687) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:21:57.360209 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-08a19c1e-311e-4bc1-a3fc-5754bbbd701e req-16df77b6-9316-41df-a571-139cc955c831 service neutron] Bound using segment: {'id': '9521f383-6017-4b4d-9f47-cff4ed54cb57', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 864, 'network_id': '21794e86-fda7-40a6-a5a8-db117c7eeb9d'} {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 04:21:57.361173 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.managers [req-08a19c1e-311e-4bc1-a3fc-5754bbbd701e req-16df77b6-9316-41df-a571-139cc955c831 service neutron] Bound port: 115e1bac-cc4d-40b5-b860-798c85c78924, host: hv-cinder-79091, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '9521f383-6017-4b4d-9f47-cff4ed54cb57', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 864, 'network_id': '21794e86-fda7-40a6-a5a8-db117c7eeb9d'}}] {{(pid=91687) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 04:21:57.361929 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-08a19c1e-311e-4bc1-a3fc-5754bbbd701e req-16df77b6-9316-41df-a571-139cc955c831 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:57.363914 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-13027643-ab6e-465b-ad4a-9937d69103db admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:21:57.413358 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:57.459283 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c77c87b-f274-48c4-8347-baadd43022b7 req-d1636997-a400-4803-992e-17a8e7e3f07e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:21:57.461403 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-0c77c87b-f274-48c4-8347-baadd43022b7 req-d1636997-a400-4803-992e-17a8e7e3f07e service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=b7d86d894a5f420e86f4c28d7772bd22&device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 1096 time: 0.4848371
May 20 04:21:57.597162 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-0c77c87b-f274-48c4-8347-baadd43022b7 req-9a6dcc9b-f5ac-4da0-a743-231b2c25ca9c service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=65d523e1-f132-4819-aa42-995ded4a1ad8 HTTP/1.1" status: 200  len: 217 time: 0.1228108
May 20 04:21:57.726363 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a5b1279-621d-4345-b99e-1f126d68a250 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9cd5b503-2cb3-4626-b00b-0da0b6b0d73a,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:57.732842 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c77c87b-f274-48c4-8347-baadd43022b7 req-b4fbd79a-742c-4d11-824d-6337723e5253 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:21:57.734694 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-0c77c87b-f274-48c4-8347-baadd43022b7 req-b4fbd79a-742c-4d11-824d-6337723e5253 service neutron] 10.222.0.82 "GET /v2.0/subnets?id=b488dc7d-0e70-4e52-9179-7e6c3e4fb0a1 HTTP/1.1" status: 200  len: 859 time: 0.1276023
May 20 04:21:57.739913 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-5a5b1279-621d-4345-b99e-1f126d68a250 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.326s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:57.753344 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-5a5b1279-621d-4345-b99e-1f126d68a250 admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=be64ed363cb647e29d494fb95246a74d&name=default HTTP/1.1" status: 200  len: 2979 time: 1.9740300
May 20 04:21:57.757967 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 36236) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:21:57.761328 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.notifiers.nova [req-4c886a56-584b-461b-9575-e692d7d651ff req-58ec3c4d-2fce-4f74-91c4-6ecd46daf319 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 10fe1059-aa07-4700-a931-76bcfa45b119 {{(pid=91687) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 04:21:57.824104 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-0c77c87b-f274-48c4-8347-baadd43022b7 req-65e91a4d-616b-4041-9a5c-e1b957ff482f service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=348b2b0f-c826-45ab-ba85-8430235b9cac&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0772116
May 20 04:21:57.824702 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c516c9e-82fd-4f58-8395-4f29abac4cec req-ddddd774-8266-4e73-adc9-8e1a1131a0fe tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:21:57.827235 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-6c516c9e-82fd-4f58-8395-4f29abac4cec req-ddddd774-8266-4e73-adc9-8e1a1131a0fe tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 944 time: 1.0792501
May 20 04:21:57.845433 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-4c886a56-584b-461b-9575-e692d7d651ff req-58ec3c4d-2fce-4f74-91c4-6ecd46daf319 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:57.862469 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-13027643-ab6e-465b-ad4a-9937d69103db admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:57.889727 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-13027643-ab6e-465b-ad4a-9937d69103db admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:57.922730 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.003s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:57.948110 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7fb31908-b5c9-44dd-ab7c-bb06a577e1c8', 'tag': '65d523e1-f132-4819-aa42-995ded4a1ad8', 'status': 'completed', 'code': 200}
May 20 04:21:57.978890 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.provisioning_blocks [req-4c886a56-584b-461b-9575-e692d7d651ff req-58ec3c4d-2fce-4f74-91c4-6ecd46daf319 service neutron] Transition to ACTIVE for port object 10fe1059-aa07-4700-a931-76bcfa45b119 will not be triggered until provisioned by entity L2. {{(pid=91687) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:21:58.025214 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [req-08a19c1e-311e-4bc1-a3fc-5754bbbd701e req-16df77b6-9316-41df-a571-139cc955c831 service neutron] For port 115e1bac-cc4d-40b5-b860-798c85c78924, host hv-cinder-79091, cleared binding levels {{(pid=91687) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 04:21:58.031757 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-4c886a56-584b-461b-9575-e692d7d651ff req-58ec3c4d-2fce-4f74-91c4-6ecd46daf319 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4162185'] for port, after_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:58.082223 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-6c516c9e-82fd-4f58-8395-4f29abac4cec req-d0ccf2d8-5200-403e-a728-c9bcfa93f8cf tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.2215209
May 20 04:21:58.089799 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:58.104407 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13027643-ab6e-465b-ad4a-9937d69103db admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c704f769-643d-4d63-82c4-e85ee48653a2,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:58.127939 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-13027643-ab6e-465b-ad4a-9937d69103db admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=2d52d985777b481b9607a7241a1d3541&name=default HTTP/1.1" status: 200  len: 2979 time: 1.0040567
May 20 04:21:58.137551 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-13027643-ab6e-465b-ad4a-9937d69103db admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.209s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:58.140153 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 36250) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:21:58.201293 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [req-08a19c1e-311e-4bc1-a3fc-5754bbbd701e req-16df77b6-9316-41df-a571-139cc955c831 service neutron] For port 115e1bac-cc4d-40b5-b860-798c85c78924, host hv-cinder-79091, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=115e1bac-cc4d-40b5-b860-798c85c78924,segment=NetworkSegment(9521f383-6017-4b4d-9f47-cff4ed54cb57),segment_id=9521f383-6017-4b4d-9f47-cff4ed54cb57)] {{(pid=91687) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 04:21:58.261327 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-08a19c1e-311e-4bc1-a3fc-5754bbbd701e req-16df77b6-9316-41df-a571-139cc955c831 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4162185'] for port, after_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:58.320185 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-0c77c87b-f274-48c4-8347-baadd43022b7 req-39df6de8-680f-424f-87fe-22f5bcb1ae15 service neutron] 10.222.0.82 "GET /v2.0/networks/348b2b0f-c826-45ab-ba85-8430235b9cac?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4826033
May 20 04:21:58.365129 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-072be878-b401-494d-a3b0-9d9ccdfb5ce6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:58.372526 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 36256) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:21:58.441350 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-517c69e0-d1d1-4817-be82-0ca690871710 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:58.488094 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-072be878-b401-494d-a3b0-9d9ccdfb5ce6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:58.567529 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6722d519-1f1e-4f9b-b4c1-a31175001235 req-d90f5219-825f-43f2-84a9-c6952d30da2e tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:21:58.575285 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-6722d519-1f1e-4f9b-b4c1-a31175001235 req-d90f5219-825f-43f2-84a9-c6952d30da2e tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/ports?device_id=20a6d6ed-f811-42fd-8b44-ab4c031330e7 HTTP/1.1" status: 200  len: 944 time: 0.3481584
May 20 04:21:58.637434 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-4468e8e9-6e6c-4ae6-8fe0-c59101f9e6fa admin admin] Notify callbacks [] for security_group, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:58.647523 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08a19c1e-311e-4bc1-a3fc-5754bbbd701e req-16df77b6-9316-41df-a571-139cc955c831 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:21:58.648832 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-08a19c1e-311e-4bc1-a3fc-5754bbbd701e req-16df77b6-9316-41df-a571-139cc955c831 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for port, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:58.652211 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-08a19c1e-311e-4bc1-a3fc-5754bbbd701e req-16df77b6-9316-41df-a571-139cc955c831 service neutron] 10.222.0.82 "PUT /v2.0/ports/115e1bac-cc4d-40b5-b860-798c85c78924 HTTP/1.1" status: 200  len: 1094 time: 4.2961302
May 20 04:21:58.675341 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f32b55e5-d82f-4c9e-a67f-08d83c24cf4d', 'tag': '115e1bac-cc4d-40b5-b860-798c85c78924'}] {{(pid=91687) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:21:58.711991 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-6722d519-1f1e-4f9b-b4c1-a31175001235 req-77e8bb15-08b0-4bd2-afb8-5a177f2eaf17 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/security-groups?id=a5479633-0923-4a98-9c22-65615d7859f0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1353219
May 20 04:21:58.715945 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-0c77c87b-f274-48c4-8347-baadd43022b7 req-47c7e251-773f-493e-a7f4-169e29063593 service neutron] 10.222.0.82 "GET /v2.0/networks/348b2b0f-c826-45ab-ba85-8430235b9cac?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3815873
May 20 04:21:58.724407 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-072be878-b401-494d-a3b0-9d9ccdfb5ce6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:58.744927 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-8f90687d-d247-456e-a20b-287f17db1de2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:58.753045 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58ec3c4d-2fce-4f74-91c4-6ecd46daf319 service neutron] Pushing event updated for resources: {'Port': ['ID=10fe1059-aa07-4700-a931-76bcfa45b119,revision_number=2']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:58.773093 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-58ec3c4d-2fce-4f74-91c4-6ecd46daf319 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.683s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:58.796406 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-4468e8e9-6e6c-4ae6-8fe0-c59101f9e6fa admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:21:58.816852 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.406s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:58.900310 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f32b55e5-d82f-4c9e-a67f-08d83c24cf4d', 'tag': '115e1bac-cc4d-40b5-b860-798c85c78924', 'status': 'completed', 'code': 200}
May 20 04:21:58.918870 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-517c69e0-d1d1-4817-be82-0ca690871710 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:58.932985 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-4468e8e9-6e6c-4ae6-8fe0-c59101f9e6fa admin admin] Usage tracker for resource:security_group_rule and tenant:bfd2d2c4ae7643c58c17d6ece55599a1 is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:21:58.938852 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-4468e8e9-6e6c-4ae6-8fe0-c59101f9e6fa admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:21:58.955839 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-4468e8e9-6e6c-4ae6-8fe0-c59101f9e6fa admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:21:59.043993 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16df77b6-9316-41df-a571-139cc955c831 service neutron] Pushing event updated for resources: {'Port': ['ID=115e1bac-cc4d-40b5-b860-798c85c78924,revision_number=3']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:59.044444 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-072be878-b401-494d-a3b0-9d9ccdfb5ce6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c704f769-643d-4d63-82c4-e85ee48653a2,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:59.050078 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-16df77b6-9316-41df-a571-139cc955c831 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.233s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:59.054230 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-072be878-b401-494d-a3b0-9d9ccdfb5ce6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.310s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:59.074760 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.managers [req-4c886a56-584b-461b-9575-e692d7d651ff req-58ec3c4d-2fce-4f74-91c4-6ecd46daf319 service neutron] Attempting to bind port 10fe1059-aa07-4700-a931-76bcfa45b119 on host hv-cinder-79091 for vnic_type normal with profile  {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 04:21:59.075234 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.managers [req-4c886a56-584b-461b-9575-e692d7d651ff req-58ec3c4d-2fce-4f74-91c4-6ecd46daf319 service neutron] Attempting to bind port 10fe1059-aa07-4700-a931-76bcfa45b119 by drivers openvswitch,hyperv on host hv-cinder-79091 at level 0 using segments [{'id': '9d2ee761-256d-4e66-82a3-ef6e5bd352c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '348b2b0f-c826-45ab-ba85-8430235b9cac'}] {{(pid=91687) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 04:21:59.075532 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4c886a56-584b-461b-9575-e692d7d651ff req-58ec3c4d-2fce-4f74-91c4-6ecd46daf319 service neutron] Attempting to bind port 10fe1059-aa07-4700-a931-76bcfa45b119 on network 348b2b0f-c826-45ab-ba85-8430235b9cac {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:21:59.083200 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-072be878-b401-494d-a3b0-9d9ccdfb5ce6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:59.088723 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-072be878-b401-494d-a3b0-9d9ccdfb5ce6 admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/c704f769-643d-4d63-82c4-e85ee48653a2 HTTP/1.1" status: 204  len: 168 time: 0.9372044
May 20 04:21:59.089029 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4c886a56-584b-461b-9575-e692d7d651ff req-58ec3c4d-2fce-4f74-91c4-6ecd46daf319 service neutron] Port 10fe1059-aa07-4700-a931-76bcfa45b119 on network 348b2b0f-c826-45ab-ba85-8430235b9cac not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79091 {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 20 04:21:59.089029 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4c886a56-584b-461b-9575-e692d7d651ff req-58ec3c4d-2fce-4f74-91c4-6ecd46daf319 service neutron] Attempting to bind port 10fe1059-aa07-4700-a931-76bcfa45b119 on network 348b2b0f-c826-45ab-ba85-8430235b9cac {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:21:59.117181 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7baab03e-fe86-4221-805a-55a1bf53d0e4 req-2a58ea74-fe94-495f-916c-4d3759e4bb5f tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:21:59.119010 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-7baab03e-fe86-4221-805a-55a1bf53d0e4 req-2a58ea74-fe94-495f-916c-4d3759e4bb5f tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 943 time: 0.7289970
May 20 04:21:59.152020 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4c886a56-584b-461b-9575-e692d7d651ff req-58ec3c4d-2fce-4f74-91c4-6ecd46daf319 service neutron] Checking agent: {'id': '7cc947fd-92eb-4d43-ad6b-ea002afff217', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79091', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 4, 19, 34), 'started_at': datetime.datetime(2021, 5, 20, 4, 19, 34), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 4, 21, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 04:21:59.153584 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4c886a56-584b-461b-9575-e692d7d651ff req-58ec3c4d-2fce-4f74-91c4-6ecd46daf319 service neutron] Checking segment: {'id': '9d2ee761-256d-4e66-82a3-ef6e5bd352c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '348b2b0f-c826-45ab-ba85-8430235b9cac'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91687) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:21:59.154245 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4c886a56-584b-461b-9575-e692d7d651ff req-58ec3c4d-2fce-4f74-91c4-6ecd46daf319 service neutron] Bound using segment: {'id': '9d2ee761-256d-4e66-82a3-ef6e5bd352c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '348b2b0f-c826-45ab-ba85-8430235b9cac'} {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 04:21:59.158159 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.managers [req-4c886a56-584b-461b-9575-e692d7d651ff req-58ec3c4d-2fce-4f74-91c4-6ecd46daf319 service neutron] Bound port: 10fe1059-aa07-4700-a931-76bcfa45b119, host: hv-cinder-79091, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '9d2ee761-256d-4e66-82a3-ef6e5bd352c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '348b2b0f-c826-45ab-ba85-8430235b9cac'}}] {{(pid=91687) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 04:21:59.160179 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-4c886a56-584b-461b-9575-e692d7d651ff req-58ec3c4d-2fce-4f74-91c4-6ecd46daf319 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:59.266443 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abcf9048-ca3f-4af4-9584-4c8a9c929b32 req-5f56f083-ec58-4312-986d-5e84b40a5b47 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:21:59.269225 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-abcf9048-ca3f-4af4-9584-4c8a9c929b32 req-5f56f083-ec58-4312-986d-5e84b40a5b47 service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=b7d86d894a5f420e86f4c28d7772bd22&device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 1096 time: 0.4658029
May 20 04:21:59.399215 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-4468e8e9-6e6c-4ae6-8fe0-c59101f9e6fa admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:59.401927 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-517c69e0-d1d1-4817-be82-0ca690871710 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:59.418113 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08a19c1e-311e-4bc1-a3fc-5754bbbd701e req-9e050abc-befb-41d7-a248-3b43649d9348 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:21:59.419629 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-08a19c1e-311e-4bc1-a3fc-5754bbbd701e req-9e050abc-befb-41d7-a248-3b43649d9348 service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=ef3bec4745b14484ac8e21cd16cbd11d&device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 1097 time: 0.6637459
May 20 04:21:59.425687 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:59.530607 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-4468e8e9-6e6c-4ae6-8fe0-c59101f9e6fa admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:59.546598 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-517c69e0-d1d1-4817-be82-0ca690871710 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9cd5b503-2cb3-4626-b00b-0da0b6b0d73a,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:59.555951 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-072be878-b401-494d-a3b0-9d9ccdfb5ce6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:59.576249 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-517c69e0-d1d1-4817-be82-0ca690871710 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.151s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:59.581274 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-08a19c1e-311e-4bc1-a3fc-5754bbbd701e req-9b20110d-03d3-412f-92c4-b9791d23204b service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=115e1bac-cc4d-40b5-b860-798c85c78924 HTTP/1.1" status: 200  len: 217 time: 0.1474056
May 20 04:21:59.586690 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-7baab03e-fe86-4221-805a-55a1bf53d0e4 req-3f65da0c-2b0d-455a-8f5f-8646873949c7 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Synchronizing usage tracker for tenant:b7d86d894a5f420e86f4c28d7772bd22 on resource:security_group {{(pid=91687) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:21:59.634978 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-517c69e0-d1d1-4817-be82-0ca690871710 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:59.636456 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-517c69e0-d1d1-4817-be82-0ca690871710 admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/9cd5b503-2cb3-4626-b00b-0da0b6b0d73a HTTP/1.1" status: 204  len: 168 time: 1.8651199
May 20 04:21:59.667925 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [req-4c886a56-584b-461b-9575-e692d7d651ff req-58ec3c4d-2fce-4f74-91c4-6ecd46daf319 service neutron] For port 10fe1059-aa07-4700-a931-76bcfa45b119, host hv-cinder-79091, cleared binding levels {{(pid=91687) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 04:21:59.737181 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [req-4c886a56-584b-461b-9575-e692d7d651ff req-58ec3c4d-2fce-4f74-91c4-6ecd46daf319 service neutron] For port 10fe1059-aa07-4700-a931-76bcfa45b119, host hv-cinder-79091, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=10fe1059-aa07-4700-a931-76bcfa45b119,segment=NetworkSegment(9d2ee761-256d-4e66-82a3-ef6e5bd352c1),segment_id=9d2ee761-256d-4e66-82a3-ef6e5bd352c1)] {{(pid=91687) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 04:21:59.748901 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-7baab03e-fe86-4221-805a-55a1bf53d0e4 req-3f65da0c-2b0d-455a-8f5f-8646873949c7 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Unset dirty status for tenant:b7d86d894a5f420e86f4c28d7772bd22 on resource:security_group {{(pid=91687) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:21:59.750467 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-7baab03e-fe86-4221-805a-55a1bf53d0e4 req-3f65da0c-2b0d-455a-8f5f-8646873949c7 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.4951622
May 20 04:21:59.753713 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-4c886a56-584b-461b-9575-e692d7d651ff req-58ec3c4d-2fce-4f74-91c4-6ecd46daf319 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4162185'] for port, after_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:21:59.777719 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:21:59.806034 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-4468e8e9-6e6c-4ae6-8fe0-c59101f9e6fa admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=bfd2d2c4ae7643c58c17d6ece55599a1&name=default HTTP/1.1" status: 200  len: 2979 time: 1.4324572
May 20 04:21:59.830702 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 36298) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:21:59.844074 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 49f0e77b-6589-4f2f-9f47-7eb071a38ce6 up at agent hyperv_hv-cinder-79091 {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:21:59.853074 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08a19c1e-311e-4bc1-a3fc-5754bbbd701e req-6496a6ca-f65b-42b0-82b0-082c2889ac3c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:21:59.854473 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-08a19c1e-311e-4bc1-a3fc-5754bbbd701e req-6496a6ca-f65b-42b0-82b0-082c2889ac3c service neutron] 10.222.0.82 "GET /v2.0/subnets?id=06f38702-3d3c-4e25-8f84-85483d1ddf28 HTTP/1.1" status: 200  len: 856 time: 0.2635057
May 20 04:21:59.862058 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4468e8e9-6e6c-4ae6-8fe0-c59101f9e6fa admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0c61558c-ad0c-4394-9e96-91dd736fcf5d,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:21:59.877357 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-4468e8e9-6e6c-4ae6-8fe0-c59101f9e6fa admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.321s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:21:59.971431 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abcf9048-ca3f-4af4-9584-4c8a9c929b32 req-46c4bcfb-3f09-4b4f-aebe-d30338b1fa94 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:21:59.979430 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-abcf9048-ca3f-4af4-9584-4c8a9c929b32 req-46c4bcfb-3f09-4b4f-aebe-d30338b1fa94 service neutron] 10.222.0.82 "GET /v2.0/networks?id=348b2b0f-c826-45ab-ba85-8430235b9cac HTTP/1.1" status: 200  len: 920 time: 0.6963487
May 20 04:22:00.051037 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c886a56-584b-461b-9575-e692d7d651ff req-58ec3c4d-2fce-4f74-91c4-6ecd46daf319 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:00.052310 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-4c886a56-584b-461b-9575-e692d7d651ff req-58ec3c4d-2fce-4f74-91c4-6ecd46daf319 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for port, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:00.054125 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4c886a56-584b-461b-9575-e692d7d651ff req-58ec3c4d-2fce-4f74-91c4-6ecd46daf319 service neutron] 10.222.0.82 "PUT /v2.0/ports/10fe1059-aa07-4700-a931-76bcfa45b119 HTTP/1.1" status: 200  len: 1093 time: 4.2036085
May 20 04:22:00.184354 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c6f583b-5ee6-4c61-8607-e98d9f91185a req-5caeef30-add1-4eef-a991-71d48258a19e tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:00.187129 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-2c6f583b-5ee6-4c61-8607-e98d9f91185a req-5caeef30-add1-4eef-a991-71d48258a19e tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 944 time: 0.8229651
May 20 04:22:00.195930 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-abcf9048-ca3f-4af4-9584-4c8a9c929b32 req-87e4b7d0-8d86-47ae-b426-4b39d8d8205e service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=65d523e1-f132-4819-aa42-995ded4a1ad8 HTTP/1.1" status: 200  len: 217 time: 0.2075517
May 20 04:22:00.248744 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-4ce8c449-11e3-4a9e-af3c-bb0f3d058ffe None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:00.274869 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Provisioning for port 49f0e77b-6589-4f2f-9f47-7eb071a38ce6 completed by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:22:00.298929 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Provisioning complete for port 49f0e77b-6589-4f2f-9f47-7eb071a38ce6 triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:22:00.299951 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58ec3c4d-2fce-4f74-91c4-6ecd46daf319 service neutron] Pushing event updated for resources: {'Port': ['ID=10fe1059-aa07-4700-a931-76bcfa45b119,revision_number=3']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:22:00.300424 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:00.313044 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-58ec3c4d-2fce-4f74-91c4-6ecd46daf319 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.535s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:22:00.414796 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08a19c1e-311e-4bc1-a3fc-5754bbbd701e req-e1fe456d-d169-410c-9c31-2ce9dba98d9e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:00.423448 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-08a19c1e-311e-4bc1-a3fc-5754bbbd701e req-e1fe456d-d169-410c-9c31-2ce9dba98d9e service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=21794e86-fda7-40a6-a5a8-db117c7eeb9d&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.5224767
May 20 04:22:00.439129 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-5ec065dc-857a-45f8-8ef1-4ed6f036d2c6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:00.509296 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-2c6f583b-5ee6-4c61-8607-e98d9f91185a req-c51d47ee-465d-4e1d-a6d8-14ac3f09854e tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.3060374
May 20 04:22:00.512203 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abcf9048-ca3f-4af4-9584-4c8a9c929b32 req-7a5e1734-d7b9-4f14-8c66-2dc6198ef7d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:00.515473 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-abcf9048-ca3f-4af4-9584-4c8a9c929b32 req-7a5e1734-d7b9-4f14-8c66-2dc6198ef7d3 service neutron] 10.222.0.82 "GET /v2.0/subnets?id=b488dc7d-0e70-4e52-9179-7e6c3e4fb0a1 HTTP/1.1" status: 200  len: 859 time: 0.2452600
May 20 04:22:00.595261 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 36314) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:22:00.607602 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c886a56-584b-461b-9575-e692d7d651ff req-3907a9b6-ef06-4735-acfa-52bd401ea6b4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:00.609180 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4c886a56-584b-461b-9575-e692d7d651ff req-3907a9b6-ef06-4735-acfa-52bd401ea6b4 service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=b7d86d894a5f420e86f4c28d7772bd22&device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 1096 time: 0.4690573
May 20 04:22:00.639802 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-5ec065dc-857a-45f8-8ef1-4ed6f036d2c6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:00.646778 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:00.710142 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12a147dc-db85-4ff8-bb27-6ca2272e2d38 req-97b8a9ff-7138-42c6-bd6f-e512ca8b1d10 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:00.711767 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-12a147dc-db85-4ff8-bb27-6ca2272e2d38 req-97b8a9ff-7138-42c6-bd6f-e512ca8b1d10 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/ports?device_id=20a6d6ed-f811-42fd-8b44-ab4c031330e7 HTTP/1.1" status: 200  len: 944 time: 0.4484203
May 20 04:22:00.732337 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port 49f0e77b-6589-4f2f-9f47-7eb071a38ce6, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=49f0e77b-6589-4f2f-9f47-7eb071a38ce6,segment=NetworkSegment(743e4a81-111b-4929-b0d4-50516fe60014),segment_id=743e4a81-111b-4929-b0d4-50516fe60014)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:22:00.734838 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '20a6d6ed-f811-42fd-8b44-ab4c031330e7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '49f0e77b-6589-4f2f-9f47-7eb071a38ce6'}] {{(pid=91688) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:22:00.781875 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4c886a56-584b-461b-9575-e692d7d651ff req-6bcfc072-4109-4608-9576-0004b08a1e52 service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=10fe1059-aa07-4700-a931-76bcfa45b119 HTTP/1.1" status: 200  len: 217 time: 0.1460860
May 20 04:22:00.790767 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-abcf9048-ca3f-4af4-9584-4c8a9c929b32 req-5a8d5de2-5566-4601-a92e-3237c0d71d40 service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=348b2b0f-c826-45ab-ba85-8430235b9cac&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.2678750
May 20 04:22:00.799437 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-5ec065dc-857a-45f8-8ef1-4ed6f036d2c6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:00.809349 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-8cc9b601-41b7-4373-a29c-633640204d64 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:22:00.844994 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ec065dc-857a-45f8-8ef1-4ed6f036d2c6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0c61558c-ad0c-4394-9e96-91dd736fcf5d,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:22:00.845335 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-08a19c1e-311e-4bc1-a3fc-5754bbbd701e req-5da98ee6-0d2b-4d22-8d98-efcb0abb229b service neutron] 10.222.0.82 "GET /v2.0/networks/21794e86-fda7-40a6-a5a8-db117c7eeb9d?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4180994
May 20 04:22:00.851401 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-5ec065dc-857a-45f8-8ef1-4ed6f036d2c6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:22:00.855763 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-5ec065dc-857a-45f8-8ef1-4ed6f036d2c6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:00.857988 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-5ec065dc-857a-45f8-8ef1-4ed6f036d2c6 admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/0c61558c-ad0c-4394-9e96-91dd736fcf5d HTTP/1.1" status: 204  len: 168 time: 0.9912047
May 20 04:22:00.887015 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:00.893145 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-12a147dc-db85-4ff8-bb27-6ca2272e2d38 req-6128cf31-d6a6-49b4-bd1c-406bc6903954 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/security-groups?id=a5479633-0923-4a98-9c22-65615d7859f0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1247385
May 20 04:22:00.901973 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2d35fcf1-2045-41ad-8d43-0b244e5b4d20', 'tag': '10fe1059-aa07-4700-a931-76bcfa45b119'}] {{(pid=91687) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:22:00.907994 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-8a833570-0998-49d4-b6d8-01b7360e7752 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:22:01.021018 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2d35fcf1-2045-41ad-8d43-0b244e5b4d20', 'tag': '10fe1059-aa07-4700-a931-76bcfa45b119', 'status': 'completed', 'code': 200}
May 20 04:22:01.089776 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Pushing event updated for resources: {'Port': ['ID=49f0e77b-6589-4f2f-9f47-7eb071a38ce6,revision_number=5']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:22:01.095412 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.188s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:22:01.179901 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-c4e3f0a4-da47-4d04-ad9b-ad701c7a8840 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:01.204837 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-c4e3f0a4-da47-4d04-ad9b-ad701c7a8840 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:22:01.205767 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66a32fc8-c2c3-4351-a0e7-f55254c2de55 req-57422a4e-0bb6-41d7-86c9-1d4753bedca0 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:01.208919 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-66a32fc8-c2c3-4351-a0e7-f55254c2de55 req-57422a4e-0bb6-41d7-86c9-1d4753bedca0 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 943 time: 0.2025208
May 20 04:22:01.221737 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-c4e3f0a4-da47-4d04-ad9b-ad701c7a8840 admin admin] Usage tracker for resource:security_group_rule and tenant:93c9700eac5d4c3dba30de8f8889947a is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:22:01.227272 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-c4e3f0a4-da47-4d04-ad9b-ad701c7a8840 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:22:01.239344 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-c4e3f0a4-da47-4d04-ad9b-ad701c7a8840 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:22:01.324772 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-66a32fc8-c2c3-4351-a0e7-f55254c2de55 req-ea11c18c-9605-48d1-b50c-f39e7b14e9d8 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1061981
May 20 04:22:01.439609 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-c4e3f0a4-da47-4d04-ad9b-ad701c7a8840 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:01.448252 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-c4e3f0a4-da47-4d04-ad9b-ad701c7a8840 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:01.462516 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-d8a3058a-fbe0-4b0e-b32e-24fd5201e9c7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:22:01.522868 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-c4e3f0a4-da47-4d04-ad9b-ad701c7a8840 admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=93c9700eac5d4c3dba30de8f8889947a&name=default HTTP/1.1" status: 200  len: 2979 time: 0.9261470
May 20 04:22:01.525030 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4e3f0a4-da47-4d04-ad9b-ad701c7a8840 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d62ceda9-26ec-493d-8d42-bf436f943b24,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:22:01.527129 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 36350) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:22:01.540542 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-c4e3f0a4-da47-4d04-ad9b-ad701c7a8840 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:22:01.802027 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-deb75242-7908-4fc1-ab2f-af9366ce87d3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:01.827777 dv-cinder-790910-4-iscsi neutron-server[91688]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '20a6d6ed-f811-42fd-8b44-ab4c031330e7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '49f0e77b-6589-4f2f-9f47-7eb071a38ce6', 'code': 200}
May 20 04:22:01.883184 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 36366) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:22:01.904460 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-5eec21e9-f949-4563-b09e-4e6e201425e1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:01.929984 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-deb75242-7908-4fc1-ab2f-af9366ce87d3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:01.934643 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-5eec21e9-f949-4563-b09e-4e6e201425e1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:22:01.939998 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-5eec21e9-f949-4563-b09e-4e6e201425e1 admin admin] Usage tracker for resource:security_group_rule and tenant:9aedf2b99c82498f8ec9026f12649ad3 is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:22:01.944187 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-5eec21e9-f949-4563-b09e-4e6e201425e1 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:22:01.951951 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-5eec21e9-f949-4563-b09e-4e6e201425e1 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:22:02.080773 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-5eec21e9-f949-4563-b09e-4e6e201425e1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:02.088761 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-5eec21e9-f949-4563-b09e-4e6e201425e1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:02.136188 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:22:02.166879 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e584c76c-82f8-4883-a715-50905f4339c9 req-c39c6da5-91f5-4ce8-ab14-673451817036 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:02.177579 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-e584c76c-82f8-4883-a715-50905f4339c9 req-c39c6da5-91f5-4ce8-ab14-673451817036 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 944 time: 0.3570466
May 20 04:22:02.204325 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-5eec21e9-f949-4563-b09e-4e6e201425e1 admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=9aedf2b99c82498f8ec9026f12649ad3&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3193521
May 20 04:22:02.212639 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 36376) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:22:02.256675 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-deb75242-7908-4fc1-ab2f-af9366ce87d3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:02.282802 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-10ae8269-cdbf-4738-a1a0-9f76c284be9a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:22:02.311923 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-deb75242-7908-4fc1-ab2f-af9366ce87d3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d62ceda9-26ec-493d-8d42-bf436f943b24,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:22:02.317188 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5eec21e9-f949-4563-b09e-4e6e201425e1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0b02a079-5df7-4d6d-9397-b2a63ac9afcc,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:22:02.322976 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-5eec21e9-f949-4563-b09e-4e6e201425e1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.187s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:22:02.324066 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-deb75242-7908-4fc1-ab2f-af9366ce87d3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:22:02.349380 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-e584c76c-82f8-4883-a715-50905f4339c9 req-a18ba4ce-0686-42a8-aca8-0048f4558cd7 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1595685
May 20 04:22:02.364736 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-deb75242-7908-4fc1-ab2f-af9366ce87d3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:02.373623 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-deb75242-7908-4fc1-ab2f-af9366ce87d3 admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/d62ceda9-26ec-493d-8d42-bf436f943b24 HTTP/1.1" status: 204  len: 168 time: 0.8433738
May 20 04:22:02.503134 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-96b5534f-6121-49b2-9128-78c103c51d9d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:02.553267 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:02.628777 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e9695f0-0b0d-4e36-94d6-1d8353eaa4d0 req-80e8ec71-e922-4b25-840d-0dcf8830afcb tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:02.634681 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-8e9695f0-0b0d-4e36-94d6-1d8353eaa4d0 req-80e8ec71-e922-4b25-840d-0dcf8830afcb tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 943 time: 0.0977519
May 20 04:22:02.700381 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-d8cc045d-cb94-4ab7-9ae1-461c135cff39 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:02.736301 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-96b5534f-6121-49b2-9128-78c103c51d9d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:02.750546 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-8e9695f0-0b0d-4e36-94d6-1d8353eaa4d0 req-808231fe-e4fc-47f8-bc4b-96a58fcfe7f0 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1116581
May 20 04:22:02.759549 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b683baac-330c-468e-a38d-512a866249a0 req-a8d62818-4303-4339-9653-a115b6706914 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:02.762324 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-b683baac-330c-468e-a38d-512a866249a0 req-a8d62818-4303-4339-9653-a115b6706914 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/ports?device_id=20a6d6ed-f811-42fd-8b44-ab4c031330e7 HTTP/1.1" status: 200  len: 945 time: 0.5057898
May 20 04:22:02.827570 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c886a56-584b-461b-9575-e692d7d651ff req-98ed5cc8-5d9e-4fbe-9100-c3305819f85f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:02.829666 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4c886a56-584b-461b-9575-e692d7d651ff req-98ed5cc8-5d9e-4fbe-9100-c3305819f85f service neutron] 10.222.0.82 "GET /v2.0/subnets?id=b488dc7d-0e70-4e52-9179-7e6c3e4fb0a1 HTTP/1.1" status: 200  len: 859 time: 0.2590895
May 20 04:22:02.908180 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-b683baac-330c-468e-a38d-512a866249a0 req-2a0e272d-da2f-41bb-a8b2-8d0f4e7d161f tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/security-groups?id=a5479633-0923-4a98-9c22-65615d7859f0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1181533
May 20 04:22:02.924861 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-96b5534f-6121-49b2-9128-78c103c51d9d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:02.934672 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:22:02.967302 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96b5534f-6121-49b2-9128-78c103c51d9d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0b02a079-5df7-4d6d-9397-b2a63ac9afcc,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:22:02.971613 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-96b5534f-6121-49b2-9128-78c103c51d9d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:22:02.986855 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-96b5534f-6121-49b2-9128-78c103c51d9d admin admin] Notify callbacks [] for security_group, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:02.988866 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-96b5534f-6121-49b2-9128-78c103c51d9d admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/0b02a079-5df7-4d6d-9397-b2a63ac9afcc HTTP/1.1" status: 204  len: 168 time: 0.7746565
May 20 04:22:03.189215 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 36404) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:22:03.322327 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ea4803bd-878f-47d5-9084-1ec41953c9db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:03.334695 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-2f92f8ff-38e0-4181-89e8-cf844f593301 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:03.362485 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-2f92f8ff-38e0-4181-89e8-cf844f593301 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:22:03.369942 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-2f92f8ff-38e0-4181-89e8-cf844f593301 admin admin] Usage tracker for resource:security_group_rule and tenant:4593d1e48c544686a34896e218be9b5d is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:22:03.375513 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-2f92f8ff-38e0-4181-89e8-cf844f593301 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:22:03.387531 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-2f92f8ff-38e0-4181-89e8-cf844f593301 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:22:03.513747 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-2f92f8ff-38e0-4181-89e8-cf844f593301 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:03.521876 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-2f92f8ff-38e0-4181-89e8-cf844f593301 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:03.530492 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:22:03.576796 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f92f8ff-38e0-4181-89e8-cf844f593301 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=57417ed9-f8e6-4d80-8941-fd03909326f2,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:22:03.580531 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-2f92f8ff-38e0-4181-89e8-cf844f593301 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:22:03.584113 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-2f92f8ff-38e0-4181-89e8-cf844f593301 admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=4593d1e48c544686a34896e218be9b5d&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3929067
May 20 04:22:03.588331 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 36416) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:22:03.683217 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:03.820175 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4c886a56-584b-461b-9575-e692d7d651ff req-1df59085-9f99-4d51-a85a-4cea5b832bac service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=348b2b0f-c826-45ab-ba85-8430235b9cac&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1815584
May 20 04:22:03.866099 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-abcf9048-ca3f-4af4-9584-4c8a9c929b32 req-78de1003-27ad-4f7c-acde-02b3bbd9b856 service neutron] 10.222.0.82 "GET /v2.0/networks/348b2b0f-c826-45ab-ba85-8430235b9cac?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2096181
May 20 04:22:03.875770 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-694b3a43-0fa9-44d1-abb4-642e6751c8b3 req-93be978f-d13c-4fc9-b097-2ba249c8ddd3 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:03.884300 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-694b3a43-0fa9-44d1-abb4-642e6751c8b3 req-93be978f-d13c-4fc9-b097-2ba249c8ddd3 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 944 time: 0.2944102
May 20 04:22:03.933176 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-90d2c1f6-871d-4295-8339-8c0db5ab2c30 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:03.954680 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-694b3a43-0fa9-44d1-abb4-642e6751c8b3 req-aa65c73a-9391-4cb6-ab3d-460221c4bc60 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0665772
May 20 04:22:03.986335 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-08a19c1e-311e-4bc1-a3fc-5754bbbd701e req-6e53192b-46a5-4ebf-acf1-d5ba43ec1177 service neutron] 10.222.0.82 "GET /v2.0/networks/21794e86-fda7-40a6-a5a8-db117c7eeb9d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3534157
May 20 04:22:03.988681 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-90d2c1f6-871d-4295-8339-8c0db5ab2c30 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:04.059708 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-90d2c1f6-871d-4295-8339-8c0db5ab2c30 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:04.066004 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-96b5534f-6121-49b2-9128-78c103c51d9d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:22:04.079585 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90d2c1f6-871d-4295-8339-8c0db5ab2c30 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=57417ed9-f8e6-4d80-8941-fd03909326f2,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:22:04.082916 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-90d2c1f6-871d-4295-8339-8c0db5ab2c30 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:22:04.091469 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-90d2c1f6-871d-4295-8339-8c0db5ab2c30 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:04.092979 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-90d2c1f6-871d-4295-8339-8c0db5ab2c30 admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/57417ed9-f8e6-4d80-8941-fd03909326f2 HTTP/1.1" status: 204  len: 168 time: 0.5035212
May 20 04:22:04.168727 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 36432) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:22:04.199031 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-5076b25f-59c3-440e-b4cf-8659ad1f36f1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:04.230075 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d914a729-0833-4f66-9d62-85b07d1b0c73 req-108f1a11-77dc-49ae-930f-4422e75d7f47 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:04.230577 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-5076b25f-59c3-440e-b4cf-8659ad1f36f1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:22:04.237103 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-5076b25f-59c3-440e-b4cf-8659ad1f36f1 admin admin] Usage tracker for resource:security_group_rule and tenant:e8b1e8af4bbd4a4f80012dea7916cfbf is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:22:04.240888 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-d914a729-0833-4f66-9d62-85b07d1b0c73 req-108f1a11-77dc-49ae-930f-4422e75d7f47 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 943 time: 0.1139977
May 20 04:22:04.243551 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-5076b25f-59c3-440e-b4cf-8659ad1f36f1 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:22:04.252127 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-5076b25f-59c3-440e-b4cf-8659ad1f36f1 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:22:04.291710 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-948cd4b9-42eb-473a-9643-ca9c91470d41 req-b0b732be-92dd-4bf5-8345-39ab310a2cbd tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:04.299346 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-948cd4b9-42eb-473a-9643-ca9c91470d41 req-b0b732be-92dd-4bf5-8345-39ab310a2cbd tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/ports?device_id=20a6d6ed-f811-42fd-8b44-ab4c031330e7 HTTP/1.1" status: 200  len: 945 time: 0.1897504
May 20 04:22:04.310901 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-d914a729-0833-4f66-9d62-85b07d1b0c73 req-a322cae2-d5e0-4ef0-a294-dbcd104212be tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0681193
May 20 04:22:04.361933 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-948cd4b9-42eb-473a-9643-ca9c91470d41 req-568e961d-fbd1-4a4c-a566-963082ac9578 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/security-groups?id=a5479633-0923-4a98-9c22-65615d7859f0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0612595
May 20 04:22:04.467937 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-5076b25f-59c3-440e-b4cf-8659ad1f36f1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:04.475044 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-5076b25f-59c3-440e-b4cf-8659ad1f36f1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:04.483303 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-5ec065dc-857a-45f8-8ef1-4ed6f036d2c6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:22:04.530672 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5076b25f-59c3-440e-b4cf-8659ad1f36f1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a25821f6-2888-4f8a-a22c-33ec2d29df47,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:22:04.534882 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-5076b25f-59c3-440e-b4cf-8659ad1f36f1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:22:04.537905 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-5076b25f-59c3-440e-b4cf-8659ad1f36f1 admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=e8b1e8af4bbd4a4f80012dea7916cfbf&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3676975
May 20 04:22:04.541233 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 36444) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:22:04.629700 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-17d8d33f-a4c6-465e-be83-a8839603f3c9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:04.674125 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-17d8d33f-a4c6-465e-be83-a8839603f3c9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:04.780822 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-17d8d33f-a4c6-465e-be83-a8839603f3c9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:04.794731 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:22:04.807494 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17d8d33f-a4c6-465e-be83-a8839603f3c9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a25821f6-2888-4f8a-a22c-33ec2d29df47,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:22:04.810164 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-17d8d33f-a4c6-465e-be83-a8839603f3c9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:22:04.817358 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-17d8d33f-a4c6-465e-be83-a8839603f3c9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:04.821665 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-17d8d33f-a4c6-465e-be83-a8839603f3c9 admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/a25821f6-2888-4f8a-a22c-33ec2d29df47 HTTP/1.1" status: 204  len: 168 time: 0.2787795
May 20 04:22:05.150046 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f21320cc-6a25-4ec1-8a32-8b119b35fd55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:05.165835 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 65d523e1-f132-4819-aa42-995ded4a1ad8 details requested by agent hyperv_hv-cinder-79091 with host hv-cinder-79091 {{(pid=91688) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 20 04:22:05.494986 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port 65d523e1-f132-4819-aa42-995ded4a1ad8, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=65d523e1-f132-4819-aa42-995ded4a1ad8,segment=NetworkSegment(9d2ee761-256d-4e66-82a3-ef6e5bd352c1),segment_id=9d2ee761-256d-4e66-82a3-ef6e5bd352c1)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:22:05.544688 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Returning: {'device': '65d523e1-f132-4819-aa42-995ded4a1ad8', 'network_id': '348b2b0f-c826-45ab-ba85-8430235b9cac', 'port_id': '65d523e1-f132-4819-aa42-995ded4a1ad8', 'mac_address': 'fa:16:3e:49:1a:cb', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 897, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b488dc7d-0e70-4e52-9179-7e6c3e4fb0a1', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91688) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 20 04:22:05.612211 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-abcf9048-ca3f-4af4-9584-4c8a9c929b32 req-8196297f-be19-4bcf-a6b1-f5bd5624fcfa service neutron] 10.222.0.82 "GET /v2.0/networks/348b2b0f-c826-45ab-ba85-8430235b9cac?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4225717
May 20 04:22:05.619275 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.82', 55115) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:22:05.681184 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:05.740602 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.notifiers.nova [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 65d523e1-f132-4819-aa42-995ded4a1ad8 {{(pid=91688) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 04:22:05.770993 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.agents_db [None req-92d61f12-17bc-4bf9-9eab-8a69b8c6da2f None None] Agent healthcheck: found 6 active agents {{(pid=91689) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 04:22:05.784108 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port 65d523e1-f132-4819-aa42-995ded4a1ad8, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=65d523e1-f132-4819-aa42-995ded4a1ad8,segment=NetworkSegment(9d2ee761-256d-4e66-82a3-ef6e5bd352c1),segment_id=9d2ee761-256d-4e66-82a3-ef6e5bd352c1)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:22:05.792258 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:05.798607 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:22:05.900752 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4c886a56-584b-461b-9575-e692d7d651ff req-ddc14d3e-72b6-4d56-96d4-1aa7adb5e48e service neutron] 10.222.0.82 "GET /v2.0/networks/348b2b0f-c826-45ab-ba85-8430235b9cac?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.7140284
May 20 04:22:05.908388 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59077a57-bcb0-401c-8bd0-eb915169dd48 req-a3c4323a-3f8a-40ab-a7ed-ccdc4f114864 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:05.916020 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-59077a57-bcb0-401c-8bd0-eb915169dd48 req-a3c4323a-3f8a-40ab-a7ed-ccdc4f114864 service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=ef3bec4745b14484ac8e21cd16cbd11d&device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 1097 time: 0.4091237
May 20 04:22:05.943454 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5a63ec8-b747-4b93-b07f-96f381cc811a req-feb0ba70-c41d-417d-bfae-e70adfe07b2a tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:05.946604 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-d5a63ec8-b747-4b93-b07f-96f381cc811a req-feb0ba70-c41d-417d-bfae-e70adfe07b2a tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 944 time: 0.6683397
May 20 04:22:05.977343 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Pushing event updated for resources: {'Port': ['ID=65d523e1-f132-4819-aa42-995ded4a1ad8,revision_number=4']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:22:05.988326 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.189s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:22:06.053443 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b697ac5-2d67-4bb4-b49f-4f112fbf3b4b req-3f2a4c46-f150-490d-96ab-517f61d6c0ef service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:06.055988 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-0b697ac5-2d67-4bb4-b49f-4f112fbf3b4b req-3f2a4c46-f150-490d-96ab-517f61d6c0ef service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=20a6d6ed-f811-42fd-8b44-ab4c031330e7 HTTP/1.1" status: 200  len: 1098 time: 0.4316363
May 20 04:22:06.080532 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f130cb26-1cf3-40d9-a6aa-a525720b04be req-3063c9d2-c7cb-479a-84eb-4dd8c81260ed tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:06.083458 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-f130cb26-1cf3-40d9-a6aa-a525720b04be req-3063c9d2-c7cb-479a-84eb-4dd8c81260ed tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 943 time: 0.3344085
May 20 04:22:06.135585 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [req-0b697ac5-2d67-4bb4-b49f-4f112fbf3b4b req-f04aa4e7-4814-4f0e-addb-41d170890fe6 service neutron] Notify callbacks [] for security_group, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:06.158656 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4c886a56-584b-461b-9575-e692d7d651ff req-ac1aaa21-7802-4e2f-8bdf-b35673c9d9bb service neutron] 10.222.0.82 "GET /v2.0/networks/348b2b0f-c826-45ab-ba85-8430235b9cac?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2403488
May 20 04:22:06.215645 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [req-0b697ac5-2d67-4bb4-b49f-4f112fbf3b4b req-f04aa4e7-4814-4f0e-addb-41d170890fe6 service neutron] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:22:06.243347 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [req-0b697ac5-2d67-4bb4-b49f-4f112fbf3b4b req-f04aa4e7-4814-4f0e-addb-41d170890fe6 service neutron] Usage tracker for resource:security_group_rule and tenant:6413780497424480b037d5bbdb75f42d is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:22:06.252657 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [req-0b697ac5-2d67-4bb4-b49f-4f112fbf3b4b req-f04aa4e7-4814-4f0e-addb-41d170890fe6 service neutron] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:22:06.319996 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-f130cb26-1cf3-40d9-a6aa-a525720b04be req-cfa5ca1a-a261-43a7-89da-a784e9c37ec1 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2134268
May 20 04:22:06.333118 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [req-0b697ac5-2d67-4bb4-b49f-4f112fbf3b4b req-f04aa4e7-4814-4f0e-addb-41d170890fe6 service neutron] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:22:06.361302 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-d5a63ec8-b747-4b93-b07f-96f381cc811a req-faebc00a-61a9-4427-a2b6-2e3332f25f12 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1972427
May 20 04:22:06.444132 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59077a57-bcb0-401c-8bd0-eb915169dd48 req-6f42d4fd-18bd-421b-846b-5ffb59d779ee service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:06.445917 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-59077a57-bcb0-401c-8bd0-eb915169dd48 req-6f42d4fd-18bd-421b-846b-5ffb59d779ee service neutron] 10.222.0.82 "GET /v2.0/networks?id=21794e86-fda7-40a6-a5a8-db117c7eeb9d HTTP/1.1" status: 200  len: 918 time: 0.5289309
May 20 04:22:06.623834 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb0af62e-d1bf-4b98-ab7d-d11f33efb895 req-36639214-efdc-42a3-9b25-799715a4ad34 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:06.633764 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-fb0af62e-d1bf-4b98-ab7d-d11f33efb895 req-36639214-efdc-42a3-9b25-799715a4ad34 service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=b7d86d894a5f420e86f4c28d7772bd22&device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 1096 time: 0.3671350
May 20 04:22:06.651143 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [req-0b697ac5-2d67-4bb4-b49f-4f112fbf3b4b req-f04aa4e7-4814-4f0e-addb-41d170890fe6 service neutron] Notify callbacks [] for security_group, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:06.658987 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [req-0b697ac5-2d67-4bb4-b49f-4f112fbf3b4b req-f04aa4e7-4814-4f0e-addb-41d170890fe6 service neutron] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:06.666305 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:22:06.696641 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-59077a57-bcb0-401c-8bd0-eb915169dd48 req-8b91c67e-3e3e-4fd5-a4a0-bce97464aea9 service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=115e1bac-cc4d-40b5-b860-798c85c78924 HTTP/1.1" status: 200  len: 217 time: 0.2370608
May 20 04:22:06.738844 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-0b697ac5-2d67-4bb4-b49f-4f112fbf3b4b req-f04aa4e7-4814-4f0e-addb-41d170890fe6 service neutron] 10.222.0.82 "GET /v2.0/security-groups?id=a5479633-0923-4a98-9c22-65615d7859f0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.6743844
May 20 04:22:06.749696 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f04aa4e7-4814-4f0e-addb-41d170890fe6 service neutron] Pushing event updated for resources: {'SecurityGroup': ['ID=b5753903-8935-41e4-8385-95c767d9f8dc,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:22:06.770672 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-f04aa4e7-4814-4f0e-addb-41d170890fe6 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:22:06.805818 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] get_ports_and_sgs() called for port_ids ['65d523e1-f132-4819-aa42-995ded4a1ad8'] {{(pid=91688) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 04:22:07.125067 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59077a57-bcb0-401c-8bd0-eb915169dd48 req-6d94ebf2-232a-4eaa-89ef-0e924d236911 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:07.135953 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-59077a57-bcb0-401c-8bd0-eb915169dd48 req-6d94ebf2-232a-4eaa-89ef-0e924d236911 service neutron] 10.222.0.82 "GET /v2.0/subnets?id=06f38702-3d3c-4e25-8f84-85483d1ddf28 HTTP/1.1" status: 200  len: 856 time: 0.3490400
May 20 04:22:07.526485 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb0af62e-d1bf-4b98-ab7d-d11f33efb895 req-d90f0bf9-e4e7-41c8-874e-1ef438e44c3f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:07.533466 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-fb0af62e-d1bf-4b98-ab7d-d11f33efb895 req-d90f0bf9-e4e7-41c8-874e-1ef438e44c3f service neutron] 10.222.0.82 "GET /v2.0/networks?id=348b2b0f-c826-45ab-ba85-8430235b9cac HTTP/1.1" status: 200  len: 920 time: 0.8969784
May 20 04:22:07.590469 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a53bacd1-9726-4909-a468-86438e451aae req-8b30599d-de76-4f2a-86c8-e7a5123e5630 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:07.603842 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a53bacd1-9726-4909-a468-86438e451aae req-8b30599d-de76-4f2a-86c8-e7a5123e5630 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/ports?device_id=20a6d6ed-f811-42fd-8b44-ab4c031330e7 HTTP/1.1" status: 200  len: 945 time: 0.9825175
May 20 04:22:07.869359 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-fb0af62e-d1bf-4b98-ab7d-d11f33efb895 req-888c4f38-0675-4fd6-8cb4-f4cb85e66ebf service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=10fe1059-aa07-4700-a931-76bcfa45b119 HTTP/1.1" status: 200  len: 217 time: 0.3142817
May 20 04:22:07.912309 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eca6d17c-d538-449e-b7bb-494d291ba172 req-4c272e0f-8483-431f-b8e8-c23c7e92cca7 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:07.916189 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-eca6d17c-d538-449e-b7bb-494d291ba172 req-4c272e0f-8483-431f-b8e8-c23c7e92cca7 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 943 time: 0.1674600
May 20 04:22:07.917754 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59077a57-bcb0-401c-8bd0-eb915169dd48 req-77286a73-e7d7-4a60-a42b-83637aeab1f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:07.919301 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-59077a57-bcb0-401c-8bd0-eb915169dd48 req-77286a73-e7d7-4a60-a42b-83637aeab1f4 service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=21794e86-fda7-40a6-a5a8-db117c7eeb9d&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.7821357
May 20 04:22:08.002467 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a53bacd1-9726-4909-a468-86438e451aae req-f402f6d9-340b-436b-86cc-57ee3acab6e2 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/security-groups?id=a5479633-0923-4a98-9c22-65615d7859f0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1858599
May 20 04:22:08.049625 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-eca6d17c-d538-449e-b7bb-494d291ba172 req-d50f0b71-5a60-4467-8a22-2810edc806c4 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1207037
May 20 04:22:08.170755 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb0af62e-d1bf-4b98-ab7d-d11f33efb895 req-13326971-2968-4dce-8123-50f66e687aa2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:08.174145 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-fb0af62e-d1bf-4b98-ab7d-d11f33efb895 req-13326971-2968-4dce-8123-50f66e687aa2 service neutron] 10.222.0.82 "GET /v2.0/subnets?id=b488dc7d-0e70-4e52-9179-7e6c3e4fb0a1 HTTP/1.1" status: 200  len: 859 time: 0.2955763
May 20 04:22:08.309192 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-fb0af62e-d1bf-4b98-ab7d-d11f33efb895 req-14a05005-554e-4dc8-ba85-737fa0f39dc1 service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=348b2b0f-c826-45ab-ba85-8430235b9cac&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0758264
May 20 04:22:08.398181 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-59077a57-bcb0-401c-8bd0-eb915169dd48 req-0ce754ba-00ad-44c5-b231-4aedfa9b17ca service neutron] 10.222.0.82 "GET /v2.0/networks/21794e86-fda7-40a6-a5a8-db117c7eeb9d?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4633229
May 20 04:22:08.634464 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae55431d-f9db-4125-97dd-14fac9462dc9 req-43470d02-0976-447e-ab73-b571e539ff0b tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:08.642363 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-ae55431d-f9db-4125-97dd-14fac9462dc9 req-43470d02-0976-447e-ab73-b571e539ff0b tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 944 time: 0.4865267
May 20 04:22:08.667056 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-59077a57-bcb0-401c-8bd0-eb915169dd48 req-39949c3e-8eb4-4278-99f8-5a1f5d6fb83f service neutron] 10.222.0.82 "GET /v2.0/networks/21794e86-fda7-40a6-a5a8-db117c7eeb9d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2620077
May 20 04:22:08.729660 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-fb0af62e-d1bf-4b98-ab7d-d11f33efb895 req-e50c88af-78a3-491d-8972-cc0daaa1c342 service neutron] 10.222.0.82 "GET /v2.0/networks/348b2b0f-c826-45ab-ba85-8430235b9cac?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4105220
May 20 04:22:08.741479 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-ae55431d-f9db-4125-97dd-14fac9462dc9 req-45aa603b-5c2f-40f5-8b2d-4b28d532ffb0 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0979576
May 20 04:22:09.006526 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-fb0af62e-d1bf-4b98-ab7d-d11f33efb895 req-62b57a5f-48f2-4e4a-9570-28f6f2275fa8 service neutron] 10.222.0.82 "GET /v2.0/networks/348b2b0f-c826-45ab-ba85-8430235b9cac?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2609403
May 20 04:22:09.396573 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a041b60-b306-45c9-b9ad-509771c0c690 req-92f477db-4abd-4781-a546-838b98a5ae10 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:09.415902 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-3a041b60-b306-45c9-b9ad-509771c0c690 req-92f477db-4abd-4781-a546-838b98a5ae10 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 943 time: 0.1828356
May 20 04:22:09.449939 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ab68b2a-1d28-41ea-bbb4-b413c7b64e93 req-c390e18a-954b-48a9-97ec-61a013c8d08c tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:09.463174 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-2ab68b2a-1d28-41ea-bbb4-b413c7b64e93 req-c390e18a-954b-48a9-97ec-61a013c8d08c tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/ports?device_id=20a6d6ed-f811-42fd-8b44-ab4c031330e7 HTTP/1.1" status: 200  len: 945 time: 0.2336488
May 20 04:22:09.533663 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-3a041b60-b306-45c9-b9ad-509771c0c690 req-685d64b6-199a-4626-bad6-e0b44a518f74 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1136060
May 20 04:22:09.550475 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-2ab68b2a-1d28-41ea-bbb4-b413c7b64e93 req-33c9156d-f4fb-4ad5-9ffe-774296c20eea tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/security-groups?id=a5479633-0923-4a98-9c22-65615d7859f0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0836785
May 20 04:22:09.741157 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 36626) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:22:09.953692 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-18b10fa3-6cad-4cdd-8f3d-7375b4e61d73 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:09.973739 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-18b10fa3-6cad-4cdd-8f3d-7375b4e61d73 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:22:09.978242 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-18b10fa3-6cad-4cdd-8f3d-7375b4e61d73 admin admin] Usage tracker for resource:security_group_rule and tenant:dc8fede1d53d44f2abe7977ea4b04680 is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:22:09.981558 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-18b10fa3-6cad-4cdd-8f3d-7375b4e61d73 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:22:09.988125 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-18b10fa3-6cad-4cdd-8f3d-7375b4e61d73 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:22:10.117824 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54382b9c-66d3-47d6-9c79-e6e4643365e2 req-841ae672-d4fb-4ddc-81ac-bbebfc106a53 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:10.125207 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-54382b9c-66d3-47d6-9c79-e6e4643365e2 req-841ae672-d4fb-4ddc-81ac-bbebfc106a53 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 944 time: 0.1555266
May 20 04:22:10.203643 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-54382b9c-66d3-47d6-9c79-e6e4643365e2 req-7f20535b-e82c-4255-8178-2475ad92afa9 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0756369
May 20 04:22:10.216077 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-18b10fa3-6cad-4cdd-8f3d-7375b4e61d73 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:10.221725 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-18b10fa3-6cad-4cdd-8f3d-7375b4e61d73 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:10.229206 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:22:10.273758 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-18b10fa3-6cad-4cdd-8f3d-7375b4e61d73 admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=dc8fede1d53d44f2abe7977ea4b04680&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5310402
May 20 04:22:10.274753 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18b10fa3-6cad-4cdd-8f3d-7375b4e61d73 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b93d2e71-2ec2-4c90-85e3-f3c0772501d9,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:22:10.277112 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 36642) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:22:10.296723 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18b10fa3-6cad-4cdd-8f3d-7375b4e61d73 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:22:10.297220 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18b10fa3-6cad-4cdd-8f3d-7375b4e61d73 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:22:10.297579 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18b10fa3-6cad-4cdd-8f3d-7375b4e61d73 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:22:10.297927 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18b10fa3-6cad-4cdd-8f3d-7375b4e61d73 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:22:10.298266 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18b10fa3-6cad-4cdd-8f3d-7375b4e61d73 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:22:10.298605 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18b10fa3-6cad-4cdd-8f3d-7375b4e61d73 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:22:10.298948 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18b10fa3-6cad-4cdd-8f3d-7375b4e61d73 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:22:10.299276 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18b10fa3-6cad-4cdd-8f3d-7375b4e61d73 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:22:10.299608 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18b10fa3-6cad-4cdd-8f3d-7375b4e61d73 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:22:10.299944 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18b10fa3-6cad-4cdd-8f3d-7375b4e61d73 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:22:10.300267 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18b10fa3-6cad-4cdd-8f3d-7375b4e61d73 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:22:10.300594 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18b10fa3-6cad-4cdd-8f3d-7375b4e61d73 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:22:10.307014 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-18b10fa3-6cad-4cdd-8f3d-7375b4e61d73 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:22:10.357526 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-fcfd5ee5-3ddb-49cc-aa11-becc5c80c6bb admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:10.388194 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-fcfd5ee5-3ddb-49cc-aa11-becc5c80c6bb admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:10.450649 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-fcfd5ee5-3ddb-49cc-aa11-becc5c80c6bb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:10.455016 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:22:10.468413 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fcfd5ee5-3ddb-49cc-aa11-becc5c80c6bb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b93d2e71-2ec2-4c90-85e3-f3c0772501d9,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:22:10.474305 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-fcfd5ee5-3ddb-49cc-aa11-becc5c80c6bb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:22:10.476671 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-fcfd5ee5-3ddb-49cc-aa11-becc5c80c6bb admin admin] Notify callbacks [] for security_group, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:10.480926 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-fcfd5ee5-3ddb-49cc-aa11-becc5c80c6bb admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/b93d2e71-2ec2-4c90-85e3-f3c0772501d9 HTTP/1.1" status: 204  len: 168 time: 0.1998541
May 20 04:22:10.828376 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0f8f457-d53a-4aa1-a35c-92cff5adf5a0 req-aa465e4c-484c-484f-b669-cc5ba3d0c1f2 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:10.829255 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df2c114d-b70e-40f8-b4ef-c387e3c2db3c req-b9faca7d-ed27-436f-91c4-88f47d56b29c tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:10.832083 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-df2c114d-b70e-40f8-b4ef-c387e3c2db3c req-b9faca7d-ed27-436f-91c4-88f47d56b29c tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 943 time: 0.1434178
May 20 04:22:10.836137 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-f0f8f457-d53a-4aa1-a35c-92cff5adf5a0 req-aa465e4c-484c-484f-b669-cc5ba3d0c1f2 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/ports?device_id=20a6d6ed-f811-42fd-8b44-ab4c031330e7 HTTP/1.1" status: 200  len: 945 time: 0.1345663
May 20 04:22:10.889896 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-f0f8f457-d53a-4aa1-a35c-92cff5adf5a0 req-f1122bbf-ce60-4f86-9e7d-f410f55aeb5a tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/security-groups?id=a5479633-0923-4a98-9c22-65615d7859f0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0524507
May 20 04:22:10.901746 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-df2c114d-b70e-40f8-b4ef-c387e3c2db3c req-490315d6-e701-4163-ac86-beffe9f49162 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0505910
May 20 04:22:10.921447 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 115e1bac-cc4d-40b5-b860-798c85c78924 details requested by agent hyperv_hv-cinder-79091 with host hv-cinder-79091 {{(pid=91688) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 20 04:22:10.971555 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 65d523e1-f132-4819-aa42-995ded4a1ad8 up at agent hyperv_hv-cinder-79091 {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:22:10.979711 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 36666) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:22:10.998432 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-fc659e1c-3c8c-4770-a620-13fba1f6aba5 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:11.014576 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-fc659e1c-3c8c-4770-a620-13fba1f6aba5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:22:11.018881 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-fc659e1c-3c8c-4770-a620-13fba1f6aba5 admin admin] Usage tracker for resource:security_group_rule and tenant:a98df87ac117427c92e5838af2fc648c is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:22:11.022538 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-fc659e1c-3c8c-4770-a620-13fba1f6aba5 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:22:11.028318 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-fc659e1c-3c8c-4770-a620-13fba1f6aba5 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:22:11.126319 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-fc659e1c-3c8c-4770-a620-13fba1f6aba5 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:11.130678 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-fc659e1c-3c8c-4770-a620-13fba1f6aba5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:11.138582 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-b9a5c3a7-7ee2-4595-a5e3-9292c0e2a317 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:22:11.186463 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-fc659e1c-3c8c-4770-a620-13fba1f6aba5 admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=a98df87ac117427c92e5838af2fc648c&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2055666
May 20 04:22:11.187413 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc659e1c-3c8c-4770-a620-13fba1f6aba5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=31157d20-109c-431e-b90a-1c183c732b6b,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:22:11.189485 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 36670) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:22:11.190640 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-fc659e1c-3c8c-4770-a620-13fba1f6aba5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:22:11.263604 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-dfbc3811-7513-4e92-af30-f6605525079b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:11.294956 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-dfbc3811-7513-4e92-af30-f6605525079b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:11.298479 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port 115e1bac-cc4d-40b5-b860-798c85c78924, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=115e1bac-cc4d-40b5-b860-798c85c78924,segment=NetworkSegment(9521f383-6017-4b4d-9f47-cff4ed54cb57),segment_id=9521f383-6017-4b4d-9f47-cff4ed54cb57)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:22:11.306908 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Provisioning for port 65d523e1-f132-4819-aa42-995ded4a1ad8 completed by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:22:11.316811 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Provisioning complete for port 65d523e1-f132-4819-aa42-995ded4a1ad8 triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:22:11.317297 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:11.348687 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Returning: {'device': '115e1bac-cc4d-40b5-b860-798c85c78924', 'network_id': '21794e86-fda7-40a6-a5a8-db117c7eeb9d', 'port_id': '115e1bac-cc4d-40b5-b860-798c85c78924', 'mac_address': 'fa:16:3e:71:24:f2', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 864, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '06f38702-3d3c-4e25-8f84-85483d1ddf28', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91688) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 20 04:22:11.356933 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-dfbc3811-7513-4e92-af30-f6605525079b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:11.362899 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-deb75242-7908-4fc1-ab2f-af9366ce87d3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:22:11.378890 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfbc3811-7513-4e92-af30-f6605525079b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=31157d20-109c-431e-b90a-1c183c732b6b,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:22:11.391516 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dfbc3811-7513-4e92-af30-f6605525079b admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:22:11.391828 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dfbc3811-7513-4e92-af30-f6605525079b admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:22:11.392107 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dfbc3811-7513-4e92-af30-f6605525079b admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:22:11.392450 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dfbc3811-7513-4e92-af30-f6605525079b admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:22:11.392780 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dfbc3811-7513-4e92-af30-f6605525079b admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:22:11.393167 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dfbc3811-7513-4e92-af30-f6605525079b admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:22:11.393514 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dfbc3811-7513-4e92-af30-f6605525079b admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:22:11.393832 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dfbc3811-7513-4e92-af30-f6605525079b admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:22:11.394162 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dfbc3811-7513-4e92-af30-f6605525079b admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:22:11.394488 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dfbc3811-7513-4e92-af30-f6605525079b admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:22:11.394814 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dfbc3811-7513-4e92-af30-f6605525079b admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:22:11.395134 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dfbc3811-7513-4e92-af30-f6605525079b admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:22:11.398662 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-dfbc3811-7513-4e92-af30-f6605525079b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:22:11.401224 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-dfbc3811-7513-4e92-af30-f6605525079b admin admin] Notify callbacks [] for security_group, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:11.405731 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-dfbc3811-7513-4e92-af30-f6605525079b admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/31157d20-109c-431e-b90a-1c183c732b6b HTTP/1.1" status: 204  len: 168 time: 0.2141969
May 20 04:22:11.452636 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:11.510218 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.notifiers.nova [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 115e1bac-cc4d-40b5-b860-798c85c78924 {{(pid=91688) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 04:22:11.519519 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9118d583-6ed6-472c-a7b6-fcebebc01564 req-506cefda-3eab-4d05-8d53-7bdedb35a178 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:11.521263 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9118d583-6ed6-472c-a7b6-fcebebc01564 req-506cefda-3eab-4d05-8d53-7bdedb35a178 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 944 time: 0.1041343
May 20 04:22:11.543838 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port 115e1bac-cc4d-40b5-b860-798c85c78924, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=115e1bac-cc4d-40b5-b860-798c85c78924,segment=NetworkSegment(9521f383-6017-4b4d-9f47-cff4ed54cb57),segment_id=9521f383-6017-4b4d-9f47-cff4ed54cb57)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:22:11.546835 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:11.562675 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:11.566772 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:22:11.626847 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9118d583-6ed6-472c-a7b6-fcebebc01564 req-306b11ab-e45c-4dac-9855-dbff76f9d869 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0687156
May 20 04:22:11.637906 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7fb31908-b5c9-44dd-ab7c-bb06a577e1c8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '65d523e1-f132-4819-aa42-995ded4a1ad8'}] {{(pid=91688) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:22:11.661513 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port 65d523e1-f132-4819-aa42-995ded4a1ad8, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=65d523e1-f132-4819-aa42-995ded4a1ad8,segment=NetworkSegment(9d2ee761-256d-4e66-82a3-ef6e5bd352c1),segment_id=9d2ee761-256d-4e66-82a3-ef6e5bd352c1)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:22:11.669093 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Pushing event updated for resources: {'Port': ['ID=115e1bac-cc4d-40b5-b860-798c85c78924,revision_number=4']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:22:11.672252 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:11.677708 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:22:11.677708 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-61ab26c4-7772-49e5-8a6f-a6c36e2b71a8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.003s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:22:11.719084 dv-cinder-790910-4-iscsi neutron-server[91688]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7fb31908-b5c9-44dd-ab7c-bb06a577e1c8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '65d523e1-f132-4819-aa42-995ded4a1ad8', 'code': 200}
May 20 04:22:11.760398 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Pushing event updated for resources: {'Port': ['ID=65d523e1-f132-4819-aa42-995ded4a1ad8,revision_number=5']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:22:11.763906 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:22:12.292354 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a8be3ac-1786-4cea-961d-772297d0e127 req-e6aca74d-2ddf-4f5c-8d2e-58fbff334668 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:12.295002 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-2a8be3ac-1786-4cea-961d-772297d0e127 req-e6aca74d-2ddf-4f5c-8d2e-58fbff334668 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/ports?device_id=20a6d6ed-f811-42fd-8b44-ab4c031330e7 HTTP/1.1" status: 200  len: 945 time: 0.2196269
May 20 04:22:12.312290 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f70004da-279d-4f00-a6db-bb4fc0d08dc8 req-3eeb7839-10bb-4d04-a434-47f0acd2288a tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:12.314128 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-f70004da-279d-4f00-a6db-bb4fc0d08dc8 req-3eeb7839-10bb-4d04-a434-47f0acd2288a tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 943 time: 0.2641163
May 20 04:22:12.388290 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-2a8be3ac-1786-4cea-961d-772297d0e127 req-ff3057be-e4bb-4df7-aba7-d9d790097d52 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/security-groups?id=a5479633-0923-4a98-9c22-65615d7859f0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0797184
May 20 04:22:12.391907 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-f70004da-279d-4f00-a6db-bb4fc0d08dc8 req-6419304d-9c2d-4950-acb7-43919424c89f tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0665200
May 20 04:22:12.845933 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-188e9b31-7a9e-4e63-a8f4-f5697394cd2e req-7accb248-a867-4485-9558-978c47be5463 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:12.847723 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-188e9b31-7a9e-4e63-a8f4-f5697394cd2e req-7accb248-a867-4485-9558-978c47be5463 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 945 time: 0.0970111
May 20 04:22:12.910891 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-188e9b31-7a9e-4e63-a8f4-f5697394cd2e req-c8270f0e-0878-4090-a085-83fa41d4f447 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0566647
May 20 04:22:13.620369 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-865987c5-0c74-4221-b2b3-1d8d7691a5d1 req-876b0ea8-ddf3-451c-998c-b5269a1acb2d tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:13.621202 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69e9ce06-ae23-48fd-8361-094ac36aa8ce req-d96bd11e-9ac3-4824-a0eb-cb6df48a5d9a tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:13.622007 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-69e9ce06-ae23-48fd-8361-094ac36aa8ce req-d96bd11e-9ac3-4824-a0eb-cb6df48a5d9a tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 943 time: 0.0900495
May 20 04:22:13.622312 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-865987c5-0c74-4221-b2b3-1d8d7691a5d1 req-876b0ea8-ddf3-451c-998c-b5269a1acb2d tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/ports?device_id=20a6d6ed-f811-42fd-8b44-ab4c031330e7 HTTP/1.1" status: 200  len: 945 time: 0.0906000
May 20 04:22:13.674191 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-69e9ce06-ae23-48fd-8361-094ac36aa8ce req-4086c73d-2de6-4e00-abab-0db2f7590972 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0424931
May 20 04:22:13.676442 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-865987c5-0c74-4221-b2b3-1d8d7691a5d1 req-392caeb6-4239-4a40-a41d-af9bc3a495d6 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/security-groups?id=a5479633-0923-4a98-9c22-65615d7859f0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0447693
May 20 04:22:13.716790 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 10fe1059-aa07-4700-a931-76bcfa45b119 details requested by agent hyperv_hv-cinder-79091 with host hv-cinder-79091 {{(pid=91688) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 20 04:22:13.874062 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port 10fe1059-aa07-4700-a931-76bcfa45b119, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=10fe1059-aa07-4700-a931-76bcfa45b119,segment=NetworkSegment(9d2ee761-256d-4e66-82a3-ef6e5bd352c1),segment_id=9d2ee761-256d-4e66-82a3-ef6e5bd352c1)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:22:13.892008 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Returning: {'device': '10fe1059-aa07-4700-a931-76bcfa45b119', 'network_id': '348b2b0f-c826-45ab-ba85-8430235b9cac', 'port_id': '10fe1059-aa07-4700-a931-76bcfa45b119', 'mac_address': 'fa:16:3e:cc:69:fb', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 897, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b488dc7d-0e70-4e52-9179-7e6c3e4fb0a1', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91688) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 20 04:22:14.007799 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:14.034584 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.notifiers.nova [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 10fe1059-aa07-4700-a931-76bcfa45b119 {{(pid=91688) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 04:22:14.056159 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port 10fe1059-aa07-4700-a931-76bcfa45b119, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=10fe1059-aa07-4700-a931-76bcfa45b119,segment=NetworkSegment(9d2ee761-256d-4e66-82a3-ef6e5bd352c1),segment_id=9d2ee761-256d-4e66-82a3-ef6e5bd352c1)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:22:14.062763 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:14.065391 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:22:14.107416 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f04a687-b48f-4706-a883-1942121461b3 req-e05f714e-4f9a-4eb4-8207-42eb32f92c2b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:14.109957 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-3f04a687-b48f-4706-a883-1942121461b3 req-e05f714e-4f9a-4eb4-8207-42eb32f92c2b service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 1098 time: 0.1465259
May 20 04:22:14.200240 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-3f04a687-b48f-4706-a883-1942121461b3 req-99cd10bc-7113-4438-9934-463226345e25 service neutron] 10.222.0.82 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0707767
May 20 04:22:14.204043 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Pushing event updated for resources: {'Port': ['ID=10fe1059-aa07-4700-a931-76bcfa45b119,revision_number=4']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:22:14.229620 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:22:14.230981 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:22:14.232553 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:22:14.233390 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:22:14.234456 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:22:14.235664 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:22:14.237432 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:22:14.237948 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:22:14.239309 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:22:14.239797 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:22:14.241579 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:22:14.242062 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:22:14.247436 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.182s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:22:14.314775 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b29348fb-9048-48cc-b60c-3311729b4abc req-0cf64fe2-3d79-4efa-8943-34948459d31c tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:14.316382 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-b29348fb-9048-48cc-b60c-3311729b4abc req-0cf64fe2-3d79-4efa-8943-34948459d31c tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 945 time: 0.1834145
May 20 04:22:14.367480 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-b29348fb-9048-48cc-b60c-3311729b4abc req-1adaf771-eed3-4e64-9f14-91557e42a466 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0439923
May 20 04:22:14.855133 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] get_ports_and_sgs() called for port_ids ['115e1bac-cc4d-40b5-b860-798c85c78924'] {{(pid=91688) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 04:22:14.966507 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a7abce0-87ce-47a0-ab7e-90846b661cf3 req-2fef054e-25f3-402a-a9c1-77f60f2c2507 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:14.970535 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-6a7abce0-87ce-47a0-ab7e-90846b661cf3 req-2fef054e-25f3-402a-a9c1-77f60f2c2507 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 944 time: 0.1314864
May 20 04:22:14.972030 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d3aa974-265a-4f90-8e5e-0a16e57b1d31 req-82d8a4e8-bbf6-4e88-9b8c-0c51117736a8 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:14.974120 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-6d3aa974-265a-4f90-8e5e-0a16e57b1d31 req-82d8a4e8-bbf6-4e88-9b8c-0c51117736a8 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/ports?device_id=20a6d6ed-f811-42fd-8b44-ab4c031330e7 HTTP/1.1" status: 200  len: 945 time: 0.1627138
May 20 04:22:15.050567 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-6a7abce0-87ce-47a0-ab7e-90846b661cf3 req-749a14d3-563a-475f-b066-45e0ec2dab4c tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0738711
May 20 04:22:15.073442 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-6d3aa974-265a-4f90-8e5e-0a16e57b1d31 req-3bda184a-d2a8-485e-9427-a1ae35f3ce3c tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/security-groups?id=a5479633-0923-4a98-9c22-65615d7859f0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0858786
May 20 04:22:15.074012 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] get_ports_and_sgs() called for port_ids ['10fe1059-aa07-4700-a931-76bcfa45b119'] {{(pid=91688) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 04:22:15.698237 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a90837d1-ce89-4b73-929f-22bbd8066046 req-371294bd-3131-459c-8f16-9a475e8636df tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:15.702088 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-a90837d1-ce89-4b73-929f-22bbd8066046 req-371294bd-3131-459c-8f16-9a475e8636df tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 945 time: 0.1587863
May 20 04:22:15.800817 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-a90837d1-ce89-4b73-929f-22bbd8066046 req-c8f721df-66f2-4e06-8ddd-5b618e4db645 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0867109
May 20 04:22:16.252326 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b78f68c8-0218-4a1e-911a-8f0713534ec4 req-29b17bdd-6295-44bb-8be4-66a265877273 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:16.253922 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-b78f68c8-0218-4a1e-911a-8f0713534ec4 req-29b17bdd-6295-44bb-8be4-66a265877273 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 944 time: 0.0925562
May 20 04:22:16.310586 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-b78f68c8-0218-4a1e-911a-8f0713534ec4 req-3e6018aa-b193-4016-9804-ef0cbe175952 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0507727
May 20 04:22:17.062681 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec872475-a28b-443e-b74a-1f0591bbc6ca req-b095cc07-0c99-4bfd-b41b-e6094644538f tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:17.064271 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-ec872475-a28b-443e-b74a-1f0591bbc6ca req-b095cc07-0c99-4bfd-b41b-e6094644538f tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 945 time: 0.1178634
May 20 04:22:17.113230 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-ec872475-a28b-443e-b74a-1f0591bbc6ca req-3a2d5b36-e43b-46e1-9af0-371dd6050dbd tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0425124
May 20 04:22:17.556087 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-169b2fe7-5b37-4b84-82bf-58d4ebc74265 req-1d833ec9-94a1-4db2-a3ca-bf9995e78810 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:17.558559 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-169b2fe7-5b37-4b84-82bf-58d4ebc74265 req-1d833ec9-94a1-4db2-a3ca-bf9995e78810 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 944 time: 0.1164575
May 20 04:22:17.616495 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-169b2fe7-5b37-4b84-82bf-58d4ebc74265 req-0101bc0d-3a2d-4a0e-aa50-2406a27ede67 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0512786
May 20 04:22:18.397073 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26527700-a84e-4e23-ab67-8605b616dcd8 req-3bccea9e-180d-43a1-9a0c-90adea68b973 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:18.398527 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-26527700-a84e-4e23-ab67-8605b616dcd8 req-3bccea9e-180d-43a1-9a0c-90adea68b973 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 945 time: 0.0883172
May 20 04:22:18.452288 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-26527700-a84e-4e23-ab67-8605b616dcd8 req-74965280-8ddd-4a1d-8da3-3b648fe6397d tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0433440
May 20 04:22:18.823160 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-906231e2-7119-4478-be22-6a3f190f3c9d req-b502c3f9-c525-4b5d-9f7e-10210ce29964 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:18.824822 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-906231e2-7119-4478-be22-6a3f190f3c9d req-b502c3f9-c525-4b5d-9f7e-10210ce29964 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 944 time: 0.0917504
May 20 04:22:18.896177 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-906231e2-7119-4478-be22-6a3f190f3c9d req-65b0fcb2-717a-4813-a13a-38085c361fa9 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0598679
May 20 04:22:19.659590 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ab900a7-6dd5-4ad9-93b0-14a25fc59efb req-97c6db52-8f61-4515-9054-4df9eeddbc17 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:19.661170 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-7ab900a7-6dd5-4ad9-93b0-14a25fc59efb req-97c6db52-8f61-4515-9054-4df9eeddbc17 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 945 time: 0.0931730
May 20 04:22:19.719782 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-7ab900a7-6dd5-4ad9-93b0-14a25fc59efb req-5cb847f7-a3c7-4406-ac54-0e8c5c81153f tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0485809
May 20 04:22:20.179670 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd0bde85-7b15-485e-ac43-ee27ca546fef req-4ece175d-9764-4130-90cf-558358ec2240 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:20.182615 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-bd0bde85-7b15-485e-ac43-ee27ca546fef req-4ece175d-9764-4130-90cf-558358ec2240 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 944 time: 0.0914299
May 20 04:22:20.250209 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-bd0bde85-7b15-485e-ac43-ee27ca546fef req-c5cda169-fabd-43b6-b24a-8381d93f5f6a tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0585060
May 20 04:22:20.989675 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c284a6ac-b030-4f68-a899-8fb54ad074e8 req-182b2fe7-0df0-4cee-9973-e1a35f38fb1c tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:20.991269 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-c284a6ac-b030-4f68-a899-8fb54ad074e8 req-182b2fe7-0df0-4cee-9973-e1a35f38fb1c tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 945 time: 0.1141777
May 20 04:22:21.044929 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-c284a6ac-b030-4f68-a899-8fb54ad074e8 req-31e8d631-d1e2-42cc-9f2f-73479d067abb tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0432181
May 20 04:22:21.552503 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fefe8c34-2665-405f-a36e-50c2c762b033 req-ed4772ea-054f-45f2-93a6-b3caa1d4abab tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:21.554871 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-fefe8c34-2665-405f-a36e-50c2c762b033 req-ed4772ea-054f-45f2-93a6-b3caa1d4abab tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 944 time: 0.1260924
May 20 04:22:21.605925 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-fefe8c34-2665-405f-a36e-50c2c762b033 req-72864e30-c3ac-45b7-892c-ffee795be046 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0426209
May 20 04:22:22.245301 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 10fe1059-aa07-4700-a931-76bcfa45b119 up at agent hyperv_hv-cinder-79091 {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:22:22.390894 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Provisioning for port 10fe1059-aa07-4700-a931-76bcfa45b119 completed by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:22:22.401256 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Provisioning complete for port 10fe1059-aa07-4700-a931-76bcfa45b119 triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:22:22.402361 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:22.428717 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed2355c6-21c3-435d-b1ed-77c0258fd719 req-52e08812-1807-490f-ba16-4a1735f2f6df tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:22.431425 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-ed2355c6-21c3-435d-b1ed-77c0258fd719 req-52e08812-1807-490f-ba16-4a1735f2f6df tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 945 time: 0.2080905
May 20 04:22:22.532447 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-ed2355c6-21c3-435d-b1ed-77c0258fd719 req-400cb3f0-2c8a-4b07-8558-77f9277991a1 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0924265
May 20 04:22:22.679288 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:22.756616 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port 10fe1059-aa07-4700-a931-76bcfa45b119, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=10fe1059-aa07-4700-a931-76bcfa45b119,segment=NetworkSegment(9d2ee761-256d-4e66-82a3-ef6e5bd352c1),segment_id=9d2ee761-256d-4e66-82a3-ef6e5bd352c1)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:22:22.758722 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2d35fcf1-2045-41ad-8d43-0b244e5b4d20', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '10fe1059-aa07-4700-a931-76bcfa45b119'}] {{(pid=91688) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:22:22.770186 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:22.772128 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 115e1bac-cc4d-40b5-b860-798c85c78924 up at agent hyperv_hv-cinder-79091 {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:22:22.826964 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-8a833570-0998-49d4-b6d8-01b7360e7752 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:22:22.876312 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-483ac5af-5b9d-4e9b-b4e1-6bb7b0dd7919 req-ddd48ca0-a540-437e-8113-c16562711f98 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:22.878104 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-483ac5af-5b9d-4e9b-b4e1-6bb7b0dd7919 req-ddd48ca0-a540-437e-8113-c16562711f98 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 945 time: 0.1369262
May 20 04:22:22.957771 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-483ac5af-5b9d-4e9b-b4e1-6bb7b0dd7919 req-5f501ffb-efc3-44f2-aacf-b87f7038401c tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0721984
May 20 04:22:23.049413 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Pushing event updated for resources: {'Port': ['ID=10fe1059-aa07-4700-a931-76bcfa45b119,revision_number=5']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:22:23.061474 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.235s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:22:23.070789 dv-cinder-790910-4-iscsi neutron-server[91688]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2d35fcf1-2045-41ad-8d43-0b244e5b4d20', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '10fe1059-aa07-4700-a931-76bcfa45b119', 'code': 200}
May 20 04:22:23.077220 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Provisioning for port 115e1bac-cc4d-40b5-b860-798c85c78924 completed by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:22:23.093540 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Provisioning complete for port 115e1bac-cc4d-40b5-b860-798c85c78924 triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:22:23.097777 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:23.352915 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:23.425870 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port 115e1bac-cc4d-40b5-b860-798c85c78924, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=115e1bac-cc4d-40b5-b860-798c85c78924,segment=NetworkSegment(9521f383-6017-4b4d-9f47-cff4ed54cb57),segment_id=9521f383-6017-4b4d-9f47-cff4ed54cb57)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:22:23.436310 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:23.442423 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:22:23.590282 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Pushing event updated for resources: {'Port': ['ID=115e1bac-cc4d-40b5-b860-798c85c78924,revision_number=5']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:22:23.594954 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.153s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:22:23.615941 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce7734c7-388a-4d9e-b567-ddf1affdbcf5 req-96a863e9-5039-47be-b9a6-28bc0a04e57b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:23.618029 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-ce7734c7-388a-4d9e-b567-ddf1affdbcf5 req-96a863e9-5039-47be-b9a6-28bc0a04e57b service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 1098 time: 0.1251693
May 20 04:22:23.723972 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-ce7734c7-388a-4d9e-b567-ddf1affdbcf5 req-8d9d9744-2543-4ec3-a413-27128222af18 service neutron] 10.222.0.82 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0950935
May 20 04:22:23.989827 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98223d83-17dc-4e84-8ae9-b6fba44ff949 req-6b43b06b-78a9-4693-8763-936ea04cb066 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:23.991393 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-98223d83-17dc-4e84-8ae9-b6fba44ff949 req-6b43b06b-78a9-4693-8763-936ea04cb066 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 946 time: 0.1362276
May 20 04:22:24.077915 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-98223d83-17dc-4e84-8ae9-b6fba44ff949 req-a8f021a7-0519-4632-abd6-7b7fcefe468c tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0694628
May 20 04:22:24.315510 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffe6c173-f31e-4e59-89be-d6bf1932df2d req-6bf837ac-5ad9-4f79-bf95-a0327c2d2e90 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:24.317567 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-ffe6c173-f31e-4e59-89be-d6bf1932df2d req-6bf837ac-5ad9-4f79-bf95-a0327c2d2e90 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 945 time: 0.1187980
May 20 04:22:24.474839 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-ffe6c173-f31e-4e59-89be-d6bf1932df2d req-9d999cd1-6b84-42d9-a217-112a4dc2eb01 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1445284
May 20 04:22:24.722743 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 36966) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:22:24.847550 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 36976) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:22:25.036603 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-27b4a608-7fea-4aa2-83cb-f522fd8cfb8b admin admin] Notify callbacks [] for security_group, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:25.071595 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f32b55e5-d82f-4c9e-a67f-08d83c24cf4d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '115e1bac-cc4d-40b5-b860-798c85c78924'}] {{(pid=91688) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:22:25.079248 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-27b4a608-7fea-4aa2-83cb-f522fd8cfb8b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:22:25.086217 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-27b4a608-7fea-4aa2-83cb-f522fd8cfb8b admin admin] Usage tracker for resource:security_group_rule and tenant:33a9c138832c4a66b0ad5eb218b2f2ee is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:22:25.089444 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-606a4c83-6ed4-4bbc-aebf-1ef9d9e2b55a admin admin] Notify callbacks [] for security_group, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:25.102503 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-27b4a608-7fea-4aa2-83cb-f522fd8cfb8b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:22:25.133218 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-27b4a608-7fea-4aa2-83cb-f522fd8cfb8b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:22:25.140327 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-606a4c83-6ed4-4bbc-aebf-1ef9d9e2b55a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:22:25.162807 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-606a4c83-6ed4-4bbc-aebf-1ef9d9e2b55a admin admin] Usage tracker for resource:security_group_rule and tenant:225c26cff2f94312a4494d5990dcd8d1 is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:22:25.170818 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-606a4c83-6ed4-4bbc-aebf-1ef9d9e2b55a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:22:25.184707 dv-cinder-790910-4-iscsi neutron-server[91688]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f32b55e5-d82f-4c9e-a67f-08d83c24cf4d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '115e1bac-cc4d-40b5-b860-798c85c78924', 'code': 200}
May 20 04:22:25.197499 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-606a4c83-6ed4-4bbc-aebf-1ef9d9e2b55a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:22:25.416499 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-27b4a608-7fea-4aa2-83cb-f522fd8cfb8b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:25.429710 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-27b4a608-7fea-4aa2-83cb-f522fd8cfb8b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:25.440685 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-cec06234-ad55-40b4-ad57-d17b6c0c4e9b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:22:25.474146 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-606a4c83-6ed4-4bbc-aebf-1ef9d9e2b55a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:25.507966 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-606a4c83-6ed4-4bbc-aebf-1ef9d9e2b55a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:25.581866 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-27b4a608-7fea-4aa2-83cb-f522fd8cfb8b admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=33a9c138832c4a66b0ad5eb218b2f2ee&name=default HTTP/1.1" status: 200  len: 2979 time: 0.8573492
May 20 04:22:25.599048 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0a155ca-538c-4703-ba24-c936e77a4313 req-38094be2-b3a1-4a28-b874-048e4c8d4faf tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:25.601805 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-e0a155ca-538c-4703-ba24-c936e77a4313 req-38094be2-b3a1-4a28-b874-048e4c8d4faf tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 946 time: 0.2973523
May 20 04:22:25.602367 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 37004) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:22:25.613782 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27b4a608-7fea-4aa2-83cb-f522fd8cfb8b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=da98e6da-2cff-41e0-a39d-b728fb4635f6,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:22:25.642288 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-27b4a608-7fea-4aa2-83cb-f522fd8cfb8b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.201s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:22:25.642956 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.093s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:22:25.764070 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-606a4c83-6ed4-4bbc-aebf-1ef9d9e2b55a admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=225c26cff2f94312a4494d5990dcd8d1&name=default HTTP/1.1" status: 200  len: 2979 time: 0.9146950
May 20 04:22:25.798732 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 37016) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:22:25.834622 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-606a4c83-6ed4-4bbc-aebf-1ef9d9e2b55a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f2ecee2b-6617-4148-820a-bdcb4a3f7bf0,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:22:25.838580 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-606a4c83-6ed4-4bbc-aebf-1ef9d9e2b55a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.196s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:22:25.860049 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-2f40b9d6-0b26-481c-ad81-7008d3d9a8ad admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:25.920873 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-2f40b9d6-0b26-481c-ad81-7008d3d9a8ad admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:25.961085 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-cee5aa18-7c09-44d7-a293-3f6e02c24552 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:26.019257 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-cee5aa18-7c09-44d7-a293-3f6e02c24552 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:26.053882 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-e0a155ca-538c-4703-ba24-c936e77a4313 req-b02983b3-ac4d-436b-bf7d-717cfc25b3a1 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.3044786
May 20 04:22:26.089263 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-2f40b9d6-0b26-481c-ad81-7008d3d9a8ad admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:26.095909 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-160d080d-e9d4-4326-8c1f-10d430700697 req-bf32bc47-e947-4b8a-b708-d22db7f2f1c8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:26.097065 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-ad2b0843-8bb0-4117-9bdc-1cbbedf5967f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:22:26.099168 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-160d080d-e9d4-4326-8c1f-10d430700697 req-bf32bc47-e947-4b8a-b708-d22db7f2f1c8 service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 1099 time: 0.4637225
May 20 04:22:26.115206 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f40b9d6-0b26-481c-ad81-7008d3d9a8ad admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=da98e6da-2cff-41e0-a39d-b728fb4635f6,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:22:26.126211 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-2f40b9d6-0b26-481c-ad81-7008d3d9a8ad admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:22:26.127674 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-2f40b9d6-0b26-481c-ad81-7008d3d9a8ad admin admin] Notify callbacks [] for security_group, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:26.129631 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-2f40b9d6-0b26-481c-ad81-7008d3d9a8ad admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/da98e6da-2cff-41e0-a39d-b728fb4635f6 HTTP/1.1" status: 204  len: 168 time: 0.5260212
May 20 04:22:26.133091 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e8dcce4-b54f-463b-9d44-b47e682a6190 req-6bea8118-7839-4755-be8a-994092168431 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:26.141097 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-8e8dcce4-b54f-463b-9d44-b47e682a6190 req-6bea8118-7839-4755-be8a-994092168431 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 945 time: 0.3101878
May 20 04:22:26.215028 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-cee5aa18-7c09-44d7-a293-3f6e02c24552 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:26.230985 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-5eec21e9-f949-4563-b09e-4e6e201425e1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:22:26.343266 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-160d080d-e9d4-4326-8c1f-10d430700697 req-9230bb97-5722-4b0b-916d-92b09efe1746 service neutron] 10.222.0.82 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.2360716
May 20 04:22:26.367844 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cee5aa18-7c09-44d7-a293-3f6e02c24552 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f2ecee2b-6617-4148-820a-bdcb4a3f7bf0,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:22:26.375576 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-cee5aa18-7c09-44d7-a293-3f6e02c24552 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.145s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:22:26.389435 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-8e8dcce4-b54f-463b-9d44-b47e682a6190 req-620cd9e4-1176-40ae-aef3-8181db4a05de tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2470798
May 20 04:22:26.401918 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-cee5aa18-7c09-44d7-a293-3f6e02c24552 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:26.405016 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-cee5aa18-7c09-44d7-a293-3f6e02c24552 admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/f2ecee2b-6617-4148-820a-bdcb4a3f7bf0 HTTP/1.1" status: 204  len: 168 time: 0.6041787
May 20 04:22:26.576481 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 37030) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:22:26.597677 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-af0e688a-e66e-4f2a-8604-0a27155ccb28 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:26.615436 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-af0e688a-e66e-4f2a-8604-0a27155ccb28 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:22:26.619832 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-af0e688a-e66e-4f2a-8604-0a27155ccb28 admin admin] Usage tracker for resource:security_group_rule and tenant:3da69189e9ae452ea1a5c50e1aa429de is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:22:26.623860 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-af0e688a-e66e-4f2a-8604-0a27155ccb28 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:22:26.631975 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-af0e688a-e66e-4f2a-8604-0a27155ccb28 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:22:26.781298 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-af0e688a-e66e-4f2a-8604-0a27155ccb28 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:26.787612 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-af0e688a-e66e-4f2a-8604-0a27155ccb28 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:26.805385 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-a2e8308e-bc15-42a4-a715-c2f5131d3764 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:22:26.857457 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-af0e688a-e66e-4f2a-8604-0a27155ccb28 admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=3da69189e9ae452ea1a5c50e1aa429de&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2793627
May 20 04:22:26.858521 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af0e688a-e66e-4f2a-8604-0a27155ccb28 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=058c49d2-90ec-4bb6-8a80-b11d4d96f671,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:22:26.860601 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 37040) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:22:26.875231 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-af0e688a-e66e-4f2a-8604-0a27155ccb28 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:22:27.112755 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 37054) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:22:27.127281 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-7737d743-2a2c-4ab0-8aa7-95402f1856ef admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:27.150947 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-087fa116-7ded-47a1-bbe9-e075d29d393f admin admin] Notify callbacks [] for security_group, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:27.177078 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-087fa116-7ded-47a1-bbe9-e075d29d393f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:22:27.188482 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-087fa116-7ded-47a1-bbe9-e075d29d393f admin admin] Usage tracker for resource:security_group_rule and tenant:ac3da20419fe4b929c8afecd66189f4e is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:22:27.195319 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-087fa116-7ded-47a1-bbe9-e075d29d393f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:22:27.209203 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-087fa116-7ded-47a1-bbe9-e075d29d393f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:22:27.245153 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-7737d743-2a2c-4ab0-8aa7-95402f1856ef admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:27.402673 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d8d249d-0b7f-47a2-88e1-eeb5f742dc6d req-e533f49c-71ce-4731-bf78-a1f4c71c4129 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:27.404582 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-3d8d249d-0b7f-47a2-88e1-eeb5f742dc6d req-e533f49c-71ce-4731-bf78-a1f4c71c4129 service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=b7d86d894a5f420e86f4c28d7772bd22&device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 1098 time: 0.3404410
May 20 04:22:27.444623 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8b97eef-b026-47d2-8cbb-20e0cec848d7 req-df5c23da-6d41-42bc-a24d-86eaea13af10 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:27.446259 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-a8b97eef-b026-47d2-8cbb-20e0cec848d7 req-df5c23da-6d41-42bc-a24d-86eaea13af10 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 946 time: 0.1548939
May 20 04:22:27.451556 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-087fa116-7ded-47a1-bbe9-e075d29d393f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:27.461063 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-087fa116-7ded-47a1-bbe9-e075d29d393f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:27.474643 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-7737d743-2a2c-4ab0-8aa7-95402f1856ef admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:27.477588 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:22:27.482535 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-cee5aa18-7c09-44d7-a293-3f6e02c24552 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:22:27.583565 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-087fa116-7ded-47a1-bbe9-e075d29d393f admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=ac3da20419fe4b929c8afecd66189f4e&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4693832
May 20 04:22:27.587634 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 37062) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:22:27.764105 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-a8b97eef-b026-47d2-8cbb-20e0cec848d7 req-7dbf0cd1-6f48-4096-80d9-6a1323850a19 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.2743900
May 20 04:22:27.765291 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d8d249d-0b7f-47a2-88e1-eeb5f742dc6d req-9b9eac0b-1464-40f9-a628-fc643020e294 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:27.766406 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-3d8d249d-0b7f-47a2-88e1-eeb5f742dc6d req-9b9eac0b-1464-40f9-a628-fc643020e294 service neutron] 10.222.0.82 "GET /v2.0/networks?id=348b2b0f-c826-45ab-ba85-8430235b9cac HTTP/1.1" status: 200  len: 920 time: 0.3532245
May 20 04:22:27.777974 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-55287143-3309-4250-879e-a237b1e2d37d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:27.778509 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7737d743-2a2c-4ab0-8aa7-95402f1856ef admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=058c49d2-90ec-4bb6-8a80-b11d4d96f671,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:22:27.783484 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-7737d743-2a2c-4ab0-8aa7-95402f1856ef admin admin] Notify callbacks [] for security_group, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:27.787264 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-087fa116-7ded-47a1-bbe9-e075d29d393f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=90074b9d-4385-4871-8892-92404e72b438,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:22:27.793864 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-7737d743-2a2c-4ab0-8aa7-95402f1856ef admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/058c49d2-90ec-4bb6-8a80-b11d4d96f671 HTTP/1.1" status: 204  len: 168 time: 0.9261413
May 20 04:22:27.805405 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-7737d743-2a2c-4ab0-8aa7-95402f1856ef admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.323s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:22:27.878364 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-087fa116-7ded-47a1-bbe9-e075d29d393f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.401s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:22:27.915140 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-55287143-3309-4250-879e-a237b1e2d37d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:27.978205 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41fab405-1837-4e80-a8a8-6c6295c1aac3 req-af63a045-c111-429d-92a3-35ebba603868 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:27.979800 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-41fab405-1837-4e80-a8a8-6c6295c1aac3 req-af63a045-c111-429d-92a3-35ebba603868 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 945 time: 0.7594817
May 20 04:22:28.001592 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-3d8d249d-0b7f-47a2-88e1-eeb5f742dc6d req-e8c29660-db99-4e84-a65a-9dd649b47564 service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=10fe1059-aa07-4700-a931-76bcfa45b119 HTTP/1.1" status: 200  len: 217 time: 0.2195666
May 20 04:22:28.099899 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-55287143-3309-4250-879e-a237b1e2d37d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:28.104105 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-41fab405-1837-4e80-a8a8-6c6295c1aac3 req-02ee4070-fdd1-4013-ae26-dd9344281a20 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1045189
May 20 04:22:28.112886 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-2e0cadfd-ff2f-4864-9839-056543d095ae admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:22:28.141041 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d8d249d-0b7f-47a2-88e1-eeb5f742dc6d req-27954556-1a83-4e31-9e96-528c4930ef39 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:28.141041 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-3d8d249d-0b7f-47a2-88e1-eeb5f742dc6d req-27954556-1a83-4e31-9e96-528c4930ef39 service neutron] 10.222.0.82 "GET /v2.0/subnets?id=b488dc7d-0e70-4e52-9179-7e6c3e4fb0a1 HTTP/1.1" status: 200  len: 859 time: 0.0971830
May 20 04:22:28.154538 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55287143-3309-4250-879e-a237b1e2d37d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=90074b9d-4385-4871-8892-92404e72b438,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:22:28.162482 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-55287143-3309-4250-879e-a237b1e2d37d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:22:28.167712 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-55287143-3309-4250-879e-a237b1e2d37d admin admin] Notify callbacks [] for security_group, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:28.169123 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-55287143-3309-4250-879e-a237b1e2d37d admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/90074b9d-4385-4871-8892-92404e72b438 HTTP/1.1" status: 204  len: 168 time: 0.5704658
May 20 04:22:28.370600 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-3d8d249d-0b7f-47a2-88e1-eeb5f742dc6d req-16afa186-2169-4f1c-ab3b-b7497d4b36e9 service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=348b2b0f-c826-45ab-ba85-8430235b9cac&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.2176297
May 20 04:22:28.625011 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-40472265-22b8-466e-84c9-1f46169f2294 req-ab1af1d8-e32f-452a-8374-aa09d89f6ca8 service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=20a6d6ed-f811-42fd-8b44-ab4c031330e7&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.3877385
May 20 04:22:28.696758 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-3d8d249d-0b7f-47a2-88e1-eeb5f742dc6d req-d1eb6e3c-d190-4068-aaa0-718cf931b1dd service neutron] 10.222.0.82 "GET /v2.0/networks/348b2b0f-c826-45ab-ba85-8430235b9cac?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2967591
May 20 04:22:29.227050 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-3d8d249d-0b7f-47a2-88e1-eeb5f742dc6d req-dfc626a7-f3ad-45ec-a422-dffe7e88b29b service neutron] 10.222.0.82 "GET /v2.0/networks/348b2b0f-c826-45ab-ba85-8430235b9cac?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.5129261
May 20 04:22:29.261834 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40472265-22b8-466e-84c9-1f46169f2294 req-5ff15085-d3c4-40cc-b979-09b37e1a1a56 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:29.268756 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-40472265-22b8-466e-84c9-1f46169f2294 req-5ff15085-d3c4-40cc-b979-09b37e1a1a56 service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=b6214ee7a3fe4823b9db71f53439835e&device_id=20a6d6ed-f811-42fd-8b44-ab4c031330e7 HTTP/1.1" status: 200  len: 1098 time: 0.5142922
May 20 04:22:29.561422 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63b36e45-a60f-40bf-a4e6-e2f6f721ef0c req-84a131c5-f763-45a1-956b-d4a7d7f589bc tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:29.595245 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-63b36e45-a60f-40bf-a4e6-e2f6f721ef0c req-84a131c5-f763-45a1-956b-d4a7d7f589bc tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 946 time: 0.3670633
May 20 04:22:29.877790 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-9cf6abb3-26a7-4994-979f-ada8ec05e711 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:29.938103 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-63b36e45-a60f-40bf-a4e6-e2f6f721ef0c req-a36a6ac5-4cba-4db0-afbe-11626147ab4a tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.3412521
May 20 04:22:30.042501 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 37136) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:22:30.105150 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40472265-22b8-466e-84c9-1f46169f2294 req-c17df432-896e-4696-a105-bd5e6e3f4d46 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:30.107553 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-40472265-22b8-466e-84c9-1f46169f2294 req-c17df432-896e-4696-a105-bd5e6e3f4d46 service neutron] 10.222.0.82 "GET /v2.0/networks?id=4100b38a-1db4-4a6e-9c33-7bcf19c64d59 HTTP/1.1" status: 200  len: 913 time: 0.7972972
May 20 04:22:30.223895 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aff7bbc4-c396-4b8b-8663-372438dd8332 req-f1f350ab-1319-4c22-a137-901036d50174 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:30.225623 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-aff7bbc4-c396-4b8b-8663-372438dd8332 req-f1f350ab-1319-4c22-a137-901036d50174 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 945 time: 0.4167755
May 20 04:22:30.227099 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-40472265-22b8-466e-84c9-1f46169f2294 req-cb76324e-8d54-4100-ae46-0c28e2a6391c service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=49f0e77b-6589-4f2f-9f47-7eb071a38ce6 HTTP/1.1" status: 200  len: 217 time: 0.1089730
May 20 04:22:30.276570 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-52c6903c-c045-4a9f-84eb-333a58a51d7c admin admin] Notify callbacks [] for security_group, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:30.331082 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-52c6903c-c045-4a9f-84eb-333a58a51d7c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:22:30.337743 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40472265-22b8-466e-84c9-1f46169f2294 req-4d0bc69c-9fa0-4db5-a493-0cee41b7e70c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:30.339388 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-40472265-22b8-466e-84c9-1f46169f2294 req-4d0bc69c-9fa0-4db5-a493-0cee41b7e70c service neutron] 10.222.0.82 "GET /v2.0/subnets?id=88b525de-7494-46b7-a333-32b76e112ad7 HTTP/1.1" status: 200  len: 852 time: 0.1049910
May 20 04:22:30.347505 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-52c6903c-c045-4a9f-84eb-333a58a51d7c admin admin] Usage tracker for resource:security_group_rule and tenant:60d838c1d0d3488f936a012a4757c244 is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:22:30.350655 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-aff7bbc4-c396-4b8b-8663-372438dd8332 req-e4f8793c-b9dd-4310-9bae-2b7cda11837d tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0822506
May 20 04:22:30.354981 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-52c6903c-c045-4a9f-84eb-333a58a51d7c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:22:30.386556 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-52c6903c-c045-4a9f-84eb-333a58a51d7c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:22:30.410369 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-40472265-22b8-466e-84c9-1f46169f2294 req-8d838ebd-2772-4e04-b0b8-c3447fd77320 service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=4100b38a-1db4-4a6e-9c33-7bcf19c64d59&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0540712
May 20 04:22:30.428151 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ace1c4f-c4e3-4880-accc-4bfc4592868a req-27353856-afc5-499d-b52c-4ec37843f915 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:30.430855 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-9ace1c4f-c4e3-4880-accc-4bfc4592868a req-27353856-afc5-499d-b52c-4ec37843f915 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 946 time: 0.2678235
May 20 04:22:30.450046 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 37150) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:22:30.457329 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.v2.base [None req-58fc35c1-ef93-4088-a4c4-4b9139765ac1 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Request body: {'floatingip': {'port_id': '115e1bac-cc4d-40b5-b860-798c85c78924'}} {{(pid=91686) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:22:30.556347 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-58fc35c1-ef93-4088-a4c4-4b9139765ac1 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks [] for floatingip, before_update {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:30.754240 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-40472265-22b8-466e-84c9-1f46169f2294 req-2cf09f34-018e-4b65-87bb-a1c773626bbb service neutron] 10.222.0.82 "GET /v2.0/networks/4100b38a-1db4-4a6e-9c33-7bcf19c64d59?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3301430
May 20 04:22:30.982477 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-40472265-22b8-466e-84c9-1f46169f2294 req-809510ba-83d1-4462-9cee-e99dfcc23e1b service neutron] 10.222.0.82 "GET /v2.0/networks/4100b38a-1db4-4a6e-9c33-7bcf19c64d59?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2182503
May 20 04:22:31.061926 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-52c6903c-c045-4a9f-84eb-333a58a51d7c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:31.078582 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-52c6903c-c045-4a9f-84eb-333a58a51d7c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:31.124018 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:22:31.143686 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-52c6903c-c045-4a9f-84eb-333a58a51d7c admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=60d838c1d0d3488f936a012a4757c244&name=default HTTP/1.1" status: 200  len: 2979 time: 1.0941846
May 20 04:22:31.144155 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 37174) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:22:31.267497 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52c6903c-c045-4a9f-84eb-333a58a51d7c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2beab203-9398-46d5-b6dc-67477b7db684,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:22:31.282608 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-52c6903c-c045-4a9f-84eb-333a58a51d7c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.159s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:22:31.314345 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-cd301e67-fb58-4f7e-bd44-e52cbeffea9c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:31.364855 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-cd301e67-fb58-4f7e-bd44-e52cbeffea9c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:31.500858 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-cd301e67-fb58-4f7e-bd44-e52cbeffea9c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:31.514477 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:22:31.543276 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-cd301e67-fb58-4f7e-bd44-e52cbeffea9c admin admin] Notify callbacks [] for security_group, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:31.545069 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-cd301e67-fb58-4f7e-bd44-e52cbeffea9c admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/2beab203-9398-46d5-b6dc-67477b7db684 HTTP/1.1" status: 204  len: 168 time: 0.4005606
May 20 04:22:31.546629 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd301e67-fb58-4f7e-bd44-e52cbeffea9c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2beab203-9398-46d5-b6dc-67477b7db684,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:22:31.551418 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-cd301e67-fb58-4f7e-bd44-e52cbeffea9c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:22:31.830118 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8687b54-aaca-41bc-8fef-d2c9701e061b req-34d1bd04-a4fb-4ed8-ac84-3a34cd0970ea tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:31.832564 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-c8687b54-aaca-41bc-8fef-d2c9701e061b req-34d1bd04-a4fb-4ed8-ac84-3a34cd0970ea tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 945 time: 0.2405651
May 20 04:22:31.951448 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.db.resource_extend [None req-58fc35c1-ef93-4088-a4c4-4b9139765ac1 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] It took 0.13 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=91686) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}}
May 20 04:22:32.011797 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-c8687b54-aaca-41bc-8fef-d2c9701e061b req-136434c2-d87f-4265-b024-87d7bfb09b3a tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1700943
May 20 04:22:32.166675 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-58fc35c1-ef93-4088-a4c4-4b9139765ac1 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks [] for floatingip, precommit_update {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:32.178444 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-58fc35c1-ef93-4088-a4c4-4b9139765ac1 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1716406'] for floatingip, after_update {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:32.550377 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:32.704016 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-7e6a02c9-b53c-4fc9-8553-768d4093abd6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:32.733682 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.db.l3_db [None req-58fc35c1-ef93-4088-a4c4-4b9139765ac1 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Floating IP d48a0309-c834-4503-947b-c46dcd773365 associated. External IP: 172.27.1.199, port: 115e1bac-cc4d-40b5-b860-798c85c78924.
May 20 04:22:32.831110 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 37212) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:22:32.854144 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-a0b9e856-781b-443a-9872-bdf65b593a0b admin admin] Notify callbacks [] for security_group, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:32.876450 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-a0b9e856-781b-443a-9872-bdf65b593a0b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:22:32.888569 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-a0b9e856-781b-443a-9872-bdf65b593a0b admin admin] Usage tracker for resource:security_group_rule and tenant:f7150f5b8da547738dac9c6b28a46c54 is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:22:32.899578 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-a0b9e856-781b-443a-9872-bdf65b593a0b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:22:32.920977 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-a0b9e856-781b-443a-9872-bdf65b593a0b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:22:33.148588 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-a0b9e856-781b-443a-9872-bdf65b593a0b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:33.155851 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-a0b9e856-781b-443a-9872-bdf65b593a0b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:33.192414 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-fef1e47c-3250-41c9-892b-b418ccc6784a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:22:33.200639 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-58fc35c1-ef93-4088-a4c4-4b9139765ac1 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Router 34eeb764-2607-4d9f-96c4-89598b702500 has already been hosted by L3 agent 02733fc0-fc9c-4e29-bc03-c27a792d539d {{(pid=91686) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 04:22:33.290416 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0b9e856-781b-443a-9872-bdf65b593a0b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2f478bec-2733-4732-b31b-9f74c3f5dcfd,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:22:33.313493 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-a0b9e856-781b-443a-9872-bdf65b593a0b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:22:33.353285 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 37228) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:22:33.353473 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ea4803bd-878f-47d5-9084-1ec41953c9db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:33.353632 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-a0b9e856-781b-443a-9872-bdf65b593a0b admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=f7150f5b8da547738dac9c6b28a46c54&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5123849
May 20 04:22:33.677520 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:33.798211 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-4b580db9-0ada-4bb7-bc9b-ee104bea48cb admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:33.851609 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5dab9ef-a725-4ec2-8e84-e4c79c19bde4 req-2405276f-ff6c-445f-bcb8-cec799d95f51 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:33.854493 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-c5dab9ef-a725-4ec2-8e84-e4c79c19bde4 req-2405276f-ff6c-445f-bcb8-cec799d95f51 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 945 time: 0.5073371
May 20 04:22:33.872998 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-58fc35c1-ef93-4088-a4c4-4b9139765ac1 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify agent at l3_agent.dv-cinder-790910-4-iscsi the message routers_updated {{(pid=91686) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 04:22:33.891042 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-77493eaa-f11a-40b4-8b82-53aeb565a93a None None] Sync routers for ids ['34eeb764-2607-4d9f-96c4-89598b702500'] in dv-cinder-790910-4-iscsi {{(pid=91689) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 04:22:33.915764 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-77493eaa-f11a-40b4-8b82-53aeb565a93a None None] Routers {'34eeb764-2607-4d9f-96c4-89598b702500'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91689) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:22:33.916700 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-77493eaa-f11a-40b4-8b82-53aeb565a93a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced1ba6f10>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:22:33Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['34eeb764-2607-4d9f-96c4-89598b702500'], 'active': True} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:22:33.956909 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-4b580db9-0ada-4bb7-bc9b-ee104bea48cb admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:34.082643 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-c5dab9ef-a725-4ec2-8e84-e4c79c19bde4 req-25a2b971-5059-4b12-9aab-db6172a37d32 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2129114
May 20 04:22:34.104160 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-58fc35c1-ef93-4088-a4c4-4b9139765ac1 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for floatingip, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:34.236136 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-58fc35c1-ef93-4088-a4c4-4b9139765ac1 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "PUT /v2.0/floatingips/d48a0309-c834-4503-947b-c46dcd773365 HTTP/1.1" status: 200  len: 992 time: 3.7817912
May 20 04:22:34.239298 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f32b55e5-d82f-4c9e-a67f-08d83c24cf4d', 'tag': '115e1bac-cc4d-40b5-b860-798c85c78924'}] {{(pid=91686) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:22:34.300552 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-4b580db9-0ada-4bb7-bc9b-ee104bea48cb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:34.305744 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvr_db [None req-77493eaa-f11a-40b4-8b82-53aeb565a93a None None] Set router 34eeb764-2607-4d9f-96c4-89598b702500 gateway port host: dv-cinder-790910-4-iscsi {{(pid=91689) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:22:34.324516 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-f04aa4e7-4814-4f0e-addb-41d170890fe6 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:22:34.371372 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b580db9-0ada-4bb7-bc9b-ee104bea48cb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2f478bec-2733-4732-b31b-9f74c3f5dcfd,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:22:34.380359 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-4b580db9-0ada-4bb7-bc9b-ee104bea48cb admin admin] Notify callbacks [] for security_group, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:34.395719 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-4b580db9-0ada-4bb7-bc9b-ee104bea48cb admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/2f478bec-2733-4732-b31b-9f74c3f5dcfd HTTP/1.1" status: 204  len: 168 time: 1.0427148
May 20 04:22:34.396812 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-4b580db9-0ada-4bb7-bc9b-ee104bea48cb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:22:34.424790 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6c6c78a-48f6-41d8-a4f8-2b01cce5c8b5 req-897a0ae1-9d13-4bc5-ac61-ebbaf921eb8d tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:34.429450 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-b6c6c78a-48f6-41d8-a4f8-2b01cce5c8b5 req-897a0ae1-9d13-4bc5-ac61-ebbaf921eb8d tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/ports?device_id=20a6d6ed-f811-42fd-8b44-ab4c031330e7 HTTP/1.1" status: 200  len: 945 time: 0.2707562
May 20 04:22:34.530102 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-b6c6c78a-48f6-41d8-a4f8-2b01cce5c8b5 req-972b5d28-76de-406d-9486-abacf5453a2b tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/security-groups?id=a5479633-0923-4a98-9c22-65615d7859f0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0876997
May 20 04:22:34.629536 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f32b55e5-d82f-4c9e-a67f-08d83c24cf4d', 'tag': '115e1bac-cc4d-40b5-b860-798c85c78924', 'status': 'completed', 'code': 200}
May 20 04:22:35.002957 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-77493eaa-f11a-40b4-8b82-53aeb565a93a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced1ba6f10>, [{'id': '34eeb764-2607-4d9f-96c4-89598b702500', 'name': 'tempest-AttachVolumeShelveTestJSON-1895235554-router', 'tenant_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.72'}], 'enable_snat': True}, 'gw_port_id': '16508f6e-35a3-4301-9018-78e099969b00', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:21:10Z', 'updated_at': '2021-05-20T04:21:20Z', 'revision_number': 4, 'project_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'gw_port': {'id': '16508f6e-35a3-4301-9018-78e099969b00', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:e3:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '34eeb764-2607-4d9f-96c4-89598b702500', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:21:12Z', 'updated_at': '2021-05-20T04:21:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_floatingips': [{'id': 'd48a0309-c834-4503-947b-c46dcd773365', 'tenant_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'floating_ip_address': '172.27.1.199', 'floating_network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'router_id': '34eeb764-2607-4d9f-96c4-89598b702500', 'port_id': '115e1bac-cc4d-40b5-b860-798c85c78924', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 120, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '21794e86-fda7-40a6-a5a8-db117c7eeb9d', 'mac_address': 'fa:16:3e:71:24:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f32b55e5-d82f-4c9e-a67f-08d83c24cf4d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T04:21:35Z', 'updated_at': '2021-05-20T04:22:31Z', 'revision_number': 1, 'project_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'aad390e4-f9e2-4bbe-9e64-7b390cc7f3b3', 'name': '', 'network_id': '21794e86-fda7-40a6-a5a8-db117c7eeb9d', 'tenant_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'mac_address': 'fa:16:3e:b2:b9:f0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '34eeb764-2607-4d9f-96c4-89598b702500', 'device_owner': 'network:router_interface', 'standard_attr_id': 88, 'fixed_ips': [{'subnet_id': '06f38702-3d3c-4e25-8f84-85483d1ddf28', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:21:18Z', 'updated_at': '2021-05-20T04:21:40Z', 'revision_number': 5, 'project_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'subnets': [{'id': '06f38702-3d3c-4e25-8f84-85483d1ddf28', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:22:35.011562 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-77493eaa-f11a-40b4-8b82-53aeb565a93a None None] Checking router: 34eeb764-2607-4d9f-96c4-89598b702500 for host: dv-cinder-790910-4-iscsi {{(pid=91689) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 04:22:35.029166 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-77493eaa-f11a-40b4-8b82-53aeb565a93a None None] Routers {'34eeb764-2607-4d9f-96c4-89598b702500'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91689) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:22:35.030224 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-77493eaa-f11a-40b4-8b82-53aeb565a93a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced1ba6f10>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:22:33Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['34eeb764-2607-4d9f-96c4-89598b702500'], 'active': True} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:22:35.161168 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f21320cc-6a25-4ec1-8a32-8b119b35fd55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:35.349158 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-038bc9fe-0586-4332-b4b8-8e0992f668c7 req-04984b25-9344-43be-bb04-fda27773d6e8 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:35.350646 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvr_db [None req-77493eaa-f11a-40b4-8b82-53aeb565a93a None None] Set router 34eeb764-2607-4d9f-96c4-89598b702500 gateway port host: dv-cinder-790910-4-iscsi {{(pid=91689) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:22:35.351600 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-038bc9fe-0586-4332-b4b8-8e0992f668c7 req-04984b25-9344-43be-bb04-fda27773d6e8 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 945 time: 0.1419473
May 20 04:22:35.422828 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-038bc9fe-0586-4332-b4b8-8e0992f668c7 req-b520b2e7-0260-443e-9afe-1e0e0da63b50 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0639153
May 20 04:22:35.787042 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-513c44e0-daa7-4935-b1db-8ea6b688b5ec req-772e32b5-0e2c-4970-8187-6c083dc77ffa tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:35.790863 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-513c44e0-daa7-4935-b1db-8ea6b688b5ec req-772e32b5-0e2c-4970-8187-6c083dc77ffa tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/ports?device_id=20a6d6ed-f811-42fd-8b44-ab4c031330e7 HTTP/1.1" status: 200  len: 945 time: 0.1191821
May 20 04:22:35.848634 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-77493eaa-f11a-40b4-8b82-53aeb565a93a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced1ba6f10>, [{'id': '34eeb764-2607-4d9f-96c4-89598b702500', 'name': 'tempest-AttachVolumeShelveTestJSON-1895235554-router', 'tenant_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.72'}], 'enable_snat': True}, 'gw_port_id': '16508f6e-35a3-4301-9018-78e099969b00', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:21:10Z', 'updated_at': '2021-05-20T04:21:20Z', 'revision_number': 4, 'project_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'gw_port': {'id': '16508f6e-35a3-4301-9018-78e099969b00', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:e3:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '34eeb764-2607-4d9f-96c4-89598b702500', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:21:12Z', 'updated_at': '2021-05-20T04:21:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_floatingips': [{'id': 'd48a0309-c834-4503-947b-c46dcd773365', 'tenant_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'floating_ip_address': '172.27.1.199', 'floating_network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'router_id': '34eeb764-2607-4d9f-96c4-89598b702500', 'port_id': '115e1bac-cc4d-40b5-b860-798c85c78924', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 120, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '21794e86-fda7-40a6-a5a8-db117c7eeb9d', 'mac_address': 'fa:16:3e:71:24:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f32b55e5-d82f-4c9e-a67f-08d83c24cf4d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T04:21:35Z', 'updated_at': '2021-05-20T04:22:31Z', 'revision_number': 1, 'project_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'aad390e4-f9e2-4bbe-9e64-7b390cc7f3b3', 'name': '', 'network_id': '21794e86-fda7-40a6-a5a8-db117c7eeb9d', 'tenant_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'mac_address': 'fa:16:3e:b2:b9:f0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '34eeb764-2607-4d9f-96c4-89598b702500', 'device_owner': 'network:router_interface', 'standard_attr_id': 88, 'fixed_ips': [{'subnet_id': '06f38702-3d3c-4e25-8f84-85483d1ddf28', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:21:18Z', 'updated_at': '2021-05-20T04:21:40Z', 'revision_number': 5, 'project_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'subnets': [{'id': '06f38702-3d3c-4e25-8f84-85483d1ddf28', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:22:35.858024 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-77493eaa-f11a-40b4-8b82-53aeb565a93a None None] The sync data for ids ['34eeb764-2607-4d9f-96c4-89598b702500'] in dv-cinder-790910-4-iscsi is: [{'id': '34eeb764-2607-4d9f-96c4-89598b702500', 'name': 'tempest-AttachVolumeShelveTestJSON-1895235554-router', 'tenant_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.72'}], 'enable_snat': True}, 'gw_port_id': '16508f6e-35a3-4301-9018-78e099969b00', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:21:10Z', 'updated_at': '2021-05-20T04:21:20Z', 'revision_number': 4, 'project_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'gw_port': {'id': '16508f6e-35a3-4301-9018-78e099969b00', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:e3:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '34eeb764-2607-4d9f-96c4-89598b702500', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:21:12Z', 'updated_at': '2021-05-20T04:21:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_floatingips': [{'id': 'd48a0309-c834-4503-947b-c46dcd773365', 'tenant_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'floating_ip_address': '172.27.1.199', 'floating_network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'router_id': '34eeb764-2607-4d9f-96c4-89598b702500', 'port_id': '115e1bac-cc4d-40b5-b860-798c85c78924', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 120, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '21794e86-fda7-40a6-a5a8-db117c7eeb9d', 'mac_address': 'fa:16:3e:71:24:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f32b55e5-d82f-4c9e-a67f-08d83c24cf4d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T04:21:35Z', 'updated_at': '2021-05-20T04:22:31Z', 'revision_number': 1, 'project_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'aad390e4-f9e2-4bbe-9e64-7b390cc7f3b3', 'name': '', 'network_id': '21794e86-fda7-40a6-a5a8-db117c7eeb9d', 'tenant_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'mac_address': 'fa:16:3e:b2:b9:f0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '34eeb764-2607-4d9f-96c4-89598b702500', 'device_owner': 'network:router_interface', 'standard_attr_id': 88, 'fixed_ips': [{'subnet_id': '06f38702-3d3c-4e25-8f84-85483d1ddf28', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:21:18Z', 'updated_at': '2021-05-20T04:21:40Z', 'revision_number': 5, 'project_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'subnets': [{'id': '06f38702-3d3c-4e25-8f84-85483d1ddf28', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91689) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 04:22:35.873680 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-513c44e0-daa7-4935-b1db-8ea6b688b5ec req-c1d095d2-5445-41dd-a7af-cad50129cdbb tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/security-groups?id=a5479633-0923-4a98-9c22-65615d7859f0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0744565
May 20 04:22:36.173054 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-388704a8-bdc0-45df-96fc-fc7a3ac33e24 None None] New status for floating IP d48a0309-c834-4503-947b-c46dcd773365: ACTIVE {{(pid=91688) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 20 04:22:36.663138 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00abefaf-33b4-46c3-af88-296368914521 req-320c478d-1bed-492e-ab9e-3b6aa7ac2daf tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:36.666371 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-00abefaf-33b4-46c3-af88-296368914521 req-320c478d-1bed-492e-ab9e-3b6aa7ac2daf tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 945 time: 0.1000974
May 20 04:22:36.740131 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-00abefaf-33b4-46c3-af88-296368914521 req-65dc304d-9d51-4551-befa-b5ed459195bb tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0671544
May 20 04:22:37.124527 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5508e69-3465-438f-9f12-5442a7f7b560 req-ef8fc118-2196-4857-9bf3-23a13b60086e tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:37.130116 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a5508e69-3465-438f-9f12-5442a7f7b560 req-ef8fc118-2196-4857-9bf3-23a13b60086e tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/ports?device_id=20a6d6ed-f811-42fd-8b44-ab4c031330e7 HTTP/1.1" status: 200  len: 945 time: 0.1127462
May 20 04:22:37.204093 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a5508e69-3465-438f-9f12-5442a7f7b560 req-551291d5-3492-4feb-835d-bbb72d75f174 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/security-groups?id=a5479633-0923-4a98-9c22-65615d7859f0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0703313
May 20 04:22:38.022878 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f606b1e-8097-46fe-abe9-2ab36b3daaf4 req-32cc73ab-f3c3-4e6a-a375-1477a18ecf5c tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:38.026598 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-3f606b1e-8097-46fe-abe9-2ab36b3daaf4 req-32cc73ab-f3c3-4e6a-a375-1477a18ecf5c tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 945 time: 0.1575689
May 20 04:22:38.104194 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-3f606b1e-8097-46fe-abe9-2ab36b3daaf4 req-721f133e-b697-4cac-aac6-29becd0e8532 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0733900
May 20 04:22:38.487090 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4603fb1b-7b35-4f03-8a97-273bc6372449 req-5452fccb-11f7-47fb-88e0-668ef16aa9e5 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:38.489093 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4603fb1b-7b35-4f03-8a97-273bc6372449 req-5452fccb-11f7-47fb-88e0-668ef16aa9e5 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/ports?device_id=20a6d6ed-f811-42fd-8b44-ab4c031330e7 HTTP/1.1" status: 200  len: 945 time: 0.1129394
May 20 04:22:38.564265 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4603fb1b-7b35-4f03-8a97-273bc6372449 req-ddfa49bd-6ec0-4137-abc0-515361d21245 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/security-groups?id=a5479633-0923-4a98-9c22-65615d7859f0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0655937
May 20 04:22:39.355241 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47d01faa-a939-4937-bebb-71a5733e445c req-c18447c2-b9de-4d63-81f4-4a4081aed0b8 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:39.357167 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-47d01faa-a939-4937-bebb-71a5733e445c req-c18447c2-b9de-4d63-81f4-4a4081aed0b8 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 945 time: 0.1214926
May 20 04:22:39.413584 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-47d01faa-a939-4937-bebb-71a5733e445c req-a66df3d5-8320-4ee0-93b7-2549f8f4ca0e tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0493550
May 20 04:22:39.617470 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6216b5c0-af01-43a0-b440-f5c3c9852aeb req-e7b97f77-4ed7-4215-b565-597f20d99129 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:39.618982 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-6216b5c0-af01-43a0-b440-f5c3c9852aeb req-e7b97f77-4ed7-4215-b565-597f20d99129 service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=ef3bec4745b14484ac8e21cd16cbd11d&device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 1099 time: 0.0991218
May 20 04:22:39.869482 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6216b5c0-af01-43a0-b440-f5c3c9852aeb req-b317f69e-9680-4f89-b1f7-f8c08093f238 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:39.871228 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-6216b5c0-af01-43a0-b440-f5c3c9852aeb req-b317f69e-9680-4f89-b1f7-f8c08093f238 service neutron] 10.222.0.82 "GET /v2.0/networks?id=21794e86-fda7-40a6-a5a8-db117c7eeb9d HTTP/1.1" status: 200  len: 918 time: 0.2438476
May 20 04:22:39.953307 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92b3a5cc-30e0-42e1-8791-85428380c5bb req-93b989d5-217e-4614-b67a-2babf5c268f0 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:39.954854 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-92b3a5cc-30e0-42e1-8791-85428380c5bb req-93b989d5-217e-4614-b67a-2babf5c268f0 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/ports?device_id=20a6d6ed-f811-42fd-8b44-ab4c031330e7 HTTP/1.1" status: 200  len: 945 time: 0.1882803
May 20 04:22:40.097551 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-6216b5c0-af01-43a0-b440-f5c3c9852aeb req-cb4b77ff-919a-481b-bdca-78031c765fae service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=115e1bac-cc4d-40b5-b860-798c85c78924 HTTP/1.1" status: 200  len: 1002 time: 0.2175174
May 20 04:22:40.105576 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-92b3a5cc-30e0-42e1-8791-85428380c5bb req-b0dcd616-d4c1-4f10-96c3-4d7130d22c2b tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/security-groups?id=a5479633-0923-4a98-9c22-65615d7859f0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1415975
May 20 04:22:40.167699 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6216b5c0-af01-43a0-b440-f5c3c9852aeb req-837b25dc-90e4-4167-ae80-cc612088954c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:40.170156 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-6216b5c0-af01-43a0-b440-f5c3c9852aeb req-837b25dc-90e4-4167-ae80-cc612088954c service neutron] 10.222.0.82 "GET /v2.0/subnets?id=06f38702-3d3c-4e25-8f84-85483d1ddf28 HTTP/1.1" status: 200  len: 856 time: 0.0635595
May 20 04:22:40.308828 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6216b5c0-af01-43a0-b440-f5c3c9852aeb req-c6b36fff-7b11-4dcd-bef2-e7400ac44ce6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:40.310409 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-6216b5c0-af01-43a0-b440-f5c3c9852aeb req-c6b36fff-7b11-4dcd-bef2-e7400ac44ce6 service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=21794e86-fda7-40a6-a5a8-db117c7eeb9d&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1311681
May 20 04:22:40.457616 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-6216b5c0-af01-43a0-b440-f5c3c9852aeb req-0d915e08-7f5b-4954-8eec-9f6379de517c service neutron] 10.222.0.82 "GET /v2.0/networks/21794e86-fda7-40a6-a5a8-db117c7eeb9d?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1376581
May 20 04:22:40.640044 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-6216b5c0-af01-43a0-b440-f5c3c9852aeb req-533703a4-8440-4e48-b0e8-cccdc713b9c3 service neutron] 10.222.0.82 "GET /v2.0/networks/21794e86-fda7-40a6-a5a8-db117c7eeb9d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1742208
May 20 04:22:40.703733 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4155d6ae-351c-4b9a-83be-b87ca9ecc5cb req-df4d7134-7a56-4cdd-9856-3508a4c58fb4 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:40.705510 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-4155d6ae-351c-4b9a-83be-b87ca9ecc5cb req-df4d7134-7a56-4cdd-9856-3508a4c58fb4 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 945 time: 0.1681564
May 20 04:22:40.794146 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-4155d6ae-351c-4b9a-83be-b87ca9ecc5cb req-f1dbdc4c-b308-4061-a15a-335448e51edd tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0788050
May 20 04:22:41.371856 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6a23f2c-395b-4b51-93a0-7b1397496bda req-38946ab5-783e-45cd-a969-9c90ecff4775 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:41.374595 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-f6a23f2c-395b-4b51-93a0-7b1397496bda req-38946ab5-783e-45cd-a969-9c90ecff4775 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/ports?device_id=20a6d6ed-f811-42fd-8b44-ab4c031330e7 HTTP/1.1" status: 200  len: 945 time: 0.1057258
May 20 04:22:41.455961 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-f6a23f2c-395b-4b51-93a0-7b1397496bda req-9ece7ef8-dfd0-4383-a15c-c348379e9af3 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/security-groups?id=a5479633-0923-4a98-9c22-65615d7859f0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0699978
May 20 04:22:42.103573 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-caa436aa-10ce-453d-bb75-869a7d6395f3 req-e479188a-39dd-4eec-80e7-f94522e44fb1 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:42.105457 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-caa436aa-10ce-453d-bb75-869a7d6395f3 req-e479188a-39dd-4eec-80e7-f94522e44fb1 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 945 time: 0.1198075
May 20 04:22:42.159516 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-caa436aa-10ce-453d-bb75-869a7d6395f3 req-d8115b22-8d61-4517-bade-a65ba758bf04 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0480814
May 20 04:22:42.309813 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c423dcc-df67-4b7b-9c6d-5c04a4fca23f req-a184e319-daca-4eb6-aaeb-0874adccd376 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:42.311357 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9c423dcc-df67-4b7b-9c6d-5c04a4fca23f req-a184e319-daca-4eb6-aaeb-0874adccd376 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.82 "GET /v2.0/ports?device_id=20a6d6ed-f811-42fd-8b44-ab4c031330e7 HTTP/1.1" status: 200  len: 945 time: 0.1126213
May 20 04:22:42.486525 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [req-9c423dcc-df67-4b7b-9c6d-5c04a4fca23f req-a9b31bd2-3651-495f-8937-e84a49b57e3e tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Deleting port 49f0e77b-6589-4f2f-9f47-7eb071a38ce6 {{(pid=91687) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 04:22:42.486905 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-9c423dcc-df67-4b7b-9c6d-5c04a4fca23f req-a9b31bd2-3651-495f-8937-e84a49b57e3e tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8782892520551'] for port, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:42.701530 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [req-9c423dcc-df67-4b7b-9c6d-5c04a4fca23f req-a9b31bd2-3651-495f-8937-e84a49b57e3e tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] For port 49f0e77b-6589-4f2f-9f47-7eb071a38ce6, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=49f0e77b-6589-4f2f-9f47-7eb071a38ce6,segment=NetworkSegment(743e4a81-111b-4929-b0d4-50516fe60014),segment_id=743e4a81-111b-4929-b0d4-50516fe60014)] {{(pid=91687) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:22:42.702115 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-9c423dcc-df67-4b7b-9c6d-5c04a4fca23f req-a9b31bd2-3651-495f-8937-e84a49b57e3e tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1718922'] for port, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:42.719714 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c073f82d-a735-40a2-a55c-cbf93692c95a req-01987103-f85d-4e3b-a360-772456244da7 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:42.721323 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-c073f82d-a735-40a2-a55c-cbf93692c95a req-01987103-f85d-4e3b-a360-772456244da7 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/ports?device_id=20a6d6ed-f811-42fd-8b44-ab4c031330e7 HTTP/1.1" status: 200  len: 945 time: 0.0862274
May 20 04:22:42.760634 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.agents_db [None req-92d61f12-17bc-4bf9-9eab-8a69b8c6da2f None None] Agent healthcheck: found 6 active agents {{(pid=91689) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 04:22:42.772978 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-c073f82d-a735-40a2-a55c-cbf93692c95a req-f76aa0ce-d066-4b71-9a9e-5af90c4614c9 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/security-groups?id=a5479633-0923-4a98-9c22-65615d7859f0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0444837
May 20 04:22:42.945456 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [req-9c423dcc-df67-4b7b-9c6d-5c04a4fca23f req-a9b31bd2-3651-495f-8937-e84a49b57e3e tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Calling delete_port for 49f0e77b-6589-4f2f-9f47-7eb071a38ce6 owned by compute:nova {{(pid=91687) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 04:22:43.237748 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-9c423dcc-df67-4b7b-9c6d-5c04a4fca23f req-a9b31bd2-3651-495f-8937-e84a49b57e3e tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8782892522936', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8782892108804', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4162192'] for port, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:43.246349 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-58ec3c4d-2fce-4f74-91c4-6ecd46daf319 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:22:43.254466 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] get_ports_and_sgs() called for port_ids ['49f0e77b-6589-4f2f-9f47-7eb071a38ce6'] {{(pid=91688) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 04:22:43.349006 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9b31bd2-3651-495f-8937-e84a49b57e3e tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Pushing event deleted for resources: {'Port': ['ID=49f0e77b-6589-4f2f-9f47-7eb071a38ce6,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:22:43.357044 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-a9b31bd2-3651-495f-8937-e84a49b57e3e tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:22:43.462356 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.l3_dvrscheduler_db [req-9c423dcc-df67-4b7b-9c6d-5c04a4fca23f req-a9b31bd2-3651-495f-8937-e84a49b57e3e tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] No DVR routers for this DVR port 49f0e77b-6589-4f2f-9f47-7eb071a38ce6 on host hv-cinder-79091 {{(pid=91687) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 04:22:43.467449 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-9c423dcc-df67-4b7b-9c6d-5c04a4fca23f req-a9b31bd2-3651-495f-8937-e84a49b57e3e tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for port, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:43.478071 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '20a6d6ed-f811-42fd-8b44-ab4c031330e7', 'name': 'network-vif-deleted', 'tag': '49f0e77b-6589-4f2f-9f47-7eb071a38ce6'}] {{(pid=91687) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:22:43.513615 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9c423dcc-df67-4b7b-9c6d-5c04a4fca23f req-a9b31bd2-3651-495f-8937-e84a49b57e3e tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.82 "DELETE /v2.0/ports/49f0e77b-6589-4f2f-9f47-7eb071a38ce6 HTTP/1.1" status: 204  len: 173 time: 1.1939328
May 20 04:22:43.570464 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '20a6d6ed-f811-42fd-8b44-ab4c031330e7', 'name': 'network-vif-deleted', 'tag': '49f0e77b-6589-4f2f-9f47-7eb071a38ce6', 'status': 'completed', 'code': 200}
May 20 04:22:43.590664 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfdba1b6-6c87-4b77-9994-1f38c7ddef6c req-9953a801-165a-4d34-b0be-938cb39e2ed5 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:43.599651 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-bfdba1b6-6c87-4b77-9994-1f38c7ddef6c req-9953a801-165a-4d34-b0be-938cb39e2ed5 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 945 time: 0.1960030
May 20 04:22:43.647248 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-bfdba1b6-6c87-4b77-9994-1f38c7ddef6c req-f30af882-a2a9-4505-8c99-96af4b6936c4 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0462482
May 20 04:22:43.967334 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-381359d6-e15f-4cab-a77f-a8b3fdeca5f8 req-54fbbd70-3e85-42df-a54f-cddcd8f948f4 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Synchronizing usage tracker for tenant:b6214ee7a3fe4823b9db71f53439835e on resource:port {{(pid=91687) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:22:43.993064 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-381359d6-e15f-4cab-a77f-a8b3fdeca5f8 req-54fbbd70-3e85-42df-a54f-cddcd8f948f4 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Unset dirty status for tenant:b6214ee7a3fe4823b9db71f53439835e on resource:port {{(pid=91687) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:22:43.995027 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-381359d6-e15f-4cab-a77f-a8b3fdeca5f8 req-54fbbd70-3e85-42df-a54f-cddcd8f948f4 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/ports?device_id=20a6d6ed-f811-42fd-8b44-ab4c031330e7 HTTP/1.1" status: 200  len: 210 time: 0.1014760
May 20 04:22:44.920076 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 37544) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:22:44.945079 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 37550) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:22:45.044392 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52fd5574-4292-40f3-aa34-106a7d68a83b req-d58106c6-5c0a-4acd-a52d-febb9e8d33aa tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:45.058801 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-52fd5574-4292-40f3-aa34-106a7d68a83b req-d58106c6-5c0a-4acd-a52d-febb9e8d33aa tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 945 time: 0.2077336
May 20 04:22:45.145723 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-52fd5574-4292-40f3-aa34-106a7d68a83b req-991483c3-1bdf-4262-b5f4-7ba75a27c65e tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0834663
May 20 04:22:45.190456 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-1f76a0b1-fa74-4021-9162-22ac1baeacc4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:45.268569 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-af728259-8677-4fc9-827b-0a3882b9f3b1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:45.277963 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-1f76a0b1-fa74-4021-9162-22ac1baeacc4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:22:45.283857 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-b52a4f88-badc-411c-b8da-d7ad6152e682 req-266deba8-875f-4ad6-b872-2559baa9c1d4 tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] 10.222.0.71 "GET /v2.0/ports?device_id=20a6d6ed-f811-42fd-8b44-ab4c031330e7 HTTP/1.1" status: 200  len: 210 time: 0.0799005
May 20 04:22:45.288600 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-1f76a0b1-fa74-4021-9162-22ac1baeacc4 admin admin] Usage tracker for resource:security_group_rule and tenant:b98e0e730524428ebffa867bfdad9d79 is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:22:45.293002 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-1f76a0b1-fa74-4021-9162-22ac1baeacc4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:22:45.300426 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-af728259-8677-4fc9-827b-0a3882b9f3b1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:22:45.305106 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-1f76a0b1-fa74-4021-9162-22ac1baeacc4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:22:45.307465 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-af728259-8677-4fc9-827b-0a3882b9f3b1 admin admin] Usage tracker for resource:security_group_rule and tenant:b8bcc59dad6b4aa28a383b47f88c3c74 is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:22:45.311364 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-af728259-8677-4fc9-827b-0a3882b9f3b1 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:22:45.322625 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-af728259-8677-4fc9-827b-0a3882b9f3b1 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:22:45.490736 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-1f76a0b1-fa74-4021-9162-22ac1baeacc4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:45.506780 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-1f76a0b1-fa74-4021-9162-22ac1baeacc4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:45.519300 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-087fa116-7ded-47a1-bbe9-e075d29d393f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:22:45.530696 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-af728259-8677-4fc9-827b-0a3882b9f3b1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:45.550979 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-af728259-8677-4fc9-827b-0a3882b9f3b1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:45.578907 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-1f76a0b1-fa74-4021-9162-22ac1baeacc4 admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=b98e0e730524428ebffa867bfdad9d79&name=default HTTP/1.1" status: 200  len: 2979 time: 0.6573272
May 20 04:22:45.583402 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 37570) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:22:45.593135 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f76a0b1-fa74-4021-9162-22ac1baeacc4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=637b416b-40b4-4205-abda-2b7355f7983a,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:22:45.599144 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-1f76a0b1-fa74-4021-9162-22ac1baeacc4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:22:45.599924 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-52c6903c-c045-4a9f-84eb-333a58a51d7c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.030s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:22:45.619783 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-af728259-8677-4fc9-827b-0a3882b9f3b1 admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=b8bcc59dad6b4aa28a383b47f88c3c74&name=default HTTP/1.1" status: 200  len: 2979 time: 0.6728175
May 20 04:22:45.623978 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 37574) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:22:45.682373 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-71983a4f-0bb3-4ea7-aff0-d1b6a4f86b5b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:45.741410 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-71983a4f-0bb3-4ea7-aff0-d1b6a4f86b5b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:45.773137 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af728259-8677-4fc9-827b-0a3882b9f3b1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0f322435-de98-4888-8fc7-35e8345befa1,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:22:45.783735 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-af728259-8677-4fc9-827b-0a3882b9f3b1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.184s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:22:45.842884 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-71983a4f-0bb3-4ea7-aff0-d1b6a4f86b5b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:45.852882 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-d38de1a8-4960-497e-8adb-06ebc558088b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:45.853702 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-fc659e1c-3c8c-4770-a620-13fba1f6aba5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:22:45.879469 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71983a4f-0bb3-4ea7-aff0-d1b6a4f86b5b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=637b416b-40b4-4205-abda-2b7355f7983a,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:22:45.885953 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-71983a4f-0bb3-4ea7-aff0-d1b6a4f86b5b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:22:45.889914 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-d38de1a8-4960-497e-8adb-06ebc558088b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:45.894131 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-71983a4f-0bb3-4ea7-aff0-d1b6a4f86b5b admin admin] Notify callbacks [] for security_group, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:45.897259 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-71983a4f-0bb3-4ea7-aff0-d1b6a4f86b5b admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/637b416b-40b4-4205-abda-2b7355f7983a HTTP/1.1" status: 204  len: 168 time: 0.3125527
May 20 04:22:45.994485 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-d38de1a8-4960-497e-8adb-06ebc558088b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:46.002385 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:22:46.043121 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d38de1a8-4960-497e-8adb-06ebc558088b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0f322435-de98-4888-8fc7-35e8345befa1,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:22:46.047422 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-d38de1a8-4960-497e-8adb-06ebc558088b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:22:46.065159 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-d38de1a8-4960-497e-8adb-06ebc558088b admin admin] Notify callbacks [] for security_group, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:46.066313 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-d38de1a8-4960-497e-8adb-06ebc558088b admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/0f322435-de98-4888-8fc7-35e8345befa1 HTTP/1.1" status: 204  len: 168 time: 0.4410934
May 20 04:22:46.358686 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 49f0e77b-6589-4f2f-9f47-7eb071a38ce6 no longer exists at agent hyperv_hv-cinder-79091 {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 04:22:46.398355 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] No Port match for: 49f0e77b-6589-4f2f-9f47-7eb071a38ce6 {{(pid=91688) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 04:22:46.398745 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 49f0e77b-6589-4f2f-9f47-7eb071a38ce6 not bound to the agent host hv-cinder-79091 {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 04:22:46.474732 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 37600) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:22:46.499828 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0948e9a-f318-4e27-baa8-3a162976f4c8 req-b8300915-356a-4b1a-b7eb-f63cac1d164f tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:46.501563 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-e0948e9a-f318-4e27-baa8-3a162976f4c8 req-b8300915-356a-4b1a-b7eb-f63cac1d164f tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 945 time: 0.1447830
May 20 04:22:46.506818 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-c23e3535-6f48-461e-908b-d36a3a258cc9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:46.543837 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-c23e3535-6f48-461e-908b-d36a3a258cc9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:22:46.550804 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-c23e3535-6f48-461e-908b-d36a3a258cc9 admin admin] Usage tracker for resource:security_group_rule and tenant:e0226dfdc679401bad195ad106625afc is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:22:46.562378 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-c23e3535-6f48-461e-908b-d36a3a258cc9 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:22:46.574134 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-c23e3535-6f48-461e-908b-d36a3a258cc9 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:22:46.582044 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-e0948e9a-f318-4e27-baa8-3a162976f4c8 req-a5152e0f-7c76-4b29-9a95-d43d4390444a tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0631442
May 20 04:22:46.712371 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-c23e3535-6f48-461e-908b-d36a3a258cc9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:46.718196 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-c23e3535-6f48-461e-908b-d36a3a258cc9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:46.726043 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-f46585a9-73be-4e0d-987f-4472845d220c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:22:46.741893 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 37612) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:22:46.771480 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-c23e3535-6f48-461e-908b-d36a3a258cc9 admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=e0226dfdc679401bad195ad106625afc&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2954030
May 20 04:22:46.776371 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 37616) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:22:46.779677 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c23e3535-6f48-461e-908b-d36a3a258cc9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cc4ce94d-1f48-4e12-96ad-6418207cfa2e,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:22:46.799287 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-c23e3535-6f48-461e-908b-d36a3a258cc9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:22:46.862577 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-176bd93f-f0df-4e24-80a1-5b60f4a9dc8e admin admin] Notify callbacks [] for security_group, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:46.870001 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-85150698-2ff6-4c8c-9aeb-f897482d76be admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:46.880483 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-176bd93f-f0df-4e24-80a1-5b60f4a9dc8e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:22:46.886094 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-176bd93f-f0df-4e24-80a1-5b60f4a9dc8e admin admin] Usage tracker for resource:security_group_rule and tenant:047e0ef0a31c438d8f23e63f967180f7 is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:22:46.893914 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-176bd93f-f0df-4e24-80a1-5b60f4a9dc8e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:22:46.901645 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-176bd93f-f0df-4e24-80a1-5b60f4a9dc8e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:22:46.929447 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-85150698-2ff6-4c8c-9aeb-f897482d76be admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:47.017229 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-85150698-2ff6-4c8c-9aeb-f897482d76be admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:47.026383 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-176bd93f-f0df-4e24-80a1-5b60f4a9dc8e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:47.027119 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-17d8d33f-a4c6-465e-be83-a8839603f3c9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:22:47.032470 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-176bd93f-f0df-4e24-80a1-5b60f4a9dc8e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:47.043978 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-90d2c1f6-871d-4295-8339-8c0db5ab2c30 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:22:47.051230 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85150698-2ff6-4c8c-9aeb-f897482d76be admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cc4ce94d-1f48-4e12-96ad-6418207cfa2e,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:22:47.057636 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-85150698-2ff6-4c8c-9aeb-f897482d76be admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:22:47.061182 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-85150698-2ff6-4c8c-9aeb-f897482d76be admin admin] Notify callbacks [] for security_group, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:47.065509 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-85150698-2ff6-4c8c-9aeb-f897482d76be admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/cc4ce94d-1f48-4e12-96ad-6418207cfa2e HTTP/1.1" status: 204  len: 168 time: 0.2854931
May 20 04:22:47.129860 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-176bd93f-f0df-4e24-80a1-5b60f4a9dc8e admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=047e0ef0a31c438d8f23e63f967180f7&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3819807
May 20 04:22:47.131117 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 37626) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:22:47.140290 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-176bd93f-f0df-4e24-80a1-5b60f4a9dc8e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3191197f-cb38-48a6-acf8-4fa8d48519fa,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:22:47.145803 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-176bd93f-f0df-4e24-80a1-5b60f4a9dc8e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:22:47.210819 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-91ec9d45-2ce6-4b90-a8d1-4c313ae2eb72 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:47.244374 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-91ec9d45-2ce6-4b90-a8d1-4c313ae2eb72 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:47.316171 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-91ec9d45-2ce6-4b90-a8d1-4c313ae2eb72 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:47.320112 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-dfbc3811-7513-4e92-af30-f6605525079b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:22:47.332087 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91ec9d45-2ce6-4b90-a8d1-4c313ae2eb72 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3191197f-cb38-48a6-acf8-4fa8d48519fa,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:22:47.334581 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-91ec9d45-2ce6-4b90-a8d1-4c313ae2eb72 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:22:47.341126 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-91ec9d45-2ce6-4b90-a8d1-4c313ae2eb72 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:47.353913 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-91ec9d45-2ce6-4b90-a8d1-4c313ae2eb72 admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/3191197f-cb38-48a6-acf8-4fa8d48519fa HTTP/1.1" status: 204  len: 168 time: 0.2214193
May 20 04:22:47.718534 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 37656) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:22:47.759493 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-e6d9e027-f280-4f1a-8fdf-fcf06188bf66 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:47.778849 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-e6d9e027-f280-4f1a-8fdf-fcf06188bf66 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:22:47.786127 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-e6d9e027-f280-4f1a-8fdf-fcf06188bf66 admin admin] Usage tracker for resource:security_group_rule and tenant:683b0d9bb0f94b8181b49ad52e1c7a1e is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:22:47.790670 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-e6d9e027-f280-4f1a-8fdf-fcf06188bf66 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:22:47.800787 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-e6d9e027-f280-4f1a-8fdf-fcf06188bf66 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:22:48.037768 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-e6d9e027-f280-4f1a-8fdf-fcf06188bf66 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:48.049516 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-e6d9e027-f280-4f1a-8fdf-fcf06188bf66 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:48.074685 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-1cc56189-d139-4ba5-896d-89ca32afec74 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:22:48.176422 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-e6d9e027-f280-4f1a-8fdf-fcf06188bf66 admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=683b0d9bb0f94b8181b49ad52e1c7a1e&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4554095
May 20 04:22:48.180316 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6d9e027-f280-4f1a-8fdf-fcf06188bf66 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=748da3b9-baec-49b7-b6a0-f6360eb949dc,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:22:48.181064 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 37674) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:22:48.184998 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-e6d9e027-f280-4f1a-8fdf-fcf06188bf66 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:22:48.258276 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ac4e15f-f363-4713-9643-da540c92d56b req-acab1e8c-53f6-4675-95d5-139654ffd5d7 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:48.267698 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-7ac4e15f-f363-4713-9643-da540c92d56b req-acab1e8c-53f6-4675-95d5-139654ffd5d7 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 945 time: 0.1747489
May 20 04:22:48.342396 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-2bca636c-b2eb-4cc3-b788-87e936f035b4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:48.384271 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-2bca636c-b2eb-4cc3-b788-87e936f035b4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:48.417261 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-7ac4e15f-f363-4713-9643-da540c92d56b req-8ea3c198-1db2-4a28-9641-dfc96a631f0d tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1332502
May 20 04:22:48.466680 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-2bca636c-b2eb-4cc3-b788-87e936f035b4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:48.482163 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-58f68fc4-610b-4305-b809-6b3f044d756f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:22:48.504430 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2bca636c-b2eb-4cc3-b788-87e936f035b4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=748da3b9-baec-49b7-b6a0-f6360eb949dc,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:22:48.517690 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-2bca636c-b2eb-4cc3-b788-87e936f035b4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:22:48.523079 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-2bca636c-b2eb-4cc3-b788-87e936f035b4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:48.524649 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-2bca636c-b2eb-4cc3-b788-87e936f035b4 admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/748da3b9-baec-49b7-b6a0-f6360eb949dc HTTP/1.1" status: 204  len: 168 time: 0.3422363
May 20 04:22:48.565210 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 37690) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:22:48.683834 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.db_base_plugin_v2 [None req-09444ff1-f071-45e4-8c60-edb3b6952cbb admin admin] Deleting subnet 88b525de-7494-46b7-a333-32b76e112ad7 {{(pid=91686) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 20 04:22:48.689196 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-09444ff1-f071-45e4-8c60-edb3b6952cbb admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:48.753742 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-09444ff1-f071-45e4-8c60-edb3b6952cbb admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4081462'] for subnet, precommit_delete_associations {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:48.852141 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-09444ff1-f071-45e4-8c60-edb3b6952cbb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1504133'] for subnet, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:49.317227 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-09444ff1-f071-45e4-8c60-edb3b6952cbb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1504178', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-255887', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2114755', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2442237'] for subnet, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:49.329284 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-c3db815f-156d-4cb3-b8cb-a795a2d69a36 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:22:49.403517 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09444ff1-f071-45e4-8c60-edb3b6952cbb admin admin] Pushing event deleted for resources: {'Subnet': ['ID=88b525de-7494-46b7-a333-32b76e112ad7,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:22:49.421720 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-09444ff1-f071-45e4-8c60-edb3b6952cbb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:22:49.442645 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-09444ff1-f071-45e4-8c60-edb3b6952cbb admin admin] Notify callbacks [] for subnet, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:49.485482 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 37774) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:22:49.489992 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-09444ff1-f071-45e4-8c60-edb3b6952cbb admin admin] 10.222.0.71 "DELETE /v2.0/subnets/88b525de-7494-46b7-a333-32b76e112ad7 HTTP/1.1" status: 204  len: 168 time: 0.9230742
May 20 04:22:49.737642 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-b84b7633-027f-4db1-93a8-640d97a5f09a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-593149'] for network, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:49.840153 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-672663bd-8f39-4252-8124-d3ae2cb44c02 req-cff9a571-ff32-4a1b-8f9f-5c28349a4d5f tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:49.847491 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-672663bd-8f39-4252-8124-d3ae2cb44c02 req-cff9a571-ff32-4a1b-8f9f-5c28349a4d5f tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 945 time: 0.1986864
May 20 04:22:49.927982 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-b84b7633-027f-4db1-93a8-640d97a5f09a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1505550', 'neutron.services.segments.db._delete_segments_for_network-8782892550274'] for network, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:49.958585 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.services.segments.db [None req-b84b7633-027f-4db1-93a8-640d97a5f09a admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fced0ff05e0>,) {'filters': {'network_id': ['4100b38a-1db4-4a6e-9c33-7bcf19c64d59']}} {{(pid=91687) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:22:49.986834 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-672663bd-8f39-4252-8124-d3ae2cb44c02 req-151aa073-73a5-4d48-8802-cc8aafb64729 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1381009
May 20 04:22:49.995912 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.services.segments.db [None req-b84b7633-027f-4db1-93a8-640d97a5f09a admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fced0ff05e0>, '743e4a81-111b-4929-b0d4-50516fe60014') {'for_net_delete': True} {{(pid=91687) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:22:49.996195 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.services.segments.db [None req-b84b7633-027f-4db1-93a8-640d97a5f09a admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fced0ff05e0>, '743e4a81-111b-4929-b0d4-50516fe60014') {} {{(pid=91687) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:22:50.025645 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-b84b7633-027f-4db1-93a8-640d97a5f09a admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8782892560523', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-936621'] for segment, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:50.048910 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-b84b7633-027f-4db1-93a8-640d97a5f09a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1501910'] for segment, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:50.062170 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b84b7633-027f-4db1-93a8-640d97a5f09a admin admin] Releasing vlan 879 on physical network physnet1 to pool {{(pid=91687) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 20 04:22:50.063069 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-b84b7633-027f-4db1-93a8-640d97a5f09a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1501910', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-4162285'] for segment, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:50.168568 dv-cinder-790910-4-iscsi neutron-server[91687]: Traceback (most recent call last):
May 20 04:22:50.168568 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 20 04:22:50.168568 dv-cinder-790910-4-iscsi neutron-server[91687]:     timer()
May 20 04:22:50.168568 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 20 04:22:50.168568 dv-cinder-790910-4-iscsi neutron-server[91687]:     cb(*args, **kw)
May 20 04:22:50.168568 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 20 04:22:50.168568 dv-cinder-790910-4-iscsi neutron-server[91687]:     return func(*args, **kwargs)
May 20 04:22:50.168568 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 20 04:22:50.168568 dv-cinder-790910-4-iscsi neutron-server[91687]:     self._notify()
May 20 04:22:50.168568 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 20 04:22:50.168568 dv-cinder-790910-4-iscsi neutron-server[91687]:     self.callback(batched_events)
May 20 04:22:50.168568 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 20 04:22:50.168568 dv-cinder-790910-4-iscsi neutron-server[91687]:     event.method(event)
May 20 04:22:50.168568 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 20 04:22:50.168568 dv-cinder-790910-4-iscsi neutron-server[91687]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 20 04:22:50.168568 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 20 04:22:50.168568 dv-cinder-790910-4-iscsi neutron-server[91687]:     aggregate_uuid = self.p_client.list_aggregates(
May 20 04:22:50.168568 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 20 04:22:50.168568 dv-cinder-790910-4-iscsi neutron-server[91687]:     return f(self, *a, **k)
May 20 04:22:50.168568 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 20 04:22:50.168568 dv-cinder-790910-4-iscsi neutron-server[91687]:     return self._get(url).json()
May 20 04:22:50.168568 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 20 04:22:50.168568 dv-cinder-790910-4-iscsi neutron-server[91687]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 20 04:22:50.168568 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 20 04:22:50.168568 dv-cinder-790910-4-iscsi neutron-server[91687]:     return self.request(url, 'GET', **kwargs)
May 20 04:22:50.168568 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 20 04:22:50.168568 dv-cinder-790910-4-iscsi neutron-server[91687]:     base_url = self.get_endpoint(auth, allow=allow,
May 20 04:22:50.168568 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 20 04:22:50.168568 dv-cinder-790910-4-iscsi neutron-server[91687]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 20 04:22:50.168568 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 20 04:22:50.168568 dv-cinder-790910-4-iscsi neutron-server[91687]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 20 04:22:50.168568 dv-cinder-790910-4-iscsi neutron-server[91687]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 20 04:22:50.196572 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-b84b7633-027f-4db1-93a8-640d97a5f09a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1505543', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1590664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1781430', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1713996'] for network, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:50.202313 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-2d08487b-d239-40bf-9d04-884d569b105e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:22:50.241593 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-b84b7633-027f-4db1-93a8-640d97a5f09a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for network, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:50.245090 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b84b7633-027f-4db1-93a8-640d97a5f09a admin admin] Pushing event deleted for resources: {'Network': ['ID=4100b38a-1db4-4a6e-9c33-7bcf19c64d59,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:22:50.255204 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-b84b7633-027f-4db1-93a8-640d97a5f09a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:22:50.269461 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-b84b7633-027f-4db1-93a8-640d97a5f09a admin admin] 10.222.0.71 "DELETE /v2.0/networks/4100b38a-1db4-4a6e-9c33-7bcf19c64d59 HTTP/1.1" status: 204  len: 168 time: 0.7807829
May 20 04:22:50.465867 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 37826) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:22:50.567325 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 37834) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:22:50.649642 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-08b74bce-d021-494e-9fb0-200eb1377a5e admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=b6214ee7a3fe4823b9db71f53439835e&name=default HTTP/1.1" status: 200  len: 2975 time: 0.0783589
May 20 04:22:50.650014 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 37838) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:22:50.730176 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-0241dd54-6807-41f3-be55-f71084245a28 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:50.764334 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-0241dd54-6807-41f3-be55-f71084245a28 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:50.838265 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-0241dd54-6807-41f3-be55-f71084245a28 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:50.843198 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-13027643-ab6e-465b-ad4a-9937d69103db admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:22:50.858247 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0241dd54-6807-41f3-be55-f71084245a28 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a5479633-0923-4a98-9c22-65615d7859f0,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:22:50.858493 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [None req-51daa051-2602-4bf6-85e1-71e5af2d2ff2 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1127767721-network', 'tenant_id': '3256e447aabc4919ab44697ceab8e6cf'}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:22:50.863287 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-0241dd54-6807-41f3-be55-f71084245a28 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:22:50.865472 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-51daa051-2602-4bf6-85e1-71e5af2d2ff2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:22:50.882113 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-0241dd54-6807-41f3-be55-f71084245a28 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:50.883935 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-0241dd54-6807-41f3-be55-f71084245a28 admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/a5479633-0923-4a98-9c22-65615d7859f0 HTTP/1.1" status: 204  len: 168 time: 0.2329416
May 20 04:22:50.887193 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-51daa051-2602-4bf6-85e1-71e5af2d2ff2 admin admin] Usage tracker for resource:network and tenant:3256e447aabc4919ab44697ceab8e6cf is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:22:50.896225 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-51daa051-2602-4bf6-85e1-71e5af2d2ff2 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:22:50.907585 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-51daa051-2602-4bf6-85e1-71e5af2d2ff2 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:22:50.924329 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-51daa051-2602-4bf6-85e1-71e5af2d2ff2 admin admin] Made reservation on behalf of 3256e447aabc4919ab44697ceab8e6cf for: {'network': 1} {{(pid=91687) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 04:22:50.927772 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-51daa051-2602-4bf6-85e1-71e5af2d2ff2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-578118'] for network, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:50.948488 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-51daa051-2602-4bf6-85e1-71e5af2d2ff2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:50.975606 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-51daa051-2602-4bf6-85e1-71e5af2d2ff2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:22:50.984394 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-51daa051-2602-4bf6-85e1-71e5af2d2ff2 admin admin] Usage tracker for resource:security_group_rule and tenant:3256e447aabc4919ab44697ceab8e6cf is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:22:50.988878 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-51daa051-2602-4bf6-85e1-71e5af2d2ff2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:22:51.000465 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-51daa051-2602-4bf6-85e1-71e5af2d2ff2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:22:51.173619 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-51daa051-2602-4bf6-85e1-71e5af2d2ff2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:51.180688 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-51daa051-2602-4bf6-85e1-71e5af2d2ff2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:51.186300 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-2f92f8ff-38e0-4181-89e8-cf844f593301 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:22:51.227254 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-51daa051-2602-4bf6-85e1-71e5af2d2ff2 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 863}  {{(pid=91687) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 20 04:22:51.312852 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51daa051-2602-4bf6-85e1-71e5af2d2ff2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=28e1d321-f7b0-4b59-9e60-b859e2b9c22e,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:22:51.324030 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-51daa051-2602-4bf6-85e1-71e5af2d2ff2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1501910'] for segment, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:51.324030 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.db.segments_db [None req-51daa051-2602-4bf6-85e1-71e5af2d2ff2 admin admin] Added segment f8bf9c6a-2558-4b0d-b485-baae4b399c00 of type vlan for network bcfef78b-d50f-4b70-a8f4-439d5e27267a
May 20 04:22:51.324030 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-51daa051-2602-4bf6-85e1-71e5af2d2ff2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.134s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:22:51.405601 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-51daa051-2602-4bf6-85e1-71e5af2d2ff2 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8782892092784'] for network, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:51.434314 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-280d1f64-895d-4dd4-9157-625027b9f57e req-495980a1-ed43-4947-805c-19bec927d752 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:51.435497 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-280d1f64-895d-4dd4-9157-625027b9f57e req-495980a1-ed43-4947-805c-19bec927d752 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 945 time: 0.2207909
May 20 04:22:51.537212 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-280d1f64-895d-4dd4-9157-625027b9f57e req-7cc40d00-2044-4f64-8c6d-b3dc546ce941 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0883529
May 20 04:22:51.538685 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-51daa051-2602-4bf6-85e1-71e5af2d2ff2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1590664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1781430'] for network, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:51.540725 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-51daa051-2602-4bf6-85e1-71e5af2d2ff2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:51.542144 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-51daa051-2602-4bf6-85e1-71e5af2d2ff2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for network, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:51.549702 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:22:51.618725 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-51daa051-2602-4bf6-85e1-71e5af2d2ff2 admin admin] 10.222.0.71 "POST /v2.0/networks HTTP/1.1" status: 201  len: 882 time: 1.1514850
May 20 04:22:51.621637 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 37874) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:22:51.628247 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.v2.base [None req-9be9b252-4968-4c1c-9254-0e7f5f5a0dba admin admin] Request body: {'subnet': {'network_id': 'bcfef78b-d50f-4b70-a8f4-439d5e27267a', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1127767721-subnet', 'tenant_id': '3256e447aabc4919ab44697ceab8e6cf', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=91686) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:22:51.645121 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-9be9b252-4968-4c1c-9254-0e7f5f5a0dba admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:22:51.661140 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-9be9b252-4968-4c1c-9254-0e7f5f5a0dba admin admin] Usage tracker for resource:subnet and tenant:3256e447aabc4919ab44697ceab8e6cf is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:22:51.671759 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-9be9b252-4968-4c1c-9254-0e7f5f5a0dba admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:22:51.688160 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-9be9b252-4968-4c1c-9254-0e7f5f5a0dba admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:22:51.704280 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51daa051-2602-4bf6-85e1-71e5af2d2ff2 admin admin] Pushing event updated for resources: {'Network': ['ID=bcfef78b-d50f-4b70-a8f4-439d5e27267a,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:22:51.710192 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-51daa051-2602-4bf6-85e1-71e5af2d2ff2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.160s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:22:51.719529 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Network bcfef78b-d50f-4b70-a8f4-439d5e27267a details requested by agent ovs-agent-dv-cinder-790910-4-iscsi with host dv-cinder-790910-4-iscsi {{(pid=91688) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 20 04:22:51.723922 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9be9b252-4968-4c1c-9254-0e7f5f5a0dba admin admin] Made reservation on behalf of 3256e447aabc4919ab44697ceab8e6cf for: {'subnet': 1} {{(pid=91686) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 04:22:51.728468 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-9be9b252-4968-4c1c-9254-0e7f5f5a0dba admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-2442182'] for subnet, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:52.272837 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-9be9b252-4968-4c1c-9254-0e7f5f5a0dba admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-255887', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2114700', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-2442228'] for subnet, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:52.277517 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-05e5b728-6c65-4f2f-bd89-a283697fe617 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:22:52.334453 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 37896) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:22:52.434238 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9be9b252-4968-4c1c-9254-0e7f5f5a0dba admin admin] Pushing event updated for resources: {'Subnet': ['ID=e5bf6e02-06bc-4842-ba8e-1bdd1c661e53,revision_number=0']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:22:52.442302 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-9be9b252-4968-4c1c-9254-0e7f5f5a0dba admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.165s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:22:52.469890 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 37902) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:22:52.482866 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9be9b252-4968-4c1c-9254-0e7f5f5a0dba admin admin] Checking segment: {'id': 'f8bf9c6a-2558-4b0d-b485-baae4b399c00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 863, 'network_id': 'bcfef78b-d50f-4b70-a8f4-439d5e27267a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91686) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:22:52.483359 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9be9b252-4968-4c1c-9254-0e7f5f5a0dba admin admin] Network hostable DHCP agents. Network: bcfef78b-d50f-4b70-a8f4-439d5e27267a, hostable agents: ['36d27813-c368-4fd7-ae26-0f662e0a96fd'], hosted agents: [] {{(pid=91686) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 20 04:22:52.529977 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9be9b252-4968-4c1c-9254-0e7f5f5a0dba admin admin] Network bcfef78b-d50f-4b70-a8f4-439d5e27267a is scheduled to be hosted by DHCP agent 36d27813-c368-4fd7-ae26-0f662e0a96fd with binding_index 1 {{(pid=91686) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 20 04:22:52.553868 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.base_scheduler [None req-9be9b252-4968-4c1c-9254-0e7f5f5a0dba admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-790910-4-iscsi, bcfef78b-d50f-4b70-a8f4-439d5e27267a) {{(pid=91686) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:22:52.575322 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-15b8de8c-e5f4-47f9-bb40-58822d76409d None None] Network bcfef78b-d50f-4b70-a8f4-439d5e27267a requested from dv-cinder-790910-4-iscsi {{(pid=91688) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 04:22:52.602242 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9be9b252-4968-4c1c-9254-0e7f5f5a0dba admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:52.603707 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-9be9b252-4968-4c1c-9254-0e7f5f5a0dba admin admin] Notify callbacks [] for subnet, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:52.632498 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [None req-4a30bbd5-c9f6-4ad2-97d0-05bf6867da8a admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeNegativeTest-1809838081-network', 'tenant_id': '6484c55ce8204dc3802efc929a51c4a5'}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:22:52.657721 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-9be9b252-4968-4c1c-9254-0e7f5f5a0dba admin admin] 10.222.0.71 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 846 time: 1.0345533
May 20 04:22:52.709015 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-4a30bbd5-c9f6-4ad2-97d0-05bf6867da8a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:22:52.747851 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-4a30bbd5-c9f6-4ad2-97d0-05bf6867da8a admin admin] Usage tracker for resource:network and tenant:6484c55ce8204dc3802efc929a51c4a5 is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:22:52.766550 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-4a30bbd5-c9f6-4ad2-97d0-05bf6867da8a admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:22:52.848539 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-4a30bbd5-c9f6-4ad2-97d0-05bf6867da8a admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:22:52.923430 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-43f22283-03a5-4492-8916-3f0b3b3abcba admin admin] Notify callbacks [] for security_group, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:52.973345 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-43f22283-03a5-4492-8916-3f0b3b3abcba admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:22:52.984486 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-43f22283-03a5-4492-8916-3f0b3b3abcba admin admin] Usage tracker for resource:security_group_rule and tenant:26b1f5cd253a4c0b88877efef30ec19e is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:22:52.992103 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-43f22283-03a5-4492-8916-3f0b3b3abcba admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:22:53.015361 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4a30bbd5-c9f6-4ad2-97d0-05bf6867da8a admin admin] Made reservation on behalf of 6484c55ce8204dc3802efc929a51c4a5 for: {'network': 1} {{(pid=91687) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 04:22:53.019935 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-4a30bbd5-c9f6-4ad2-97d0-05bf6867da8a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-578118'] for network, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:53.056531 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-43f22283-03a5-4492-8916-3f0b3b3abcba admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:22:53.063218 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-4a30bbd5-c9f6-4ad2-97d0-05bf6867da8a admin admin] Notify callbacks [] for security_group, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:53.130620 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-4a30bbd5-c9f6-4ad2-97d0-05bf6867da8a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:22:53.158395 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-4a30bbd5-c9f6-4ad2-97d0-05bf6867da8a admin admin] Usage tracker for resource:security_group_rule and tenant:6484c55ce8204dc3802efc929a51c4a5 is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:22:53.186774 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-4a30bbd5-c9f6-4ad2-97d0-05bf6867da8a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:22:53.197163 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-4a30bbd5-c9f6-4ad2-97d0-05bf6867da8a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:22:53.267935 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ed29522f-2d41-47e6-a6bd-7dafcf18419f None None] Network bcfef78b-d50f-4b70-a8f4-439d5e27267a requested from dv-cinder-790910-4-iscsi {{(pid=91688) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 04:22:53.523696 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-43f22283-03a5-4492-8916-3f0b3b3abcba admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:53.555908 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-43f22283-03a5-4492-8916-3f0b3b3abcba admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:53.573080 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-4a30bbd5-c9f6-4ad2-97d0-05bf6867da8a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:53.577542 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-11a703ba-85d0-45ef-8ded-c856a4f4b6b9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:22:53.623604 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-4a30bbd5-c9f6-4ad2-97d0-05bf6867da8a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:53.668059 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 37942) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:22:53.668687 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-43f22283-03a5-4492-8916-3f0b3b3abcba admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=26b1f5cd253a4c0b88877efef30ec19e&name=default HTTP/1.1" status: 200  len: 2979 time: 1.1968725
May 20 04:22:53.672847 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43f22283-03a5-4492-8916-3f0b3b3abcba admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=abb882d3-744b-4593-8e45-8f3c86170682,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:22:53.675829 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4a30bbd5-c9f6-4ad2-97d0-05bf6867da8a admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 876}  {{(pid=91687) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 20 04:22:53.685252 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f4178e0-2add-4c00-bc37-f6033d32e322 req-e62264b8-9309-422a-8fe5-dcbbaf1edd8d tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:53.692807 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-0f4178e0-2add-4c00-bc37-f6033d32e322 req-e62264b8-9309-422a-8fe5-dcbbaf1edd8d tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 945 time: 0.3242402
May 20 04:22:53.699190 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-43f22283-03a5-4492-8916-3f0b3b3abcba admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.122s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:22:53.699576 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-27b4a608-7fea-4aa2-83cb-f522fd8cfb8b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.056s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:22:53.741489 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-4a30bbd5-c9f6-4ad2-97d0-05bf6867da8a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1501910'] for segment, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:53.741825 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.db.segments_db [None req-4a30bbd5-c9f6-4ad2-97d0-05bf6867da8a admin admin] Added segment 0ad1d987-000a-4092-8d15-811f90922b00 of type vlan for network 20ab5e30-591a-443a-9e34-f3a1b7563f5d
May 20 04:22:53.782287 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 37948) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:22:53.788651 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a30bbd5-c9f6-4ad2-97d0-05bf6867da8a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bfbed793-323e-4182-8252-80af79e38321,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:22:53.791666 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.v2.base [None req-5521b875-fbc2-43e6-86ef-5cd38cf2a9d3 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1899376854-network', 'tenant_id': '82107fe100164c8c9c1e62c9952b59e9'}} {{(pid=91686) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:22:53.796295 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-4a30bbd5-c9f6-4ad2-97d0-05bf6867da8a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.097s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:22:53.800055 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-0f4178e0-2add-4c00-bc37-f6033d32e322 req-8c925769-4218-4c9d-addd-31495cd8cfce tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1063287
May 20 04:22:53.805106 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-4a30bbd5-c9f6-4ad2-97d0-05bf6867da8a admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8782892092784'] for network, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:53.823445 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-5521b875-fbc2-43e6-86ef-5cd38cf2a9d3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:22:53.831302 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-58b24cad-b3bf-4461-b7e1-730717022e64 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:53.839729 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-5521b875-fbc2-43e6-86ef-5cd38cf2a9d3 admin admin] Usage tracker for resource:network and tenant:82107fe100164c8c9c1e62c9952b59e9 is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:22:53.845919 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-4a30bbd5-c9f6-4ad2-97d0-05bf6867da8a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1590664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1781430'] for network, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:53.847389 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4a30bbd5-c9f6-4ad2-97d0-05bf6867da8a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:53.847972 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-4a30bbd5-c9f6-4ad2-97d0-05bf6867da8a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for network, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:53.851731 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-51daa051-2602-4bf6-85e1-71e5af2d2ff2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:22:53.858524 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-5521b875-fbc2-43e6-86ef-5cd38cf2a9d3 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:22:53.876415 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-5521b875-fbc2-43e6-86ef-5cd38cf2a9d3 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:22:53.905559 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-58b24cad-b3bf-4461-b7e1-730717022e64 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:53.925251 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5521b875-fbc2-43e6-86ef-5cd38cf2a9d3 admin admin] Made reservation on behalf of 82107fe100164c8c9c1e62c9952b59e9 for: {'network': 1} {{(pid=91686) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 04:22:53.927792 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-5521b875-fbc2-43e6-86ef-5cd38cf2a9d3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-578118'] for network, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:53.953440 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-5521b875-fbc2-43e6-86ef-5cd38cf2a9d3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:53.982040 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-5521b875-fbc2-43e6-86ef-5cd38cf2a9d3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:22:53.987554 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-5521b875-fbc2-43e6-86ef-5cd38cf2a9d3 admin admin] Usage tracker for resource:security_group_rule and tenant:82107fe100164c8c9c1e62c9952b59e9 is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:22:53.991310 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-5521b875-fbc2-43e6-86ef-5cd38cf2a9d3 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:22:53.998840 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-5521b875-fbc2-43e6-86ef-5cd38cf2a9d3 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:22:54.049588 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a30bbd5-c9f6-4ad2-97d0-05bf6867da8a admin admin] Pushing event updated for resources: {'Network': ['ID=20ab5e30-591a-443a-9e34-f3a1b7563f5d,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:22:54.050508 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-58b24cad-b3bf-4461-b7e1-730717022e64 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:54.052979 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-4a30bbd5-c9f6-4ad2-97d0-05bf6867da8a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.201s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:22:54.058190 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-4a30bbd5-c9f6-4ad2-97d0-05bf6867da8a admin admin] 10.222.0.71 "POST /v2.0/networks HTTP/1.1" status: 201  len: 888 time: 1.7222023
May 20 04:22:54.058988 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 37956) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:22:54.064382 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Network 20ab5e30-591a-443a-9e34-f3a1b7563f5d details requested by agent ovs-agent-dv-cinder-790910-4-iscsi with host dv-cinder-790910-4-iscsi {{(pid=91688) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 20 04:22:54.067471 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [None req-7b8ecab6-9d06-4a4e-b60c-3f23a23c8c6c admin admin] Request body: {'subnet': {'network_id': '20ab5e30-591a-443a-9e34-f3a1b7563f5d', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeNegativeTest-1809838081-subnet', 'tenant_id': '6484c55ce8204dc3802efc929a51c4a5', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:22:54.073003 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-8a65cde3-2942-44fe-b807-af84727eb604 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:22:54.076356 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-7b8ecab6-9d06-4a4e-b60c-3f23a23c8c6c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:22:54.083276 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-7b8ecab6-9d06-4a4e-b60c-3f23a23c8c6c admin admin] Usage tracker for resource:subnet and tenant:6484c55ce8204dc3802efc929a51c4a5 is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:22:54.087997 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-7b8ecab6-9d06-4a4e-b60c-3f23a23c8c6c admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:22:54.091136 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58b24cad-b3bf-4461-b7e1-730717022e64 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=abb882d3-744b-4593-8e45-8f3c86170682,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:22:54.097209 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-7b8ecab6-9d06-4a4e-b60c-3f23a23c8c6c admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:22:54.111887 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-58b24cad-b3bf-4461-b7e1-730717022e64 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:22:54.119365 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7b8ecab6-9d06-4a4e-b60c-3f23a23c8c6c admin admin] Made reservation on behalf of 6484c55ce8204dc3802efc929a51c4a5 for: {'subnet': 1} {{(pid=91687) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 04:22:54.123075 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-58b24cad-b3bf-4461-b7e1-730717022e64 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:54.124198 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-58b24cad-b3bf-4461-b7e1-730717022e64 admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/abb882d3-744b-4593-8e45-8f3c86170682 HTTP/1.1" status: 204  len: 168 time: 0.4550891
May 20 04:22:54.125327 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-7b8ecab6-9d06-4a4e-b60c-3f23a23c8c6c admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-692271'] for subnet, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:54.241015 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-5521b875-fbc2-43e6-86ef-5cd38cf2a9d3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:54.251743 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-5521b875-fbc2-43e6-86ef-5cd38cf2a9d3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:54.262719 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-c23e3535-6f48-461e-908b-d36a3a258cc9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:22:54.336173 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5521b875-fbc2-43e6-86ef-5cd38cf2a9d3 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 859}  {{(pid=91686) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 20 04:22:54.362042 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5521b875-fbc2-43e6-86ef-5cd38cf2a9d3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a6f587a7-e577-43d6-91f8-8ece790cfafb,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:22:54.368287 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-5521b875-fbc2-43e6-86ef-5cd38cf2a9d3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:22:54.373560 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-5521b875-fbc2-43e6-86ef-5cd38cf2a9d3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1501910'] for segment, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:54.374600 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.db.segments_db [None req-5521b875-fbc2-43e6-86ef-5cd38cf2a9d3 admin admin] Added segment 9b287152-3ebe-4833-9a63-0fd3a7e44b78 of type vlan for network 0ac44429-2f1c-490b-8866-f86839542644
May 20 04:22:54.447001 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-5521b875-fbc2-43e6-86ef-5cd38cf2a9d3 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8782892092784'] for network, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:54.504471 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-5521b875-fbc2-43e6-86ef-5cd38cf2a9d3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1590664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1781430'] for network, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:54.506071 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5521b875-fbc2-43e6-86ef-5cd38cf2a9d3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:54.506842 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-5521b875-fbc2-43e6-86ef-5cd38cf2a9d3 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for network, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:54.515000 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-9d29f2c2-88ff-4165-8b22-3e60a042181c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:22:54.624760 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5521b875-fbc2-43e6-86ef-5cd38cf2a9d3 admin admin] Pushing event updated for resources: {'Network': ['ID=0ac44429-2f1c-490b-8866-f86839542644,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:22:54.628692 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-5521b875-fbc2-43e6-86ef-5cd38cf2a9d3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:22:54.633366 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-5521b875-fbc2-43e6-86ef-5cd38cf2a9d3 admin admin] 10.222.0.71 "POST /v2.0/networks HTTP/1.1" status: 201  len: 882 time: 0.8470981
May 20 04:22:54.633640 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 37966) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:22:54.640275 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Network 0ac44429-2f1c-490b-8866-f86839542644 details requested by agent ovs-agent-dv-cinder-790910-4-iscsi with host dv-cinder-790910-4-iscsi {{(pid=91688) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 20 04:22:54.648338 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [None req-d0e6e9fa-6ae0-479f-9a37-60889828609f admin admin] Request body: {'subnet': {'network_id': '0ac44429-2f1c-490b-8866-f86839542644', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1899376854-subnet', 'tenant_id': '82107fe100164c8c9c1e62c9952b59e9', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:22:54.655528 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-d0e6e9fa-6ae0-479f-9a37-60889828609f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:22:54.670380 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-d0e6e9fa-6ae0-479f-9a37-60889828609f admin admin] Usage tracker for resource:subnet and tenant:82107fe100164c8c9c1e62c9952b59e9 is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:22:54.674831 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-d0e6e9fa-6ae0-479f-9a37-60889828609f admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:22:54.684001 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-d0e6e9fa-6ae0-479f-9a37-60889828609f admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:22:54.703573 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d0e6e9fa-6ae0-479f-9a37-60889828609f admin admin] Made reservation on behalf of 82107fe100164c8c9c1e62c9952b59e9 for: {'subnet': 1} {{(pid=91687) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 04:22:54.706211 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-d0e6e9fa-6ae0-479f-9a37-60889828609f admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-692271'] for subnet, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:54.760571 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 37970) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:22:54.782808 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-261749fc-f0d6-4526-8e38-5f97a6d37a91 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:54.800645 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-261749fc-f0d6-4526-8e38-5f97a6d37a91 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:22:54.805232 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-261749fc-f0d6-4526-8e38-5f97a6d37a91 admin admin] Usage tracker for resource:security_group_rule and tenant:61a4d76d1820434cbb27baaa65a9a3ae is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:22:54.808588 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-261749fc-f0d6-4526-8e38-5f97a6d37a91 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:22:54.815681 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-261749fc-f0d6-4526-8e38-5f97a6d37a91 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:22:54.894267 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-7b8ecab6-9d06-4a4e-b60c-3f23a23c8c6c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-255887', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-4160768', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-692253'] for subnet, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:54.902024 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-699d2abb-8396-4b86-8b76-11ca5810a279 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:22:54.928182 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-261749fc-f0d6-4526-8e38-5f97a6d37a91 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:54.933965 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-261749fc-f0d6-4526-8e38-5f97a6d37a91 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:54.972707 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-af728259-8677-4fc9-827b-0a3882b9f3b1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:22:54.993022 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b8ecab6-9d06-4a4e-b60c-3f23a23c8c6c admin admin] Pushing event updated for resources: {'Subnet': ['ID=2a9c681d-a9be-4897-91bb-31aeb6432254,revision_number=0']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:22:54.993894 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-261749fc-f0d6-4526-8e38-5f97a6d37a91 admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=61a4d76d1820434cbb27baaa65a9a3ae&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2317834
May 20 04:22:55.001045 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 37978) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:22:55.021528 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-261749fc-f0d6-4526-8e38-5f97a6d37a91 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a4b83dd4-f17f-4677-9ad3-d16a03f44eb5,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:22:55.025815 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-7b8ecab6-9d06-4a4e-b60c-3f23a23c8c6c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:22:55.026811 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-261749fc-f0d6-4526-8e38-5f97a6d37a91 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:22:55.047372 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7b8ecab6-9d06-4a4e-b60c-3f23a23c8c6c admin admin] Checking segment: {'id': '0ad1d987-000a-4092-8d15-811f90922b00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': '20ab5e30-591a-443a-9e34-f3a1b7563f5d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91687) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:22:55.048073 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7b8ecab6-9d06-4a4e-b60c-3f23a23c8c6c admin admin] Network hostable DHCP agents. Network: 20ab5e30-591a-443a-9e34-f3a1b7563f5d, hostable agents: ['36d27813-c368-4fd7-ae26-0f662e0a96fd'], hosted agents: [] {{(pid=91687) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 20 04:22:55.082027 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-23ddbdf1-48e5-4ee6-8693-9eff8e4468fe admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:55.118672 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-23ddbdf1-48e5-4ee6-8693-9eff8e4468fe admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:55.150734 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7b8ecab6-9d06-4a4e-b60c-3f23a23c8c6c admin admin] Network 20ab5e30-591a-443a-9e34-f3a1b7563f5d is scheduled to be hosted by DHCP agent 36d27813-c368-4fd7-ae26-0f662e0a96fd with binding_index 1 {{(pid=91687) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 20 04:22:55.188627 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.base_scheduler [None req-7b8ecab6-9d06-4a4e-b60c-3f23a23c8c6c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-790910-4-iscsi, 20ab5e30-591a-443a-9e34-f3a1b7563f5d) {{(pid=91687) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:22:55.199965 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9a34edbe-99df-4f2b-a1bc-255b93840833 None None] Network 20ab5e30-591a-443a-9e34-f3a1b7563f5d requested from dv-cinder-790910-4-iscsi {{(pid=91688) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 04:22:55.210668 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-23ddbdf1-48e5-4ee6-8693-9eff8e4468fe admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:55.216783 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7b8ecab6-9d06-4a4e-b60c-3f23a23c8c6c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:55.217192 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-5076b25f-59c3-440e-b4cf-8659ad1f36f1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:22:55.217679 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-7b8ecab6-9d06-4a4e-b60c-3f23a23c8c6c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for subnet, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:55.229932 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23ddbdf1-48e5-4ee6-8693-9eff8e4468fe admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a4b83dd4-f17f-4677-9ad3-d16a03f44eb5,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:22:55.235390 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-23ddbdf1-48e5-4ee6-8693-9eff8e4468fe admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:22:55.241399 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-23ddbdf1-48e5-4ee6-8693-9eff8e4468fe admin admin] Notify callbacks [] for security_group, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:55.242672 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-23ddbdf1-48e5-4ee6-8693-9eff8e4468fe admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/a4b83dd4-f17f-4677-9ad3-d16a03f44eb5 HTTP/1.1" status: 204  len: 168 time: 0.2403991
May 20 04:22:55.255019 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-7b8ecab6-9d06-4a4e-b60c-3f23a23c8c6c admin admin] 10.222.0.71 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 852 time: 1.1948397
May 20 04:22:55.315435 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61a9d6fe-e003-44c3-ae99-70f0f8b9d7ce req-bcb69104-e7ea-46c2-87ab-ed860b5202c3 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:55.317121 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-61a9d6fe-e003-44c3-ae99-70f0f8b9d7ce req-bcb69104-e7ea-46c2-87ab-ed860b5202c3 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 945 time: 0.2457304
May 20 04:22:55.452545 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-61a9d6fe-e003-44c3-ae99-70f0f8b9d7ce req-6cbbd463-cacc-432d-b068-91af8b8c4000 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1218390
May 20 04:22:55.485319 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2d160619-d47e-4476-9b8e-4b3f1622939c None None] Network 20ab5e30-591a-443a-9e34-f3a1b7563f5d requested from dv-cinder-790910-4-iscsi {{(pid=91688) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 04:22:55.617074 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-d0e6e9fa-6ae0-479f-9a37-60889828609f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-255887', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-4160768', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-692253'] for subnet, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:55.623955 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-7b8ecab6-9d06-4a4e-b60c-3f23a23c8c6c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:22:55.701199 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0e6e9fa-6ae0-479f-9a37-60889828609f admin admin] Pushing event updated for resources: {'Subnet': ['ID=4aa0ec79-5f1d-4162-8cc7-e398d6e1a4c0,revision_number=0']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:22:55.710882 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-d0e6e9fa-6ae0-479f-9a37-60889828609f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:22:55.738861 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d0e6e9fa-6ae0-479f-9a37-60889828609f admin admin] Checking segment: {'id': '9b287152-3ebe-4833-9a63-0fd3a7e44b78', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 859, 'network_id': '0ac44429-2f1c-490b-8866-f86839542644'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91687) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:22:55.739230 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d0e6e9fa-6ae0-479f-9a37-60889828609f admin admin] Network hostable DHCP agents. Network: 0ac44429-2f1c-490b-8866-f86839542644, hostable agents: ['36d27813-c368-4fd7-ae26-0f662e0a96fd'], hosted agents: [] {{(pid=91687) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 20 04:22:55.761294 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d0e6e9fa-6ae0-479f-9a37-60889828609f admin admin] Network 0ac44429-2f1c-490b-8866-f86839542644 is scheduled to be hosted by DHCP agent 36d27813-c368-4fd7-ae26-0f662e0a96fd with binding_index 1 {{(pid=91687) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 20 04:22:55.779022 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.base_scheduler [None req-d0e6e9fa-6ae0-479f-9a37-60889828609f admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-790910-4-iscsi, 0ac44429-2f1c-490b-8866-f86839542644) {{(pid=91687) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:22:55.794055 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f500f339-36fe-422c-9104-55ae009a5133 None None] Network 0ac44429-2f1c-490b-8866-f86839542644 requested from dv-cinder-790910-4-iscsi {{(pid=91688) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 04:22:55.798811 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d0e6e9fa-6ae0-479f-9a37-60889828609f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:55.800096 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-d0e6e9fa-6ae0-479f-9a37-60889828609f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for subnet, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:55.833180 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-d0e6e9fa-6ae0-479f-9a37-60889828609f admin admin] 10.222.0.71 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 846 time: 1.1898177
May 20 04:22:55.863005 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 38004) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:22:55.898725 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-e8cec438-7d58-4b9e-a716-5d9f6335edd1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:55.940204 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-e8cec438-7d58-4b9e-a716-5d9f6335edd1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:22:55.945510 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-e8cec438-7d58-4b9e-a716-5d9f6335edd1 admin admin] Usage tracker for resource:security_group_rule and tenant:9c0fdfb2fb0d4d9489ff96bfca6ab79e is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:22:55.950587 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-e8cec438-7d58-4b9e-a716-5d9f6335edd1 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:22:55.959132 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-e8cec438-7d58-4b9e-a716-5d9f6335edd1 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:22:56.102120 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-e8cec438-7d58-4b9e-a716-5d9f6335edd1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:56.111780 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-e8cec438-7d58-4b9e-a716-5d9f6335edd1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:56.123439 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:22:56.132070 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f0748f19-0788-4835-ab62-efc1fa74cbc6 None None] Network 0ac44429-2f1c-490b-8866-f86839542644 requested from dv-cinder-790910-4-iscsi {{(pid=91688) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 04:22:56.156589 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8cec438-7d58-4b9e-a716-5d9f6335edd1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=59aa1a9a-be9e-4529-9bc5-c2bddc221a08,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:22:56.160191 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-e8cec438-7d58-4b9e-a716-5d9f6335edd1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:22:56.190249 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-e8cec438-7d58-4b9e-a716-5d9f6335edd1 admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=9c0fdfb2fb0d4d9489ff96bfca6ab79e&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3256030
May 20 04:22:56.191327 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 38020) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:22:56.326954 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-8088882d-251f-415b-8b38-3f18cc0f51cb admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:56.362531 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-8088882d-251f-415b-8b38-3f18cc0f51cb admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:56.367677 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db623adc-36f9-4ecb-b026-98604585aa3d req-00936f7a-3cd0-4190-9468-2769c59bd997 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:56.369179 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-db623adc-36f9-4ecb-b026-98604585aa3d req-00936f7a-3cd0-4190-9468-2769c59bd997 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Synchronizing usage tracker for tenant:6484c55ce8204dc3802efc929a51c4a5 on resource:network {{(pid=91687) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:22:56.409172 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-db623adc-36f9-4ecb-b026-98604585aa3d req-00936f7a-3cd0-4190-9468-2769c59bd997 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Unset dirty status for tenant:6484c55ce8204dc3802efc929a51c4a5 on resource:network {{(pid=91687) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:22:56.411552 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-db623adc-36f9-4ecb-b026-98604585aa3d req-00936f7a-3cd0-4190-9468-2769c59bd997 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/networks?id=20ab5e30-591a-443a-9e34-f3a1b7563f5d HTTP/1.1" status: 200  len: 815 time: 0.4840224
May 20 04:22:56.440925 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-db623adc-36f9-4ecb-b026-98604585aa3d req-fb1e533c-f41b-4625-8037-976913636f21 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/quotas/6484c55ce8204dc3802efc929a51c4a5 HTTP/1.1" status: 200  len: 375 time: 0.0107875
May 20 04:22:56.463139 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-8088882d-251f-415b-8b38-3f18cc0f51cb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:56.472014 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-55287143-3309-4250-879e-a237b1e2d37d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:22:56.513930 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-db623adc-36f9-4ecb-b026-98604585aa3d req-47c3adb2-fd27-49b3-acdc-83cec445414e tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?tenant_id=6484c55ce8204dc3802efc929a51c4a5&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0649858
May 20 04:22:56.514698 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8088882d-251f-415b-8b38-3f18cc0f51cb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=59aa1a9a-be9e-4529-9bc5-c2bddc221a08,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:22:56.518846 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-8088882d-251f-415b-8b38-3f18cc0f51cb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:22:56.529386 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-8088882d-251f-415b-8b38-3f18cc0f51cb admin admin] Notify callbacks [] for security_group, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:22:56.533727 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-8088882d-251f-415b-8b38-3f18cc0f51cb admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/59aa1a9a-be9e-4529-9bc5-c2bddc221a08 HTTP/1.1" status: 204  len: 168 time: 0.3373616
May 20 04:22:56.721908 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-db623adc-36f9-4ecb-b026-98604585aa3d req-b457d04c-bb7e-420a-a48e-407aeea97d2d service neutron] 10.222.0.71 "GET /v2.0/networks/20ab5e30-591a-443a-9e34-f3a1b7563f5d?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2065413
May 20 04:22:56.944867 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-db623adc-36f9-4ecb-b026-98604585aa3d req-39b29b64-6d11-4507-bc22-2d656dc9a0b3 service neutron] 10.222.0.71 "GET /v2.0/networks/20ab5e30-591a-443a-9e34-f3a1b7563f5d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2184007
May 20 04:22:57.337267 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98686dd6-7f04-4846-b0dd-a87e69ef9e52 req-4c58f4fa-aa46-408f-8f63-dd638fe5f4e4 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:57.345808 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-98686dd6-7f04-4846-b0dd-a87e69ef9e52 req-4c58f4fa-aa46-408f-8f63-dd638fe5f4e4 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 945 time: 0.1197793
May 20 04:22:57.425003 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-98686dd6-7f04-4846-b0dd-a87e69ef9e52 req-329acc7c-d4f3-4ae0-821b-069da4fb6821 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0781283
May 20 04:22:57.564193 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-61951173-9af7-4021-aa86-573f17c0f02a req-6b04c0cb-25cc-4508-ba5b-737293717bb7 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=67a5d1ca-6a84-4a8b-8aeb-83c49965926d HTTP/1.1" status: 200  len: 210 time: 0.0580907
May 20 04:22:58.722691 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d24ed7a1-5610-44cc-91e3-bb8736b4102b req-30f0c618-6fca-43df-bd2c-edbf0074ebd0 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:22:58.724430 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-d24ed7a1-5610-44cc-91e3-bb8736b4102b req-30f0c618-6fca-43df-bd2c-edbf0074ebd0 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 945 time: 0.1755633
May 20 04:22:58.809325 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-d24ed7a1-5610-44cc-91e3-bb8736b4102b req-c660e2c1-8071-4857-981e-dd6f5683bd03 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0744400
May 20 04:22:59.029197 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-77eece30-04d7-43a9-8841-a8e623817589 req-af4dbe42-50c6-4340-ae58-ec052b71d4de tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=67a5d1ca-6a84-4a8b-8aeb-83c49965926d HTTP/1.1" status: 200  len: 210 time: 0.0513704
May 20 04:22:59.905084 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-c882843c-615d-4bb8-a323-cc72078fd857 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:00.257268 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-a7e4406d-0e9c-41aa-8f49-b8b2fddbee43 req-df95328d-babf-4dc5-8a53-9cd2e2aaacd7 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=67a5d1ca-6a84-4a8b-8aeb-83c49965926d HTTP/1.1" status: 200  len: 210 time: 0.0788083
May 20 04:23:00.447371 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db623adc-36f9-4ecb-b026-98604585aa3d req-6f467847-1df6-4f65-963e-e8bb5f4cb94f tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:00.449856 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-db623adc-36f9-4ecb-b026-98604585aa3d req-6f467847-1df6-4f65-963e-e8bb5f4cb94f tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.82 "GET /v2.0/networks?id=20ab5e30-591a-443a-9e34-f3a1b7563f5d HTTP/1.1" status: 200  len: 815 time: 0.4104486
May 20 04:23:00.469586 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [req-db623adc-36f9-4ecb-b026-98604585aa3d req-71df8bfe-0c3a-425e-9898-7df2eca67a37 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Request body: {'port': {'device_id': '67a5d1ca-6a84-4a8b-8aeb-83c49965926d', 'network_id': '20ab5e30-591a-443a-9e34-f3a1b7563f5d', 'admin_state_up': True, 'tenant_id': '6484c55ce8204dc3802efc929a51c4a5'}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:23:00.543526 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d74a52e2-ab7c-47d0-81c8-5eab917c05d6 req-19761550-10ff-4269-a2b3-aa09f62412b2 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:00.545995 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-d74a52e2-ab7c-47d0-81c8-5eab917c05d6 req-19761550-10ff-4269-a2b3-aa09f62412b2 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 945 time: 0.3108845
May 20 04:23:00.763510 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-d74a52e2-ab7c-47d0-81c8-5eab917c05d6 req-c2f4829c-966d-4c48-af55-c8fc98c33078 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2109847
May 20 04:23:00.800285 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [req-db623adc-36f9-4ecb-b026-98604585aa3d req-71df8bfe-0c3a-425e-9898-7df2eca67a37 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:23:00.807771 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-db623adc-36f9-4ecb-b026-98604585aa3d req-71df8bfe-0c3a-425e-9898-7df2eca67a37 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Usage tracker for resource:port and tenant:6484c55ce8204dc3802efc929a51c4a5 is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:23:00.813554 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-db623adc-36f9-4ecb-b026-98604585aa3d req-71df8bfe-0c3a-425e-9898-7df2eca67a37 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Quota usage for port was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:23:00.824997 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [req-db623adc-36f9-4ecb-b026-98604585aa3d req-71df8bfe-0c3a-425e-9898-7df2eca67a37 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:23:00.842969 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-db623adc-36f9-4ecb-b026-98604585aa3d req-71df8bfe-0c3a-425e-9898-7df2eca67a37 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Made reservation on behalf of 6484c55ce8204dc3802efc929a51c4a5 for: {'port': 1} {{(pid=91687) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 04:23:00.847171 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-db623adc-36f9-4ecb-b026-98604585aa3d req-71df8bfe-0c3a-425e-9898-7df2eca67a37 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:01.076525 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.db_base_plugin_common [req-db623adc-36f9-4ecb-b026-98604585aa3d req-71df8bfe-0c3a-425e-9898-7df2eca67a37 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Allocated IP 172.20.0.11 (20ab5e30-591a-443a-9e34-f3a1b7563f5d/2a9c681d-a9be-4897-91bb-31aeb6432254/9a903ca5-2762-405a-81bb-5c3dce3d256a) {{(pid=91687) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 04:23:01.334819 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-db623adc-36f9-4ecb-b026-98604585aa3d req-71df8bfe-0c3a-425e-9898-7df2eca67a37 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Notify callbacks [] for port, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:01.367842 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-db623adc-36f9-4ecb-b026-98604585aa3d req-71df8bfe-0c3a-425e-9898-7df2eca67a37 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8782892106231', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4162192'] for port, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:01.376526 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:01.446765 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-db623adc-36f9-4ecb-b026-98604585aa3d req-71df8bfe-0c3a-425e-9898-7df2eca67a37 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Network 20ab5e30-591a-443a-9e34-f3a1b7563f5d is already hosted by enough agents. {{(pid=91687) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:23:01.450437 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.base_scheduler [req-db623adc-36f9-4ecb-b026-98604585aa3d req-71df8bfe-0c3a-425e-9898-7df2eca67a37 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Resources bound (agent type, host, resource id):  {{(pid=91687) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:23:01.455260 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.l3_dvrscheduler_db [req-db623adc-36f9-4ecb-b026-98604585aa3d req-71df8bfe-0c3a-425e-9898-7df2eca67a37 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Received port after_create {{(pid=91687) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 04:23:01.479857 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04ea4313-7f7f-450e-a667-afc520c4592a req-f24613c6-7a87-4bed-aad2-5fecf1fde903 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:01.482362 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-04ea4313-7f7f-450e-a667-afc520c4592a req-f24613c6-7a87-4bed-aad2-5fecf1fde903 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=67a5d1ca-6a84-4a8b-8aeb-83c49965926d HTTP/1.1" status: 200  len: 932 time: 0.0935602
May 20 04:23:01.504981 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71df8bfe-0c3a-425e-9898-7df2eca67a37 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Pushing event updated for resources: {'Port': ['ID=9a903ca5-2762-405a-81bb-5c3dce3d256a,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:01.510426 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-71df8bfe-0c3a-425e-9898-7df2eca67a37 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.134s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:01.536880 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db623adc-36f9-4ecb-b026-98604585aa3d req-71df8bfe-0c3a-425e-9898-7df2eca67a37 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:01.536880 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-db623adc-36f9-4ecb-b026-98604585aa3d req-71df8bfe-0c3a-425e-9898-7df2eca67a37 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for port, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:01.549290 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-04ea4313-7f7f-450e-a667-afc520c4592a req-e8167ae2-c330-4a2b-900a-c98a6983a2b0 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0490379
May 20 04:23:01.559891 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-db623adc-36f9-4ecb-b026-98604585aa3d req-71df8bfe-0c3a-425e-9898-7df2eca67a37 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 1.0989532
May 20 04:23:01.576530 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [req-db623adc-36f9-4ecb-b026-98604585aa3d req-b0e22059-8581-460a-836d-a318ac70481c service neutron] Request body: {'port': {'device_id': '67a5d1ca-6a84-4a8b-8aeb-83c49965926d', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79091'}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:23:01.698488 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-db623adc-36f9-4ecb-b026-98604585aa3d req-b0e22059-8581-460a-836d-a318ac70481c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:02.065341 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52bbdcc4-26c1-4c76-a314-eb090c9485ce req-592a2aa1-93d8-4801-899a-c8c5acd501b1 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:02.067752 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-52bbdcc4-26c1-4c76-a314-eb090c9485ce req-592a2aa1-93d8-4801-899a-c8c5acd501b1 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 945 time: 0.1399715
May 20 04:23:02.163249 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-52bbdcc4-26c1-4c76-a314-eb090c9485ce req-cc7a0478-5e50-4ec0-b4fd-0a372c046ad9 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0824130
May 20 04:23:02.184494 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.notifiers.nova [req-db623adc-36f9-4ecb-b026-98604585aa3d req-b0e22059-8581-460a-836d-a318ac70481c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 9a903ca5-2762-405a-81bb-5c3dce3d256a {{(pid=91687) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 04:23:02.200117 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-db623adc-36f9-4ecb-b026-98604585aa3d req-b0e22059-8581-460a-836d-a318ac70481c service neutron] Notify callbacks [] for port, precommit_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:02.229092 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.provisioning_blocks [req-db623adc-36f9-4ecb-b026-98604585aa3d req-b0e22059-8581-460a-836d-a318ac70481c service neutron] Transition to ACTIVE for port object 9a903ca5-2762-405a-81bb-5c3dce3d256a will not be triggered until provisioned by entity L2. {{(pid=91687) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:23:02.235919 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-db623adc-36f9-4ecb-b026-98604585aa3d req-b0e22059-8581-460a-836d-a318ac70481c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4162185'] for port, after_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:02.242987 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:02.439335 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0e22059-8581-460a-836d-a318ac70481c service neutron] Pushing event updated for resources: {'Port': ['ID=9a903ca5-2762-405a-81bb-5c3dce3d256a,revision_number=2']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:02.470347 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-b0e22059-8581-460a-836d-a318ac70481c service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.227s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:02.538477 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:02.639515 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.managers [req-db623adc-36f9-4ecb-b026-98604585aa3d req-b0e22059-8581-460a-836d-a318ac70481c service neutron] Attempting to bind port 9a903ca5-2762-405a-81bb-5c3dce3d256a on host hv-cinder-79091 for vnic_type normal with profile  {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 04:23:02.640170 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.managers [req-db623adc-36f9-4ecb-b026-98604585aa3d req-b0e22059-8581-460a-836d-a318ac70481c service neutron] Attempting to bind port 9a903ca5-2762-405a-81bb-5c3dce3d256a by drivers openvswitch,hyperv on host hv-cinder-79091 at level 0 using segments [{'id': '0ad1d987-000a-4092-8d15-811f90922b00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': '20ab5e30-591a-443a-9e34-f3a1b7563f5d'}] {{(pid=91687) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 04:23:02.640713 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-db623adc-36f9-4ecb-b026-98604585aa3d req-b0e22059-8581-460a-836d-a318ac70481c service neutron] Attempting to bind port 9a903ca5-2762-405a-81bb-5c3dce3d256a on network 20ab5e30-591a-443a-9e34-f3a1b7563f5d {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:23:02.649580 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-db623adc-36f9-4ecb-b026-98604585aa3d req-b0e22059-8581-460a-836d-a318ac70481c service neutron] Port 9a903ca5-2762-405a-81bb-5c3dce3d256a on network 20ab5e30-591a-443a-9e34-f3a1b7563f5d not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79091 {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 20 04:23:02.650098 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-db623adc-36f9-4ecb-b026-98604585aa3d req-b0e22059-8581-460a-836d-a318ac70481c service neutron] Attempting to bind port 9a903ca5-2762-405a-81bb-5c3dce3d256a on network 20ab5e30-591a-443a-9e34-f3a1b7563f5d {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:23:02.664924 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-db623adc-36f9-4ecb-b026-98604585aa3d req-b0e22059-8581-460a-836d-a318ac70481c service neutron] Checking agent: {'id': '7cc947fd-92eb-4d43-ad6b-ea002afff217', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79091', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 4, 19, 34), 'started_at': datetime.datetime(2021, 5, 20, 4, 19, 34), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 4, 22, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 04:23:02.665685 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-db623adc-36f9-4ecb-b026-98604585aa3d req-b0e22059-8581-460a-836d-a318ac70481c service neutron] Checking segment: {'id': '0ad1d987-000a-4092-8d15-811f90922b00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': '20ab5e30-591a-443a-9e34-f3a1b7563f5d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91687) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:23:02.666471 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-db623adc-36f9-4ecb-b026-98604585aa3d req-b0e22059-8581-460a-836d-a318ac70481c service neutron] Bound using segment: {'id': '0ad1d987-000a-4092-8d15-811f90922b00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': '20ab5e30-591a-443a-9e34-f3a1b7563f5d'} {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 04:23:02.667520 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.managers [req-db623adc-36f9-4ecb-b026-98604585aa3d req-b0e22059-8581-460a-836d-a318ac70481c service neutron] Bound port: 9a903ca5-2762-405a-81bb-5c3dce3d256a, host: hv-cinder-79091, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '0ad1d987-000a-4092-8d15-811f90922b00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': '20ab5e30-591a-443a-9e34-f3a1b7563f5d'}}] {{(pid=91687) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 04:23:02.668170 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-db623adc-36f9-4ecb-b026-98604585aa3d req-b0e22059-8581-460a-836d-a318ac70481c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:02.709504 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-e21efa33-fa7c-4207-baeb-6d23abcbc20c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:02.944175 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [req-db623adc-36f9-4ecb-b026-98604585aa3d req-b0e22059-8581-460a-836d-a318ac70481c service neutron] For port 9a903ca5-2762-405a-81bb-5c3dce3d256a, host hv-cinder-79091, cleared binding levels {{(pid=91687) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 04:23:02.951384 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [req-db623adc-36f9-4ecb-b026-98604585aa3d req-b0e22059-8581-460a-836d-a318ac70481c service neutron] For port 9a903ca5-2762-405a-81bb-5c3dce3d256a, host hv-cinder-79091, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=9a903ca5-2762-405a-81bb-5c3dce3d256a,segment=NetworkSegment(0ad1d987-000a-4092-8d15-811f90922b00),segment_id=0ad1d987-000a-4092-8d15-811f90922b00)] {{(pid=91687) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 04:23:02.957733 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-db623adc-36f9-4ecb-b026-98604585aa3d req-b0e22059-8581-460a-836d-a318ac70481c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4162185'] for port, after_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:02.971931 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:03.102963 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4410b5cb-521b-4e53-8d32-242da0818557 req-cd6775b0-ca71-4523-a50f-67e25e3f5e94 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:03.104085 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-4410b5cb-521b-4e53-8d32-242da0818557 req-cd6775b0-ca71-4523-a50f-67e25e3f5e94 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Synchronizing usage tracker for tenant:6484c55ce8204dc3802efc929a51c4a5 on resource:port {{(pid=91687) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:23:03.111563 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db623adc-36f9-4ecb-b026-98604585aa3d req-b0e22059-8581-460a-836d-a318ac70481c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:03.112542 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-db623adc-36f9-4ecb-b026-98604585aa3d req-b0e22059-8581-460a-836d-a318ac70481c service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for port, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:03.114819 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-db623adc-36f9-4ecb-b026-98604585aa3d req-b0e22059-8581-460a-836d-a318ac70481c service neutron] 10.222.0.82 "PUT /v2.0/ports/9a903ca5-2762-405a-81bb-5c3dce3d256a HTTP/1.1" status: 200  len: 1094 time: 1.5439773
May 20 04:23:03.119485 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '67a5d1ca-6a84-4a8b-8aeb-83c49965926d', 'tag': '9a903ca5-2762-405a-81bb-5c3dce3d256a'}] {{(pid=91687) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:23:03.164032 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0e22059-8581-460a-836d-a318ac70481c service neutron] Pushing event updated for resources: {'Port': ['ID=9a903ca5-2762-405a-81bb-5c3dce3d256a,revision_number=3']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:03.169926 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-b0e22059-8581-460a-836d-a318ac70481c service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.198s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:03.171182 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-4410b5cb-521b-4e53-8d32-242da0818557 req-cd6775b0-ca71-4523-a50f-67e25e3f5e94 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Unset dirty status for tenant:6484c55ce8204dc3802efc929a51c4a5 on resource:port {{(pid=91687) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:23:03.173613 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4410b5cb-521b-4e53-8d32-242da0818557 req-cd6775b0-ca71-4523-a50f-67e25e3f5e94 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=67a5d1ca-6a84-4a8b-8aeb-83c49965926d HTTP/1.1" status: 200  len: 944 time: 0.4163163
May 20 04:23:03.254750 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '67a5d1ca-6a84-4a8b-8aeb-83c49965926d', 'tag': '9a903ca5-2762-405a-81bb-5c3dce3d256a', 'status': 'completed', 'code': 200}
May 20 04:23:03.321308 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ea4803bd-878f-47d5-9084-1ec41953c9db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:03.361042 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-4410b5cb-521b-4e53-8d32-242da0818557 req-e1e6c4bf-99a4-4311-9f97-e466eb675781 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Synchronizing usage tracker for tenant:6484c55ce8204dc3802efc929a51c4a5 on resource:security_group {{(pid=91687) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:23:03.412319 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db623adc-36f9-4ecb-b026-98604585aa3d req-f117756e-34a0-42d2-a22e-81067af6b655 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:03.415535 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-db623adc-36f9-4ecb-b026-98604585aa3d req-f117756e-34a0-42d2-a22e-81067af6b655 service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=6484c55ce8204dc3802efc929a51c4a5&device_id=67a5d1ca-6a84-4a8b-8aeb-83c49965926d HTTP/1.1" status: 200  len: 1097 time: 0.2320392
May 20 04:23:03.417639 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-4410b5cb-521b-4e53-8d32-242da0818557 req-e1e6c4bf-99a4-4311-9f97-e466eb675781 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Unset dirty status for tenant:6484c55ce8204dc3802efc929a51c4a5 on resource:security_group {{(pid=91687) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:23:03.419611 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4410b5cb-521b-4e53-8d32-242da0818557 req-e1e6c4bf-99a4-4311-9f97-e466eb675781 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2393315
May 20 04:23:03.554563 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-db623adc-36f9-4ecb-b026-98604585aa3d req-5df2d21f-e10b-4616-800a-dce25e7e9921 service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=9a903ca5-2762-405a-81bb-5c3dce3d256a HTTP/1.1" status: 200  len: 217 time: 0.1278243
May 20 04:23:03.565400 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf929994-a127-4260-8f02-655359020d78 req-df2a4160-b871-4a53-9587-833f555ffe46 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:03.567534 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-cf929994-a127-4260-8f02-655359020d78 req-df2a4160-b871-4a53-9587-833f555ffe46 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 945 time: 0.1920989
May 20 04:23:03.640161 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-cf929994-a127-4260-8f02-655359020d78 req-c46b19cf-3c32-4795-ab30-767eea74955f tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0616271
May 20 04:23:03.657676 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:03.679813 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db623adc-36f9-4ecb-b026-98604585aa3d req-2b4262f9-0756-4c6a-99db-760c74f6caf7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:03.681342 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-db623adc-36f9-4ecb-b026-98604585aa3d req-2b4262f9-0756-4c6a-99db-760c74f6caf7 service neutron] 10.222.0.82 "GET /v2.0/subnets?id=2a9c681d-a9be-4897-91bb-31aeb6432254 HTTP/1.1" status: 200  len: 855 time: 0.1191816
May 20 04:23:03.746402 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-db623adc-36f9-4ecb-b026-98604585aa3d req-b2189b68-6e51-4983-b774-0705cfd7f375 service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=20ab5e30-591a-443a-9e34-f3a1b7563f5d&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0561450
May 20 04:23:03.825172 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 38174) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:23:03.929054 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-db623adc-36f9-4ecb-b026-98604585aa3d req-95b8b69c-adb7-4d91-9dda-7a4cf10377f2 service neutron] 10.222.0.82 "GET /v2.0/networks/20ab5e30-591a-443a-9e34-f3a1b7563f5d?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1744421
May 20 04:23:04.030133 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-d556cdab-b038-476e-99eb-5881cb73663a admin admin] Notify callbacks [] for security_group, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:04.075991 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-d556cdab-b038-476e-99eb-5881cb73663a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:23:04.082550 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-d556cdab-b038-476e-99eb-5881cb73663a admin admin] Usage tracker for resource:security_group_rule and tenant:9288f538ff3e4bf4b6a2546e9b9c095b is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:23:04.088093 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-d556cdab-b038-476e-99eb-5881cb73663a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:23:04.099052 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-d556cdab-b038-476e-99eb-5881cb73663a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:23:04.136518 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-db623adc-36f9-4ecb-b026-98604585aa3d req-85401a01-ded8-4e19-b3ce-da484bf6a369 service neutron] 10.222.0.82 "GET /v2.0/networks/20ab5e30-591a-443a-9e34-f3a1b7563f5d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1995749
May 20 04:23:04.227298 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-d556cdab-b038-476e-99eb-5881cb73663a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:04.233124 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-d556cdab-b038-476e-99eb-5881cb73663a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:04.242804 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-4468e8e9-6e6c-4ae6-8fe0-c59101f9e6fa admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:04.305316 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-d556cdab-b038-476e-99eb-5881cb73663a admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=9288f538ff3e4bf4b6a2546e9b9c095b&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4782653
May 20 04:23:04.306642 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d556cdab-b038-476e-99eb-5881cb73663a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6f753b91-d130-45f3-8353-04b55b375db6,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:04.309459 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 38188) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:23:04.313309 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-d556cdab-b038-476e-99eb-5881cb73663a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:04.346114 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d091e623-7dbf-4d7f-86d4-bcf18b47ffb4 req-f6453a40-be02-4ce5-931e-fc1356158bc7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:04.347684 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-d091e623-7dbf-4d7f-86d4-bcf18b47ffb4 req-f6453a40-be02-4ce5-931e-fc1356158bc7 service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=6484c55ce8204dc3802efc929a51c4a5&device_id=67a5d1ca-6a84-4a8b-8aeb-83c49965926d HTTP/1.1" status: 200  len: 1097 time: 0.1456819
May 20 04:23:04.479372 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-5fa9cd1f-8b93-4a24-87a6-14d8c73c8762 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:04.534769 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-5fa9cd1f-8b93-4a24-87a6-14d8c73c8762 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:04.697120 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d091e623-7dbf-4d7f-86d4-bcf18b47ffb4 req-1d1079df-b898-4b2d-a098-e2370d7fe033 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:04.700805 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-d091e623-7dbf-4d7f-86d4-bcf18b47ffb4 req-1d1079df-b898-4b2d-a098-e2370d7fe033 service neutron] 10.222.0.82 "GET /v2.0/networks?id=20ab5e30-591a-443a-9e34-f3a1b7563f5d HTTP/1.1" status: 200  len: 916 time: 0.3381276
May 20 04:23:04.840693 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ad47820-cd02-4af9-9a89-1454e8246de5 req-c807ce4f-31a3-4d6b-bdb0-f93416471f12 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:04.851907 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-1ad47820-cd02-4af9-9a89-1454e8246de5 req-c807ce4f-31a3-4d6b-bdb0-f93416471f12 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=67a5d1ca-6a84-4a8b-8aeb-83c49965926d HTTP/1.1" status: 200  len: 944 time: 0.2092967
May 20 04:23:04.905874 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-1ad47820-cd02-4af9-9a89-1454e8246de5 req-e3641f1e-a623-4e41-8031-13cf6a303865 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0528960
May 20 04:23:04.931688 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-d091e623-7dbf-4d7f-86d4-bcf18b47ffb4 req-6525c619-cfd5-4791-9b7e-6abf55cddbb9 service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=9a903ca5-2762-405a-81bb-5c3dce3d256a HTTP/1.1" status: 200  len: 217 time: 0.2230475
May 20 04:23:04.995976 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-5fa9cd1f-8b93-4a24-87a6-14d8c73c8762 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:05.011830 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-7737d743-2a2c-4ab0-8aa7-95402f1856ef admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:05.056070 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5fa9cd1f-8b93-4a24-87a6-14d8c73c8762 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6f753b91-d130-45f3-8353-04b55b375db6,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:05.074488 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-5fa9cd1f-8b93-4a24-87a6-14d8c73c8762 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.063s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:05.093649 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-5fa9cd1f-8b93-4a24-87a6-14d8c73c8762 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:05.097790 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-5fa9cd1f-8b93-4a24-87a6-14d8c73c8762 admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/6f753b91-d130-45f3-8353-04b55b375db6 HTTP/1.1" status: 204  len: 168 time: 0.7870073
May 20 04:23:05.117759 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d091e623-7dbf-4d7f-86d4-bcf18b47ffb4 req-ed51fff9-e674-4fe3-b447-7c0ad8d33172 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:05.119249 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-d091e623-7dbf-4d7f-86d4-bcf18b47ffb4 req-ed51fff9-e674-4fe3-b447-7c0ad8d33172 service neutron] 10.222.0.82 "GET /v2.0/subnets?id=2a9c681d-a9be-4897-91bb-31aeb6432254 HTTP/1.1" status: 200  len: 855 time: 0.1793163
May 20 04:23:05.172547 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f21320cc-6a25-4ec1-8a32-8b119b35fd55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:05.177300 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c643e019-f1b3-4417-8e7d-30187aa30005 req-7e27c0b4-6e0d-41d2-a819-f20d44d46e80 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:05.184893 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-c643e019-f1b3-4417-8e7d-30187aa30005 req-7e27c0b4-6e0d-41d2-a819-f20d44d46e80 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 945 time: 0.3525445
May 20 04:23:05.206274 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-d091e623-7dbf-4d7f-86d4-bcf18b47ffb4 req-08c12d77-acfc-42a6-9e97-44d52259d7ee service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=20ab5e30-591a-443a-9e34-f3a1b7563f5d&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0774019
May 20 04:23:05.395779 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-c643e019-f1b3-4417-8e7d-30187aa30005 req-7122c634-73e6-4207-89eb-756482f5bd76 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2099431
May 20 04:23:05.468288 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-d091e623-7dbf-4d7f-86d4-bcf18b47ffb4 req-3f29db9d-22e7-4012-8637-a44f38f1fc0b service neutron] 10.222.0.82 "GET /v2.0/networks/20ab5e30-591a-443a-9e34-f3a1b7563f5d?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2532687
May 20 04:23:05.535148 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 38214) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:23:05.555400 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-026d6c72-f746-4595-9f3a-f4ce723e4105 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:05.571547 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-026d6c72-f746-4595-9f3a-f4ce723e4105 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:23:05.578371 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-026d6c72-f746-4595-9f3a-f4ce723e4105 admin admin] Usage tracker for resource:security_group_rule and tenant:901e571cc08e4a7da9f72926b31d5eb7 is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:23:05.581965 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-026d6c72-f746-4595-9f3a-f4ce723e4105 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:23:05.588919 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-026d6c72-f746-4595-9f3a-f4ce723e4105 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:23:05.627796 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-d091e623-7dbf-4d7f-86d4-bcf18b47ffb4 req-95118e3f-e0a5-4a2e-a6ce-7cb5b8109f6b service neutron] 10.222.0.82 "GET /v2.0/networks/20ab5e30-591a-443a-9e34-f3a1b7563f5d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1520600
May 20 04:23:05.700364 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-026d6c72-f746-4595-9f3a-f4ce723e4105 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:05.705822 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-026d6c72-f746-4595-9f3a-f4ce723e4105 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:05.725323 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-d38de1a8-4960-497e-8adb-06ebc558088b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:05.767644 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-026d6c72-f746-4595-9f3a-f4ce723e4105 admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=901e571cc08e4a7da9f72926b31d5eb7&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2309372
May 20 04:23:05.770845 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 38222) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:23:05.773336 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-026d6c72-f746-4595-9f3a-f4ce723e4105 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=688a9e32-3d69-42bf-81e0-917e1822fc9d,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:05.778366 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-026d6c72-f746-4595-9f3a-f4ce723e4105 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:05.851982 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-dbf84c16-491c-4317-815d-6e562f756150 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:05.885737 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-dbf84c16-491c-4317-815d-6e562f756150 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:05.954981 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-dbf84c16-491c-4317-815d-6e562f756150 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:05.961393 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-5fa9cd1f-8b93-4a24-87a6-14d8c73c8762 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:05.977092 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbf84c16-491c-4317-815d-6e562f756150 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=688a9e32-3d69-42bf-81e0-917e1822fc9d,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:05.987430 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-dbf84c16-491c-4317-815d-6e562f756150 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:05.988761 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-dbf84c16-491c-4317-815d-6e562f756150 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:05.990587 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-dbf84c16-491c-4317-815d-6e562f756150 admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/688a9e32-3d69-42bf-81e0-917e1822fc9d HTTP/1.1" status: 204  len: 168 time: 0.2181642
May 20 04:23:06.242457 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4dc8402-c25f-4f2e-a8f3-b561348d8c88 req-5b9b22d6-1fba-4e56-bad4-2d443a40de22 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:06.249582 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-a4dc8402-c25f-4f2e-a8f3-b561348d8c88 req-5b9b22d6-1fba-4e56-bad4-2d443a40de22 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=67a5d1ca-6a84-4a8b-8aeb-83c49965926d HTTP/1.1" status: 200  len: 944 time: 0.1263516
May 20 04:23:06.302828 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-a4dc8402-c25f-4f2e-a8f3-b561348d8c88 req-fe3809ff-8d42-4cfd-8d1a-fcff81291f21 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0475943
May 20 04:23:06.683971 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17c3428e-b321-42e0-845c-9a230282ebeb req-15815f1a-16db-40e9-a6da-b58b9775f43e tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:06.686093 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-17c3428e-b321-42e0-845c-9a230282ebeb req-15815f1a-16db-40e9-a6da-b58b9775f43e tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 945 time: 0.1026244
May 20 04:23:06.748561 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-17c3428e-b321-42e0-845c-9a230282ebeb req-d9efbf2e-f503-43ca-b9ca-96de9ea3529e tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0513716
May 20 04:23:07.862368 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45557e6f-582a-4775-8ffa-663012f6a543 req-6cacb0c7-e0bb-4cc7-b7bb-2684bea7747c tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:07.867438 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-45557e6f-582a-4775-8ffa-663012f6a543 req-6cacb0c7-e0bb-4cc7-b7bb-2684bea7747c tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=67a5d1ca-6a84-4a8b-8aeb-83c49965926d HTTP/1.1" status: 200  len: 944 time: 0.2513835
May 20 04:23:08.012144 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-45557e6f-582a-4775-8ffa-663012f6a543 req-78845eb1-fa2e-4faa-be59-2ad1d4f2bffb tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1320593
May 20 04:23:08.355050 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fe16d71-0f11-4f01-8419-677982dec179 req-0d5ce0e5-da29-4bbf-8db4-4d511535b657 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:08.358119 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-1fe16d71-0f11-4f01-8419-677982dec179 req-0d5ce0e5-da29-4bbf-8db4-4d511535b657 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 945 time: 0.2124484
May 20 04:23:08.464292 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 9a903ca5-2762-405a-81bb-5c3dce3d256a details requested by agent hyperv_hv-cinder-79091 with host hv-cinder-79091 {{(pid=91688) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 20 04:23:08.475902 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-1fe16d71-0f11-4f01-8419-677982dec179 req-7cc203aa-a71b-444e-9f1c-cd06d3e46e59 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1112511
May 20 04:23:08.714510 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port 9a903ca5-2762-405a-81bb-5c3dce3d256a, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=9a903ca5-2762-405a-81bb-5c3dce3d256a,segment=NetworkSegment(0ad1d987-000a-4092-8d15-811f90922b00),segment_id=0ad1d987-000a-4092-8d15-811f90922b00)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:23:08.732461 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Returning: {'device': '9a903ca5-2762-405a-81bb-5c3dce3d256a', 'network_id': '20ab5e30-591a-443a-9e34-f3a1b7563f5d', 'port_id': '9a903ca5-2762-405a-81bb-5c3dce3d256a', 'mac_address': 'fa:16:3e:90:23:e4', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 876, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2a9c681d-a9be-4897-91bb-31aeb6432254', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91688) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 20 04:23:08.811402 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:08.831153 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.notifiers.nova [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 9a903ca5-2762-405a-81bb-5c3dce3d256a {{(pid=91688) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 04:23:08.855929 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port 9a903ca5-2762-405a-81bb-5c3dce3d256a, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=9a903ca5-2762-405a-81bb-5c3dce3d256a,segment=NetworkSegment(0ad1d987-000a-4092-8d15-811f90922b00),segment_id=0ad1d987-000a-4092-8d15-811f90922b00)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:23:08.861798 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:08.863800 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:08.992086 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Pushing event updated for resources: {'Port': ['ID=9a903ca5-2762-405a-81bb-5c3dce3d256a,revision_number=4']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:08.995863 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.132s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:09.363699 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] get_ports_and_sgs() called for port_ids ['9a903ca5-2762-405a-81bb-5c3dce3d256a'] {{(pid=91688) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 04:23:09.450037 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 38362) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:23:09.479255 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e461ee75-fc8a-4e3c-93e3-6f46734d2f28 req-e9b117dd-cbc0-41bd-9251-b2d29d6e405c tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:09.480841 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-e461ee75-fc8a-4e3c-93e3-6f46734d2f28 req-e9b117dd-cbc0-41bd-9251-b2d29d6e405c tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=67a5d1ca-6a84-4a8b-8aeb-83c49965926d HTTP/1.1" status: 200  len: 945 time: 0.2482347
May 20 04:23:09.576387 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-e461ee75-fc8a-4e3c-93e3-6f46734d2f28 req-b6762e98-45db-41e0-9e75-a8d1833c07ef tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0856199
May 20 04:23:09.665235 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-128b92d1-8bc7-4f61-bd4e-39143077d2d4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:09.687578 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-128b92d1-8bc7-4f61-bd4e-39143077d2d4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:23:09.695407 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-128b92d1-8bc7-4f61-bd4e-39143077d2d4 admin admin] Usage tracker for resource:security_group_rule and tenant:2156f486c8474ea9be7cbef5557a0e72 is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:23:09.700005 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-128b92d1-8bc7-4f61-bd4e-39143077d2d4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:23:09.710059 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-128b92d1-8bc7-4f61-bd4e-39143077d2d4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:23:09.976557 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6efd57ae-1ef5-4563-a451-cc98aa8c53eb req-d04996c0-7a4a-43d3-a034-596ae6699101 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:09.979321 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-6efd57ae-1ef5-4563-a451-cc98aa8c53eb req-d04996c0-7a4a-43d3-a034-596ae6699101 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 945 time: 0.2294374
May 20 04:23:10.029259 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-128b92d1-8bc7-4f61-bd4e-39143077d2d4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:10.054227 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-128b92d1-8bc7-4f61-bd4e-39143077d2d4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:10.075060 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:10.115054 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-6efd57ae-1ef5-4563-a451-cc98aa8c53eb req-a8d75123-fa2c-4213-9c65-5781236504ea tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1181104
May 20 04:23:10.169367 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-128b92d1-8bc7-4f61-bd4e-39143077d2d4 admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=2156f486c8474ea9be7cbef5557a0e72&name=default HTTP/1.1" status: 200  len: 2979 time: 0.7149897
May 20 04:23:10.171406 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-128b92d1-8bc7-4f61-bd4e-39143077d2d4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=15c5367e-0aa9-4872-ae94-3baf79954170,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:10.171677 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 38392) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:23:10.182397 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-128b92d1-8bc7-4f61-bd4e-39143077d2d4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:10.326728 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-d7a094e8-9ac7-4d7a-b135-63c7b606835e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:10.394971 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-d7a094e8-9ac7-4d7a-b135-63c7b606835e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:10.522023 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-d7a094e8-9ac7-4d7a-b135-63c7b606835e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:10.537983 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:10.550382 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7a094e8-9ac7-4d7a-b135-63c7b606835e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=15c5367e-0aa9-4872-ae94-3baf79954170,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:10.553397 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-d7a094e8-9ac7-4d7a-b135-63c7b606835e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:10.596284 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-d7a094e8-9ac7-4d7a-b135-63c7b606835e admin admin] Notify callbacks [] for security_group, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:10.597745 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-d7a094e8-9ac7-4d7a-b135-63c7b606835e admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/15c5367e-0aa9-4872-ae94-3baf79954170 HTTP/1.1" status: 204  len: 168 time: 0.4244719
May 20 04:23:10.876571 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce220f62-a024-46e4-a7ac-819d12df8ec6 req-a17b53e7-3f38-4ef8-bf25-0864eab81f51 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:10.878328 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-ce220f62-a024-46e4-a7ac-819d12df8ec6 req-a17b53e7-3f38-4ef8-bf25-0864eab81f51 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=67a5d1ca-6a84-4a8b-8aeb-83c49965926d HTTP/1.1" status: 200  len: 945 time: 0.1224034
May 20 04:23:10.940034 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-ce220f62-a024-46e4-a7ac-819d12df8ec6 req-d4764379-cb44-469f-972a-56b6f977fed3 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0499711
May 20 04:23:11.067305 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 38430) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:23:11.086175 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-6fe20ac1-322d-46d2-b05c-8db732826bdc admin admin] Notify callbacks [] for security_group, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:11.103590 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-6fe20ac1-322d-46d2-b05c-8db732826bdc admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:23:11.108309 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-6fe20ac1-322d-46d2-b05c-8db732826bdc admin admin] Usage tracker for resource:security_group_rule and tenant:b415699de6134f64bbd55d8b6883b042 is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:23:11.111767 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-6fe20ac1-322d-46d2-b05c-8db732826bdc admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:23:11.119493 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-6fe20ac1-322d-46d2-b05c-8db732826bdc admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:23:11.228698 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-6fe20ac1-322d-46d2-b05c-8db732826bdc admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:11.234034 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-6fe20ac1-322d-46d2-b05c-8db732826bdc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:11.243958 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-e6d9e027-f280-4f1a-8fdf-fcf06188bf66 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:11.348534 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-6fe20ac1-322d-46d2-b05c-8db732826bdc admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=b415699de6134f64bbd55d8b6883b042&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2800126
May 20 04:23:11.352006 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 38442) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:23:11.355219 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6fe20ac1-322d-46d2-b05c-8db732826bdc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0120e51a-0bd9-423f-8089-7a48d2246d86,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:11.358525 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-6fe20ac1-322d-46d2-b05c-8db732826bdc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:11.395807 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b96a5ac-b012-4b8e-b651-b03590a79a2d req-52e4b957-f27f-4495-ba71-4ba837317b62 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:11.397673 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-2b96a5ac-b012-4b8e-b651-b03590a79a2d req-52e4b957-f27f-4495-ba71-4ba837317b62 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 945 time: 0.1366630
May 20 04:23:11.455726 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-94191f4b-ff93-4dd4-86a4-c8f6cc17aab2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:11.484598 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-2b96a5ac-b012-4b8e-b651-b03590a79a2d req-b0ef31d0-68d9-4ec9-8df4-8393f9949248 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0803881
May 20 04:23:11.508930 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-94191f4b-ff93-4dd4-86a4-c8f6cc17aab2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:11.583348 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-94191f4b-ff93-4dd4-86a4-c8f6cc17aab2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:11.588228 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-128b92d1-8bc7-4f61-bd4e-39143077d2d4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:11.607411 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94191f4b-ff93-4dd4-86a4-c8f6cc17aab2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0120e51a-0bd9-423f-8089-7a48d2246d86,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:11.622352 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94191f4b-ff93-4dd4-86a4-c8f6cc17aab2 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:23:11.622832 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94191f4b-ff93-4dd4-86a4-c8f6cc17aab2 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:23:11.623385 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94191f4b-ff93-4dd4-86a4-c8f6cc17aab2 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:23:11.623758 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94191f4b-ff93-4dd4-86a4-c8f6cc17aab2 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:23:11.624130 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94191f4b-ff93-4dd4-86a4-c8f6cc17aab2 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:23:11.624519 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94191f4b-ff93-4dd4-86a4-c8f6cc17aab2 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:23:11.625029 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94191f4b-ff93-4dd4-86a4-c8f6cc17aab2 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:23:11.625566 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94191f4b-ff93-4dd4-86a4-c8f6cc17aab2 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:23:11.626043 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94191f4b-ff93-4dd4-86a4-c8f6cc17aab2 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:23:11.626470 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94191f4b-ff93-4dd4-86a4-c8f6cc17aab2 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:23:11.626881 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94191f4b-ff93-4dd4-86a4-c8f6cc17aab2 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:23:11.627328 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94191f4b-ff93-4dd4-86a4-c8f6cc17aab2 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:23:11.632330 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-94191f4b-ff93-4dd4-86a4-c8f6cc17aab2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:11.634388 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-94191f4b-ff93-4dd4-86a4-c8f6cc17aab2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:11.641388 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-94191f4b-ff93-4dd4-86a4-c8f6cc17aab2 admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/0120e51a-0bd9-423f-8089-7a48d2246d86 HTTP/1.1" status: 204  len: 168 time: 0.2871425
May 20 04:23:12.169750 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32d05f2d-5a4b-44fe-ba92-a28f93e884bf req-adec7e0d-6c41-4187-b177-24d6ab0e675f tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:12.171348 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-32d05f2d-5a4b-44fe-ba92-a28f93e884bf req-adec7e0d-6c41-4187-b177-24d6ab0e675f tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=67a5d1ca-6a84-4a8b-8aeb-83c49965926d HTTP/1.1" status: 200  len: 945 time: 0.1033099
May 20 04:23:12.224743 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-32d05f2d-5a4b-44fe-ba92-a28f93e884bf req-a4cd9fe8-face-404e-8189-23d017734b1a tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0467980
May 20 04:23:12.737152 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 38484) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:23:12.767894 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c602781f-2ea0-498d-b402-f711c0daa978 req-9e9fa3a8-dbdb-47c3-aa09-20504a8c6d9f tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:12.771915 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-c602781f-2ea0-498d-b402-f711c0daa978 req-9e9fa3a8-dbdb-47c3-aa09-20504a8c6d9f tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 945 time: 0.1076887
May 20 04:23:12.834528 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-c602781f-2ea0-498d-b402-f711c0daa978 req-64546007-ee6c-4e63-9f6a-e101312a6c37 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0548887
May 20 04:23:12.914753 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.v2.base [None req-f55805ab-ca55-4021-b8aa-676c29032970 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-1023892954-network', 'tenant_id': 'e6fe6bea38b946a5a97ea42bf787f1b3'}} {{(pid=91686) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:23:12.920930 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-f55805ab-ca55-4021-b8aa-676c29032970 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:23:12.928917 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-f55805ab-ca55-4021-b8aa-676c29032970 admin admin] Usage tracker for resource:network and tenant:e6fe6bea38b946a5a97ea42bf787f1b3 is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:23:12.934200 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-f55805ab-ca55-4021-b8aa-676c29032970 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:23:12.945320 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-f55805ab-ca55-4021-b8aa-676c29032970 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:23:12.972405 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f55805ab-ca55-4021-b8aa-676c29032970 admin admin] Made reservation on behalf of e6fe6bea38b946a5a97ea42bf787f1b3 for: {'network': 1} {{(pid=91686) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 04:23:12.976210 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-f55805ab-ca55-4021-b8aa-676c29032970 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-578118'] for network, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:12.993433 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-f55805ab-ca55-4021-b8aa-676c29032970 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:13.021222 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-f55805ab-ca55-4021-b8aa-676c29032970 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:23:13.028696 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-f55805ab-ca55-4021-b8aa-676c29032970 admin admin] Usage tracker for resource:security_group_rule and tenant:e6fe6bea38b946a5a97ea42bf787f1b3 is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:23:13.034554 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-f55805ab-ca55-4021-b8aa-676c29032970 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:23:13.045177 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-f55805ab-ca55-4021-b8aa-676c29032970 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:23:13.154472 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-f55805ab-ca55-4021-b8aa-676c29032970 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:13.159852 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-f55805ab-ca55-4021-b8aa-676c29032970 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:13.163168 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-0ebe9990-3f21-4241-806c-3f17f9d6adf2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:13.196990 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f55805ab-ca55-4021-b8aa-676c29032970 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 893}  {{(pid=91686) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 20 04:23:13.207631 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f55805ab-ca55-4021-b8aa-676c29032970 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c188bb94-d954-43bd-b580-a3037bfce567,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:13.218935 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-f55805ab-ca55-4021-b8aa-676c29032970 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1501910'] for segment, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:13.219283 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.db.segments_db [None req-f55805ab-ca55-4021-b8aa-676c29032970 admin admin] Added segment b84e1e85-c58b-4982-b59b-cb9584098e15 of type vlan for network fdf92998-25fa-4179-ab1b-131af0ce059a
May 20 04:23:13.221327 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f55805ab-ca55-4021-b8aa-676c29032970 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:23:13.221688 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f55805ab-ca55-4021-b8aa-676c29032970 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:23:13.222044 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f55805ab-ca55-4021-b8aa-676c29032970 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:23:13.222391 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f55805ab-ca55-4021-b8aa-676c29032970 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:23:13.222734 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f55805ab-ca55-4021-b8aa-676c29032970 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:23:13.223074 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f55805ab-ca55-4021-b8aa-676c29032970 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:23:13.223412 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f55805ab-ca55-4021-b8aa-676c29032970 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:23:13.223749 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f55805ab-ca55-4021-b8aa-676c29032970 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:23:13.224085 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f55805ab-ca55-4021-b8aa-676c29032970 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:23:13.224418 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f55805ab-ca55-4021-b8aa-676c29032970 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:23:13.224749 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f55805ab-ca55-4021-b8aa-676c29032970 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:23:13.225110 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f55805ab-ca55-4021-b8aa-676c29032970 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:23:13.229270 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-f55805ab-ca55-4021-b8aa-676c29032970 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.066s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:13.267235 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-f55805ab-ca55-4021-b8aa-676c29032970 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8782892092784'] for network, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:13.308205 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-f55805ab-ca55-4021-b8aa-676c29032970 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1590664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1781430'] for network, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:13.309966 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f55805ab-ca55-4021-b8aa-676c29032970 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:13.310671 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-f55805ab-ca55-4021-b8aa-676c29032970 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for network, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:13.315082 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:13.424095 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f55805ab-ca55-4021-b8aa-676c29032970 admin admin] Pushing event updated for resources: {'Network': ['ID=fdf92998-25fa-4179-ab1b-131af0ce059a,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:13.427749 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-f55805ab-ca55-4021-b8aa-676c29032970 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:13.433366 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-f55805ab-ca55-4021-b8aa-676c29032970 admin admin] 10.222.0.71 "POST /v2.0/networks HTTP/1.1" status: 201  len: 888 time: 0.6950097
May 20 04:23:13.434008 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 38496) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:23:13.439087 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Network fdf92998-25fa-4179-ab1b-131af0ce059a details requested by agent ovs-agent-dv-cinder-790910-4-iscsi with host dv-cinder-790910-4-iscsi {{(pid=91688) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 20 04:23:13.441137 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.v2.base [None req-ca734946-1ad7-478e-84f3-17b040c169f9 admin admin] Request body: {'subnet': {'network_id': 'fdf92998-25fa-4179-ab1b-131af0ce059a', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-1023892954-subnet', 'tenant_id': 'e6fe6bea38b946a5a97ea42bf787f1b3', 'ip_version': 4}} {{(pid=91686) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:23:13.446605 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-ca734946-1ad7-478e-84f3-17b040c169f9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:23:13.451710 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-ca734946-1ad7-478e-84f3-17b040c169f9 admin admin] Usage tracker for resource:subnet and tenant:e6fe6bea38b946a5a97ea42bf787f1b3 is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:23:13.455340 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-ca734946-1ad7-478e-84f3-17b040c169f9 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:23:13.463035 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-ca734946-1ad7-478e-84f3-17b040c169f9 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:23:13.484290 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ca734946-1ad7-478e-84f3-17b040c169f9 admin admin] Made reservation on behalf of e6fe6bea38b946a5a97ea42bf787f1b3 for: {'subnet': 1} {{(pid=91686) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 04:23:13.487431 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-ca734946-1ad7-478e-84f3-17b040c169f9 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-2442182'] for subnet, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:13.516285 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdae9eb7-fa66-4387-a357-e477bdda50c6 req-6fdefd24-a9a4-410a-a8ce-c482e225f806 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:13.529945 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-bdae9eb7-fa66-4387-a357-e477bdda50c6 req-6fdefd24-a9a4-410a-a8ce-c482e225f806 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=67a5d1ca-6a84-4a8b-8aeb-83c49965926d HTTP/1.1" status: 200  len: 945 time: 0.1807442
May 20 04:23:13.607136 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-bdae9eb7-fa66-4387-a357-e477bdda50c6 req-b6a910e1-4d0f-42b4-96ab-357f97849393 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0748174
May 20 04:23:14.029988 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-ca734946-1ad7-478e-84f3-17b040c169f9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-255887', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2114700', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-2442228'] for subnet, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:14.037868 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:14.078148 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-993d9a1d-6db0-47af-8b40-4fb9f0031c06 req-2f75403c-38dd-4b9c-857d-a7865e7862e1 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:14.079861 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-993d9a1d-6db0-47af-8b40-4fb9f0031c06 req-2f75403c-38dd-4b9c-857d-a7865e7862e1 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 945 time: 0.1109359
May 20 04:23:14.142384 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-993d9a1d-6db0-47af-8b40-4fb9f0031c06 req-b8b955ba-b503-4808-aec7-6d42fed77f51 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0527256
May 20 04:23:14.144335 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca734946-1ad7-478e-84f3-17b040c169f9 admin admin] Pushing event updated for resources: {'Subnet': ['ID=e905ed23-00d1-4991-b3bb-e1a1e32b4c86,revision_number=0']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:14.151908 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-ca734946-1ad7-478e-84f3-17b040c169f9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:14.160009 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ca734946-1ad7-478e-84f3-17b040c169f9 admin admin] Checking segment: {'id': 'b84e1e85-c58b-4982-b59b-cb9584098e15', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 893, 'network_id': 'fdf92998-25fa-4179-ab1b-131af0ce059a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91686) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:23:14.160372 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ca734946-1ad7-478e-84f3-17b040c169f9 admin admin] Network hostable DHCP agents. Network: fdf92998-25fa-4179-ab1b-131af0ce059a, hostable agents: ['36d27813-c368-4fd7-ae26-0f662e0a96fd'], hosted agents: [] {{(pid=91686) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 20 04:23:14.193559 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ca734946-1ad7-478e-84f3-17b040c169f9 admin admin] Network fdf92998-25fa-4179-ab1b-131af0ce059a is scheduled to be hosted by DHCP agent 36d27813-c368-4fd7-ae26-0f662e0a96fd with binding_index 1 {{(pid=91686) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 20 04:23:14.199517 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.base_scheduler [None req-ca734946-1ad7-478e-84f3-17b040c169f9 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-790910-4-iscsi, fdf92998-25fa-4179-ab1b-131af0ce059a) {{(pid=91686) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:23:14.203670 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 9a903ca5-2762-405a-81bb-5c3dce3d256a up at agent hyperv_hv-cinder-79091 {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:23:14.215180 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ca734946-1ad7-478e-84f3-17b040c169f9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:14.216189 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-ca734946-1ad7-478e-84f3-17b040c169f9 admin admin] Notify callbacks [] for subnet, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:14.250709 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-ca734946-1ad7-478e-84f3-17b040c169f9 admin admin] 10.222.0.71 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 851 time: 0.8151510
May 20 04:23:14.253898 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 38510) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:23:14.254808 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dc5072fb-6fc7-4bcd-b9d2-d673bebfff35 None None] Network fdf92998-25fa-4179-ab1b-131af0ce059a requested from dv-cinder-790910-4-iscsi {{(pid=91688) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 04:23:14.259764 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.v2.base [None req-4cb15e24-a9a3-4fe7-98cf-6a9376806fd2 admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-1023892954-router', 'tenant_id': 'e6fe6bea38b946a5a97ea42bf787f1b3', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90'}}} {{(pid=91686) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:23:14.265347 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-4cb15e24-a9a3-4fe7-98cf-6a9376806fd2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:23:14.270393 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-4cb15e24-a9a3-4fe7-98cf-6a9376806fd2 admin admin] Usage tracker for resource:router and tenant:e6fe6bea38b946a5a97ea42bf787f1b3 is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:23:14.274282 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-4cb15e24-a9a3-4fe7-98cf-6a9376806fd2 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:23:14.282662 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-4cb15e24-a9a3-4fe7-98cf-6a9376806fd2 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:23:14.298628 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-4cb15e24-a9a3-4fe7-98cf-6a9376806fd2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1796465', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-6255'] for router, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:14.300176 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-4cb15e24-a9a3-4fe7-98cf-6a9376806fd2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1713009', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1713968', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1590966', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-6244'] for router, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:14.321792 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-4cb15e24-a9a3-4fe7-98cf-6a9376806fd2 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:14.545627 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Provisioning for port 9a903ca5-2762-405a-81bb-5c3dce3d256a completed by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:23:14.560214 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Provisioning complete for port 9a903ca5-2762-405a-81bb-5c3dce3d256a triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:23:14.560749 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:14.702691 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-4cb15e24-a9a3-4fe7-98cf-6a9376806fd2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1713977', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1796355', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-6218'] for router, precommit_update {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:14.845027 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8644445b-4d14-465a-a116-1e1f3a9585b8 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpfbdc8e9b-5136-5478-8aa8-b0b6b9be0f90-fdf92998-25fa-4179-ab1b-131af0ce059a', 'network_id': 'fdf92998-25fa-4179-ab1b-131af0ce059a', 'tenant_id': 'e6fe6bea38b946a5a97ea42bf787f1b3', 'fixed_ips': [{'subnet_id': 'e905ed23-00d1-4991-b3bb-e1a1e32b4c86'}]}} from dv-cinder-790910-4-iscsi. {{(pid=91688) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 20 04:23:14.846475 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-8644445b-4d14-465a-a116-1e1f3a9585b8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_create {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:14.959800 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:14.966478 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2fbcf36-227b-4de6-8c04-a192d5d22bab req-51b2e6ac-740d-4a9c-b8fe-45ce2cb4c06e tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:14.975902 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-e2fbcf36-227b-4de6-8c04-a192d5d22bab req-51b2e6ac-740d-4a9c-b8fe-45ce2cb4c06e tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=67a5d1ca-6a84-4a8b-8aeb-83c49965926d HTTP/1.1" status: 200  len: 945 time: 0.1246412
May 20 04:23:15.049939 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-e2fbcf36-227b-4de6-8c04-a192d5d22bab req-30e0e399-fcb7-47ec-99e3-4abacef95749 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0728545
May 20 04:23:15.068639 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '67a5d1ca-6a84-4a8b-8aeb-83c49965926d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9a903ca5-2762-405a-81bb-5c3dce3d256a'}] {{(pid=91688) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:23:15.165594 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port 9a903ca5-2762-405a-81bb-5c3dce3d256a, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=9a903ca5-2762-405a-81bb-5c3dce3d256a,segment=NetworkSegment(0ad1d987-000a-4092-8d15-811f90922b00),segment_id=0ad1d987-000a-4092-8d15-811f90922b00)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:23:15.172280 dv-cinder-790910-4-iscsi neutron-server[91688]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '67a5d1ca-6a84-4a8b-8aeb-83c49965926d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9a903ca5-2762-405a-81bb-5c3dce3d256a', 'code': 200}
May 20 04:23:15.184710 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:15.197886 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-c6c8deb6-a49b-4eff-ad77-b0ee2103e5ba None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:15.263716 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-4cb15e24-a9a3-4fe7-98cf-6a9376806fd2 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:15.326214 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-4cb15e24-a9a3-4fe7-98cf-6a9376806fd2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:15.359815 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Pushing event updated for resources: {'Port': ['ID=9a903ca5-2762-405a-81bb-5c3dce3d256a,revision_number=5']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:15.377675 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:23:15.378338 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:23:15.379003 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:23:15.379661 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:23:15.380330 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:23:15.381019 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:23:15.382057 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:23:15.382322 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:23:15.383024 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:23:15.383669 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:23:15.384507 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:23:15.385290 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:23:15.395176 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.197s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:15.395474 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a853782-c987-4979-a42f-5d6b9945a1d5 req-e6f71cb0-08ca-4193-987f-c922f3e8f4bd tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:15.406083 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-6a853782-c987-4979-a42f-5d6b9945a1d5 req-e6f71cb0-08ca-4193-987f-c922f3e8f4bd tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 945 time: 0.1140599
May 20 04:23:15.429828 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.db_base_plugin_common [None req-8644445b-4d14-465a-a116-1e1f3a9585b8 None None] Allocated IP 172.20.0.2 (fdf92998-25fa-4179-ab1b-131af0ce059a/e905ed23-00d1-4991-b3bb-e1a1e32b4c86/f0e53282-814b-4fe9-93f9-cb2ba47962df) {{(pid=91688) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 04:23:15.477134 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-6a853782-c987-4979-a42f-5d6b9945a1d5 req-a2e50e79-9bd4-4ed9-8f22-fc7d62345a15 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0686073
May 20 04:23:15.543549 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.db_base_plugin_common [None req-4cb15e24-a9a3-4fe7-98cf-6a9376806fd2 admin admin] Allocated IP 172.27.1.213 (aec557db-0c02-4008-8c9f-2efcd7462f90/217f4b55-4415-4d57-8b43-2ff4c8ac8e81/b4b174b3-1436-4e17-8fa3-97243bad59c3) {{(pid=91686) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 04:23:15.718486 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-8644445b-4d14-465a-a116-1e1f3a9585b8 None None] Notify callbacks [] for port, precommit_create {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:15.730462 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-8644445b-4d14-465a-a116-1e1f3a9585b8 None None] Transition to ACTIVE for port object f0e53282-814b-4fe9-93f9-cb2ba47962df will not be triggered until provisioned by entity L2. {{(pid=91688) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:23:15.758285 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-8644445b-4d14-465a-a116-1e1f3a9585b8 None None] Transition to ACTIVE for port object f0e53282-814b-4fe9-93f9-cb2ba47962df will not be triggered until provisioned by entity DHCP. {{(pid=91688) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:23:15.767303 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-8644445b-4d14-465a-a116-1e1f3a9585b8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8782892106231'] for port, after_create {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:15.771409 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:15.783365 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-4cb15e24-a9a3-4fe7-98cf-6a9376806fd2 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:15.831561 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-4cb15e24-a9a3-4fe7-98cf-6a9376806fd2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8782892106231', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2145052'] for port, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:15.839666 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8644445b-4d14-465a-a116-1e1f3a9585b8 None None] Network fdf92998-25fa-4179-ab1b-131af0ce059a is already hosted by enough agents. {{(pid=91688) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:23:15.840658 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:15.843008 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.scheduler.base_scheduler [None req-8644445b-4d14-465a-a116-1e1f3a9585b8 None None] Resources bound (agent type, host, resource id):  {{(pid=91688) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:23:15.848502 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8644445b-4d14-465a-a116-1e1f3a9585b8 None None] Received port after_create {{(pid=91688) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 04:23:15.864294 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8644445b-4d14-465a-a116-1e1f3a9585b8 None None] Pushing event updated for resources: {'Port': ['ID=f0e53282-814b-4fe9-93f9-cb2ba47962df,revision_number=1']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:15.917695 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-8644445b-4d14-465a-a116-1e1f3a9585b8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.146s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:15.966561 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4cb15e24-a9a3-4fe7-98cf-6a9376806fd2 admin admin] Network aec557db-0c02-4008-8c9f-2efcd7462f90 is already hosted by enough agents. {{(pid=91686) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:23:15.970580 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.base_scheduler [None req-4cb15e24-a9a3-4fe7-98cf-6a9376806fd2 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91686) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:23:15.974367 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4cb15e24-a9a3-4fe7-98cf-6a9376806fd2 admin admin] Received port after_create {{(pid=91686) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 04:23:16.000729 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.managers [None req-8644445b-4d14-465a-a116-1e1f3a9585b8 None None] Attempting to bind port f0e53282-814b-4fe9-93f9-cb2ba47962df on host dv-cinder-790910-4-iscsi for vnic_type normal with profile  {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 04:23:16.001357 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.managers [None req-8644445b-4d14-465a-a116-1e1f3a9585b8 None None] Attempting to bind port f0e53282-814b-4fe9-93f9-cb2ba47962df by drivers openvswitch,hyperv on host dv-cinder-790910-4-iscsi at level 0 using segments [{'id': 'b84e1e85-c58b-4982-b59b-cb9584098e15', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 893, 'network_id': 'fdf92998-25fa-4179-ab1b-131af0ce059a'}] {{(pid=91688) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 04:23:16.001961 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8644445b-4d14-465a-a116-1e1f3a9585b8 None None] Attempting to bind port f0e53282-814b-4fe9-93f9-cb2ba47962df on network fdf92998-25fa-4179-ab1b-131af0ce059a {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:23:16.009392 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8644445b-4d14-465a-a116-1e1f3a9585b8 None None] Checking agent: {'id': '333121d4-1023-4a33-a54c-f4dd052e1612', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-790910-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 4, 13, 33), 'started_at': datetime.datetime(2021, 5, 20, 4, 14, 3), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 4, 23, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-790910-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 04:23:16.010044 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8644445b-4d14-465a-a116-1e1f3a9585b8 None None] Checking segment: {'id': 'b84e1e85-c58b-4982-b59b-cb9584098e15', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 893, 'network_id': 'fdf92998-25fa-4179-ab1b-131af0ce059a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91688) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:23:16.010622 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-8644445b-4d14-465a-a116-1e1f3a9585b8 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:16.011267 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8644445b-4d14-465a-a116-1e1f3a9585b8 None None] Bound using segment: {'id': 'b84e1e85-c58b-4982-b59b-cb9584098e15', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 893, 'network_id': 'fdf92998-25fa-4179-ab1b-131af0ce059a'} {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 04:23:16.011954 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.managers [None req-8644445b-4d14-465a-a116-1e1f3a9585b8 None None] Bound port: f0e53282-814b-4fe9-93f9-cb2ba47962df, host: dv-cinder-790910-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b84e1e85-c58b-4982-b59b-cb9584098e15', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 893, 'network_id': 'fdf92998-25fa-4179-ab1b-131af0ce059a'}}] {{(pid=91688) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 04:23:16.012566 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-8644445b-4d14-465a-a116-1e1f3a9585b8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:16.047649 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cb15e24-a9a3-4fe7-98cf-6a9376806fd2 admin admin] Pushing event updated for resources: {'Port': ['ID=b4b174b3-1436-4e17-8fa3-97243bad59c3,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:16.052048 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-4cb15e24-a9a3-4fe7-98cf-6a9376806fd2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.211s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:16.155414 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-8644445b-4d14-465a-a116-1e1f3a9585b8 None None] For port f0e53282-814b-4fe9-93f9-cb2ba47962df, host dv-cinder-790910-4-iscsi, cleared binding levels {{(pid=91688) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 04:23:16.161968 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-8644445b-4d14-465a-a116-1e1f3a9585b8 None None] For port f0e53282-814b-4fe9-93f9-cb2ba47962df, host dv-cinder-790910-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=f0e53282-814b-4fe9-93f9-cb2ba47962df,segment=NetworkSegment(b84e1e85-c58b-4982-b59b-cb9584098e15),segment_id=b84e1e85-c58b-4982-b59b-cb9584098e15)] {{(pid=91688) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 04:23:16.169766 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-8644445b-4d14-465a-a116-1e1f3a9585b8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:16.176490 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:16.339847 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8644445b-4d14-465a-a116-1e1f3a9585b8 None None] Pushing event updated for resources: {'Port': ['ID=f0e53282-814b-4fe9-93f9-cb2ba47962df,revision_number=2']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:16.366891 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-8644445b-4d14-465a-a116-1e1f3a9585b8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.190s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:16.451309 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d23e6de-8334-4475-bfb0-10443aabe098 req-c8c4e318-56ff-4aae-86cb-8004a48eeec9 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:16.476451 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-2d23e6de-8334-4475-bfb0-10443aabe098 req-c8c4e318-56ff-4aae-86cb-8004a48eeec9 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=67a5d1ca-6a84-4a8b-8aeb-83c49965926d HTTP/1.1" status: 200  len: 946 time: 0.2520308
May 20 04:23:16.600471 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-2d23e6de-8334-4475-bfb0-10443aabe098 req-b8be320a-b522-4a5b-a399-ae27712cdc9a tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1064425
May 20 04:23:16.819457 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-4cb15e24-a9a3-4fe7-98cf-6a9376806fd2 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:17.049874 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e76cd149-aa55-4b0a-a857-090c3eda327f req-a154ee68-6e28-4bb4-a901-3226f18ffd7c tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:17.052455 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-e76cd149-aa55-4b0a-a857-090c3eda327f req-a154ee68-6e28-4bb4-a901-3226f18ffd7c tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 945 time: 0.2224967
May 20 04:23:17.153130 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-e76cd149-aa55-4b0a-a857-090c3eda327f req-5a90233b-a319-47e1-89af-e46074c2c15a tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0824835
May 20 04:23:17.169781 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c56c81bc-0b35-4ef1-9c0e-05114acfb3ce req-7816179b-77c8-4c80-bb8e-49799ba2fc5c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:17.172301 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-c56c81bc-0b35-4ef1-9c0e-05114acfb3ce req-7816179b-77c8-4c80-bb8e-49799ba2fc5c service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=67a5d1ca-6a84-4a8b-8aeb-83c49965926d HTTP/1.1" status: 200  len: 1099 time: 0.1899912
May 20 04:23:17.225800 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-c56c81bc-0b35-4ef1-9c0e-05114acfb3ce req-bf66bfcd-8495-4bc6-968a-abb372ce09ce service neutron] 10.222.0.82 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0460558
May 20 04:23:17.470222 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-4cb15e24-a9a3-4fe7-98cf-6a9376806fd2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1796474', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1714058'] for router, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:17.744442 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-61f2db3f-c7eb-4bc9-a033-7ab82ac5d698 None None] Network fdf92998-25fa-4179-ab1b-131af0ce059a requested from dv-cinder-790910-4-iscsi {{(pid=91688) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 04:23:17.878940 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4cb15e24-a9a3-4fe7-98cf-6a9376806fd2 admin admin] Router 9c2e249a-3b4f-4271-8226-b44c455943cc is scheduled to L3 agent 02733fc0-fc9c-4e29-bc03-c27a792d539d with binding_index 1 {{(pid=91686) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 20 04:23:18.024458 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-eda155ce-8efb-44f9-ac1f-e4e78a6dc007 None None] Provisioning for port f0e53282-814b-4fe9-93f9-cb2ba47962df completed by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:23:18.068578 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device f0e53282-814b-4fe9-93f9-cb2ba47962df up at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:23:18.100043 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4cb15e24-a9a3-4fe7-98cf-6a9376806fd2 admin admin] Notify agent at l3_agent.dv-cinder-790910-4-iscsi the message routers_updated {{(pid=91686) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 04:23:18.112926 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0b5e465a-536d-4b45-98e9-6dc9829f5cb6 None None] Sync routers for ids ['9c2e249a-3b4f-4271-8226-b44c455943cc'] in dv-cinder-790910-4-iscsi {{(pid=91689) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 04:23:18.127550 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0b5e465a-536d-4b45-98e9-6dc9829f5cb6 None None] Routers {'9c2e249a-3b4f-4271-8226-b44c455943cc'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91689) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:23:18.130729 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-0b5e465a-536d-4b45-98e9-6dc9829f5cb6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced1b32e20>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:23:03Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['9c2e249a-3b4f-4271-8226-b44c455943cc'], 'active': True} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:23:18.152162 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a8cff26-17eb-482b-8821-5ee80f4fea64 req-52610163-afcc-4afc-b3d3-cfb54a6749fc tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:18.153844 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-5a8cff26-17eb-482b-8821-5ee80f4fea64 req-52610163-afcc-4afc-b3d3-cfb54a6749fc tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=67a5d1ca-6a84-4a8b-8aeb-83c49965926d HTTP/1.1" status: 200  len: 946 time: 0.3689363
May 20 04:23:18.157806 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-4cb15e24-a9a3-4fe7-98cf-6a9376806fd2 admin admin] Notify callbacks [] for router, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:18.159281 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-4cb15e24-a9a3-4fe7-98cf-6a9376806fd2 admin admin] 10.222.0.71 "POST /v2.0/routers HTTP/1.1" status: 201  len: 927 time: 3.9041572
May 20 04:23:18.163972 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 38554) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:23:18.198671 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ba94189-66c8-41c2-b3c4-74304446fe0a req-751f0086-0b16-468d-8dee-a6dd98c7b6e3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:18.200844 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-2ba94189-66c8-41c2-b3c4-74304446fe0a req-751f0086-0b16-468d-8dee-a6dd98c7b6e3 service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 1098 time: 0.1367450
May 20 04:23:18.305974 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-2ba94189-66c8-41c2-b3c4-74304446fe0a req-78602d8d-9e89-4c0a-a239-c5268612f3a5 service neutron] 10.222.0.82 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0903051
May 20 04:23:18.394316 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-5a8cff26-17eb-482b-8821-5ee80f4fea64 req-538c882a-121e-4afb-bb6f-7fce07316aab tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1671512
May 20 04:23:18.418777 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning for port f0e53282-814b-4fe9-93f9-cb2ba47962df completed by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:23:18.472997 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning complete for port f0e53282-814b-4fe9-93f9-cb2ba47962df triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:23:18.484138 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:18.746114 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvr_db [None req-0b5e465a-536d-4b45-98e9-6dc9829f5cb6 None None] Set router 9c2e249a-3b4f-4271-8226-b44c455943cc gateway port host: dv-cinder-790910-4-iscsi {{(pid=91689) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:23:18.823983 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:18.872045 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] For port f0e53282-814b-4fe9-93f9-cb2ba47962df, host dv-cinder-790910-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=f0e53282-814b-4fe9-93f9-cb2ba47962df,segment=NetworkSegment(b84e1e85-c58b-4982-b59b-cb9584098e15),segment_id=b84e1e85-c58b-4982-b59b-cb9584098e15)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:23:18.884342 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:18.887153 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:19.051116 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Pushing event updated for resources: {'Port': ['ID=f0e53282-814b-4fe9-93f9-cb2ba47962df,revision_number=3']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:19.057528 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.170s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:19.085752 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4f00e8a-96f4-4cf4-a913-aa754b7724f1 req-8055fe8b-7c98-4edf-996f-575c8730b4c4 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:19.099383 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a4f00e8a-96f4-4cf4-a913-aa754b7724f1 req-8055fe8b-7c98-4edf-996f-575c8730b4c4 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 945 time: 0.4635580
May 20 04:23:19.102381 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-03dc6b78-f423-4c33-89ae-8a66c734dec8 None None] Provisioning complete for port f0e53282-814b-4fe9-93f9-cb2ba47962df triggered by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:23:19.103523 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-03dc6b78-f423-4c33-89ae-8a66c734dec8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:19.232185 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a4f00e8a-96f4-4cf4-a913-aa754b7724f1 req-119a31ad-d55d-4124-8fa4-d15e98b6a344 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1308606
May 20 04:23:19.335110 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-0b5e465a-536d-4b45-98e9-6dc9829f5cb6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced1b32e20>, [{'id': '9c2e249a-3b4f-4271-8226-b44c455943cc', 'name': 'tempest-TestMinimumBasicScenario-1023892954-router', 'tenant_id': 'e6fe6bea38b946a5a97ea42bf787f1b3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.213'}], 'enable_snat': True}, 'gw_port_id': 'b4b174b3-1436-4e17-8fa3-97243bad59c3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:23:14Z', 'updated_at': '2021-05-20T04:23:16Z', 'revision_number': 3, 'project_id': 'e6fe6bea38b946a5a97ea42bf787f1b3', 'gw_port': {'id': 'b4b174b3-1436-4e17-8fa3-97243bad59c3', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:4d:2f:62', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9c2e249a-3b4f-4271-8226-b44c455943cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 330, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:23:15Z', 'updated_at': '2021-05-20T04:23:15Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi'}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:23:19.341730 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0b5e465a-536d-4b45-98e9-6dc9829f5cb6 None None] Checking router: 9c2e249a-3b4f-4271-8226-b44c455943cc for host: dv-cinder-790910-4-iscsi {{(pid=91689) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 04:23:19.342419 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0b5e465a-536d-4b45-98e9-6dc9829f5cb6 None None] Updating router 9c2e249a-3b4f-4271-8226-b44c455943cc port b4b174b3-1436-4e17-8fa3-97243bad59c3 binding host dv-cinder-790910-4-iscsi {{(pid=91689) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 20 04:23:19.465643 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron_lib.callbacks.manager [None req-0b5e465a-536d-4b45-98e9-6dc9829f5cb6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:19.833232 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 38594) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:23:19.932512 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device f0e53282-814b-4fe9-93f9-cb2ba47962df up at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:23:19.969083 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.agents_db [None req-92d61f12-17bc-4bf9-9eab-8a69b8c6da2f None None] Agent healthcheck: found 6 active agents {{(pid=91689) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 04:23:20.065139 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning complete for port f0e53282-814b-4fe9-93f9-cb2ba47962df triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:23:20.065694 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:20.068594 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d594b62-3976-4e7b-85a3-0455d82db94a req-1ee185f1-f837-490c-941a-2434b7243252 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:20.082085 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-7d594b62-3976-4e7b-85a3-0455d82db94a req-1ee185f1-f837-490c-941a-2434b7243252 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=67a5d1ca-6a84-4a8b-8aeb-83c49965926d HTTP/1.1" status: 200  len: 946 time: 0.2401850
May 20 04:23:20.243473 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-7d594b62-3976-4e7b-85a3-0455d82db94a req-14717b55-b3da-4b35-8ec5-f195560a27db tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1511016
May 20 04:23:20.270437 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron_lib.callbacks.manager [None req-0b5e465a-536d-4b45-98e9-6dc9829f5cb6 None None] Notify callbacks [] for port, precommit_update {{(pid=91689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:20.287408 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.provisioning_blocks [None req-0b5e465a-536d-4b45-98e9-6dc9829f5cb6 None None] Transition to ACTIVE for port object b4b174b3-1436-4e17-8fa3-97243bad59c3 will not be triggered until provisioned by entity L2. {{(pid=91689) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:23:20.297910 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-ce210b7d-d7d0-48f0-a3da-dd088cd42ca2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:20.301340 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron_lib.callbacks.manager [None req-0b5e465a-536d-4b45-98e9-6dc9829f5cb6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:20.309989 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG oslo_concurrency.lockutils [None req-dc1a6b76-36b2-43a5-8d34-0e74421f311c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:20.315603 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-3649ebb2-347b-4cc6-9a5f-20f5b9d8e810 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:20.347079 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-ce210b7d-d7d0-48f0-a3da-dd088cd42ca2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:23:20.353389 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-ce210b7d-d7d0-48f0-a3da-dd088cd42ca2 admin admin] Usage tracker for resource:security_group_rule and tenant:6865ba068db345bead51d62c48ce31a9 is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:23:20.357356 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-ce210b7d-d7d0-48f0-a3da-dd088cd42ca2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:23:20.365853 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-ce210b7d-d7d0-48f0-a3da-dd088cd42ca2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:23:20.563783 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.managers [None req-0b5e465a-536d-4b45-98e9-6dc9829f5cb6 None None] Attempting to bind port b4b174b3-1436-4e17-8fa3-97243bad59c3 on host dv-cinder-790910-4-iscsi for vnic_type normal with profile  {{(pid=91689) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 04:23:20.564699 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.managers [None req-0b5e465a-536d-4b45-98e9-6dc9829f5cb6 None None] Attempting to bind port b4b174b3-1436-4e17-8fa3-97243bad59c3 by drivers openvswitch,hyperv on host dv-cinder-790910-4-iscsi at level 0 using segments [{'id': '8df49ec5-3fb9-4715-bc9a-f4019a6b55f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90'}] {{(pid=91689) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 04:23:20.572137 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0b5e465a-536d-4b45-98e9-6dc9829f5cb6 None None] Attempting to bind port b4b174b3-1436-4e17-8fa3-97243bad59c3 on network aec557db-0c02-4008-8c9f-2efcd7462f90 {{(pid=91689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:23:20.584808 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3f2dc05-eeae-48f7-a3e4-de7be39120f3 None None] Pushing event updated for resources: {'Port': ['ID=b4b174b3-1436-4e17-8fa3-97243bad59c3,revision_number=2']} {{(pid=91689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:20.591156 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-ce210b7d-d7d0-48f0-a3da-dd088cd42ca2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:20.603850 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-ce210b7d-d7d0-48f0-a3da-dd088cd42ca2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:20.613015 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0b5e465a-536d-4b45-98e9-6dc9829f5cb6 None None] Checking agent: {'id': '333121d4-1023-4a33-a54c-f4dd052e1612', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-790910-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 4, 13, 33), 'started_at': datetime.datetime(2021, 5, 20, 4, 14, 3), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 4, 23, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-790910-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 04:23:20.614107 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0b5e465a-536d-4b45-98e9-6dc9829f5cb6 None None] Checking segment: {'id': '8df49ec5-3fb9-4715-bc9a-f4019a6b55f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91689) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:23:20.614775 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron_lib.callbacks.manager [None req-0b5e465a-536d-4b45-98e9-6dc9829f5cb6 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:20.615403 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0b5e465a-536d-4b45-98e9-6dc9829f5cb6 None None] Bound using segment: {'id': '8df49ec5-3fb9-4715-bc9a-f4019a6b55f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90'} {{(pid=91689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 04:23:20.616240 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.managers [None req-0b5e465a-536d-4b45-98e9-6dc9829f5cb6 None None] Bound port: b4b174b3-1436-4e17-8fa3-97243bad59c3, host: dv-cinder-790910-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8df49ec5-3fb9-4715-bc9a-f4019a6b55f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90'}}] {{(pid=91689) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 04:23:20.616867 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron_lib.callbacks.manager [None req-0b5e465a-536d-4b45-98e9-6dc9829f5cb6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:20.640625 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-c5f829d9-d469-45a3-8975-b699ce84af96 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:20.718789 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce210b7d-d7d0-48f0-a3da-dd088cd42ca2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1b312d46-887c-49dd-9554-b1c4373ebf17,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:20.722870 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6b12d0d-9892-4452-944e-4046ab720f78 req-a193541e-8887-409f-a245-e9e881ea3846 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:20.738325 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-ce210b7d-d7d0-48f0-a3da-dd088cd42ca2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.099s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:20.738853 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-b6b12d0d-9892-4452-944e-4046ab720f78 req-a193541e-8887-409f-a245-e9e881ea3846 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 945 time: 0.2279329
May 20 04:23:20.767542 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3f2dc05-eeae-48f7-a3e4-de7be39120f3 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:23:20.768074 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3f2dc05-eeae-48f7-a3e4-de7be39120f3 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:23:20.768416 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3f2dc05-eeae-48f7-a3e4-de7be39120f3 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:23:20.768748 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3f2dc05-eeae-48f7-a3e4-de7be39120f3 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:23:20.769289 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3f2dc05-eeae-48f7-a3e4-de7be39120f3 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:23:20.769614 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3f2dc05-eeae-48f7-a3e4-de7be39120f3 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:23:20.770087 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3f2dc05-eeae-48f7-a3e4-de7be39120f3 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:23:20.770474 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3f2dc05-eeae-48f7-a3e4-de7be39120f3 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:23:20.770825 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3f2dc05-eeae-48f7-a3e4-de7be39120f3 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:23:20.771226 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3f2dc05-eeae-48f7-a3e4-de7be39120f3 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:23:20.772009 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3f2dc05-eeae-48f7-a3e4-de7be39120f3 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:23:20.772387 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3f2dc05-eeae-48f7-a3e4-de7be39120f3 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:23:20.772567 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-ce210b7d-d7d0-48f0-a3da-dd088cd42ca2 admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=6865ba068db345bead51d62c48ce31a9&name=default HTTP/1.1" status: 200  len: 2979 time: 0.9377160
May 20 04:23:20.773597 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 38608) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:23:20.787871 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG oslo_concurrency.lockutils [None req-d3f2dc05-eeae-48f7-a3e4-de7be39120f3 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.478s {{(pid=91689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:20.803506 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.db [None req-0b5e465a-536d-4b45-98e9-6dc9829f5cb6 None None] For port b4b174b3-1436-4e17-8fa3-97243bad59c3, host dv-cinder-790910-4-iscsi, cleared binding levels {{(pid=91689) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 04:23:20.816371 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.db [None req-0b5e465a-536d-4b45-98e9-6dc9829f5cb6 None None] For port b4b174b3-1436-4e17-8fa3-97243bad59c3, host dv-cinder-790910-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=b4b174b3-1436-4e17-8fa3-97243bad59c3,segment=NetworkSegment(8df49ec5-3fb9-4715-bc9a-f4019a6b55f9),segment_id=8df49ec5-3fb9-4715-bc9a-f4019a6b55f9)] {{(pid=91689) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 04:23:20.832408 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron_lib.callbacks.manager [None req-0b5e465a-536d-4b45-98e9-6dc9829f5cb6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:20.843066 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=91689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:20.877049 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-b6b12d0d-9892-4452-944e-4046ab720f78 req-c6046dca-6f97-4c97-bfaf-dc974f599f2f tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0782652
May 20 04:23:20.880594 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.db_base_plugin_common [None req-3649ebb2-347b-4cc6-9a5f-20f5b9d8e810 admin admin] Allocated IP 172.20.0.1 (fdf92998-25fa-4179-ab1b-131af0ce059a/e905ed23-00d1-4991-b3bb-e1a1e32b4c86/907a9337-b889-44b2-b856-48e472d2bc38) {{(pid=91686) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 04:23:20.988345 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-19c7f328-8200-41a2-827d-bac9f7a820f6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:21.027270 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-19c7f328-8200-41a2-827d-bac9f7a820f6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:21.072458 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3f2dc05-eeae-48f7-a3e4-de7be39120f3 None None] Pushing event updated for resources: {'Port': ['ID=b4b174b3-1436-4e17-8fa3-97243bad59c3,revision_number=3']} {{(pid=91689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:21.077359 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG oslo_concurrency.lockutils [None req-d3f2dc05-eeae-48f7-a3e4-de7be39120f3 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.234s {{(pid=91689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:21.101677 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0b5e465a-536d-4b45-98e9-6dc9829f5cb6 None None] Routers {'9c2e249a-3b4f-4271-8226-b44c455943cc'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91689) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:23:21.102755 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-0b5e465a-536d-4b45-98e9-6dc9829f5cb6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced1b32e20>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:23:03Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['9c2e249a-3b4f-4271-8226-b44c455943cc'], 'active': True} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:23:21.130327 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-19c7f328-8200-41a2-827d-bac9f7a820f6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:21.137297 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-517c69e0-d1d1-4817-be82-0ca690871710 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:21.165907 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19c7f328-8200-41a2-827d-bac9f7a820f6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1b312d46-887c-49dd-9554-b1c4373ebf17,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:21.186573 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-19c7f328-8200-41a2-827d-bac9f7a820f6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:21.204714 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-19c7f328-8200-41a2-827d-bac9f7a820f6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:21.206161 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-19c7f328-8200-41a2-827d-bac9f7a820f6 admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/1b312d46-887c-49dd-9554-b1c4373ebf17 HTTP/1.1" status: 204  len: 168 time: 0.4310203
May 20 04:23:21.240543 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-3649ebb2-347b-4cc6-9a5f-20f5b9d8e810 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:21.270501 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.provisioning_blocks [None req-3649ebb2-347b-4cc6-9a5f-20f5b9d8e810 admin admin] Transition to ACTIVE for port object 907a9337-b889-44b2-b856-48e472d2bc38 will not be triggered until provisioned by entity DHCP. {{(pid=91686) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:23:21.340619 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-3649ebb2-347b-4cc6-9a5f-20f5b9d8e810 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8782892106231', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2145052'] for port, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:21.352385 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-d4420ce5-551e-4faf-a49e-dda3d9cfacd1 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:21.385286 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvr_db [None req-0b5e465a-536d-4b45-98e9-6dc9829f5cb6 None None] Set router 9c2e249a-3b4f-4271-8226-b44c455943cc gateway port host: dv-cinder-790910-4-iscsi {{(pid=91689) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:23:21.471845 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3649ebb2-347b-4cc6-9a5f-20f5b9d8e810 admin admin] Pushing event updated for resources: {'Port': ['ID=907a9337-b889-44b2-b856-48e472d2bc38,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:21.478052 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-3649ebb2-347b-4cc6-9a5f-20f5b9d8e810 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.126s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:21.490422 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3649ebb2-347b-4cc6-9a5f-20f5b9d8e810 admin admin] Network fdf92998-25fa-4179-ab1b-131af0ce059a is already hosted by enough agents. {{(pid=91686) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:23:21.492297 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.base_scheduler [None req-3649ebb2-347b-4cc6-9a5f-20f5b9d8e810 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91686) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:23:21.496485 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3649ebb2-347b-4cc6-9a5f-20f5b9d8e810 admin admin] Received port after_create {{(pid=91686) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 04:23:21.538951 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46999f96-9387-4321-aba6-2c72f864cd68 req-b323d099-800a-40fe-9341-c3c98df107d0 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:21.550144 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-46999f96-9387-4321-aba6-2c72f864cd68 req-b323d099-800a-40fe-9341-c3c98df107d0 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.2173567
May 20 04:23:21.573456 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-3649ebb2-347b-4cc6-9a5f-20f5b9d8e810 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1716281'] for router_interface, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:21.655958 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-46999f96-9387-4321-aba6-2c72f864cd68 req-b786002a-ecef-4ba0-89ce-05d50ac2ea29 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1005573
May 20 04:23:21.936991 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-3649ebb2-347b-4cc6-9a5f-20f5b9d8e810 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:22.036014 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-555ecc0c-ad06-4b56-90fa-2fb316254497 None None] Provisioning for port 907a9337-b889-44b2-b856-48e472d2bc38 completed by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:23:22.067029 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-555ecc0c-ad06-4b56-90fa-2fb316254497 None None] Provisioning complete for port 907a9337-b889-44b2-b856-48e472d2bc38 triggered by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:23:22.067605 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-555ecc0c-ad06-4b56-90fa-2fb316254497 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:22.195338 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-555ecc0c-ad06-4b56-90fa-2fb316254497 None None] Port 907a9337-b889-44b2-b856-48e472d2bc38 cannot update to ACTIVE because it is not bound. {{(pid=91688) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 20 04:23:22.221915 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 38646) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:23:22.244701 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-f234eda3-0961-42ce-b0b8-6c12928f107e admin admin] Notify callbacks [] for security_group, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:22.269756 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-f234eda3-0961-42ce-b0b8-6c12928f107e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:23:22.275433 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-f234eda3-0961-42ce-b0b8-6c12928f107e admin admin] Usage tracker for resource:security_group_rule and tenant:2600adfa05634ab39d958b29ddd215f1 is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:23:22.279620 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-f234eda3-0961-42ce-b0b8-6c12928f107e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:23:22.288744 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-f234eda3-0961-42ce-b0b8-6c12928f107e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:23:22.396388 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-f234eda3-0961-42ce-b0b8-6c12928f107e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:22.408580 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-f234eda3-0961-42ce-b0b8-6c12928f107e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:22.427521 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-fcfd5ee5-3ddb-49cc-aa11-becc5c80c6bb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:22.430851 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-0b5e465a-536d-4b45-98e9-6dc9829f5cb6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced1b32e20>, [{'id': '9c2e249a-3b4f-4271-8226-b44c455943cc', 'name': 'tempest-TestMinimumBasicScenario-1023892954-router', 'tenant_id': 'e6fe6bea38b946a5a97ea42bf787f1b3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.213'}], 'enable_snat': True}, 'gw_port_id': 'b4b174b3-1436-4e17-8fa3-97243bad59c3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:23:14Z', 'updated_at': '2021-05-20T04:23:16Z', 'revision_number': 3, 'project_id': 'e6fe6bea38b946a5a97ea42bf787f1b3', 'gw_port': {'id': 'b4b174b3-1436-4e17-8fa3-97243bad59c3', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:4d:2f:62', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9c2e249a-3b4f-4271-8226-b44c455943cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 330, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:23:15Z', 'updated_at': '2021-05-20T04:23:20Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi'}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:23:22.440938 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0b5e465a-536d-4b45-98e9-6dc9829f5cb6 None None] The sync data for ids ['9c2e249a-3b4f-4271-8226-b44c455943cc'] in dv-cinder-790910-4-iscsi is: [{'id': '9c2e249a-3b4f-4271-8226-b44c455943cc', 'name': 'tempest-TestMinimumBasicScenario-1023892954-router', 'tenant_id': 'e6fe6bea38b946a5a97ea42bf787f1b3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.213'}], 'enable_snat': True}, 'gw_port_id': 'b4b174b3-1436-4e17-8fa3-97243bad59c3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:23:14Z', 'updated_at': '2021-05-20T04:23:16Z', 'revision_number': 3, 'project_id': 'e6fe6bea38b946a5a97ea42bf787f1b3', 'gw_port': {'id': 'b4b174b3-1436-4e17-8fa3-97243bad59c3', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:4d:2f:62', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9c2e249a-3b4f-4271-8226-b44c455943cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 330, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:23:15Z', 'updated_at': '2021-05-20T04:23:20Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi'}] {{(pid=91689) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 04:23:22.504601 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-3649ebb2-347b-4cc6-9a5f-20f5b9d8e810 admin admin] Notify callbacks [] for port, precommit_update {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:22.518873 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-3649ebb2-347b-4cc6-9a5f-20f5b9d8e810 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2145029'] for port, after_update {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:22.556382 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f234eda3-0961-42ce-b0b8-6c12928f107e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ddfa1598-a92c-4a5f-a6a7-3bf1fbf84b93,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:22.566139 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-f234eda3-0961-42ce-b0b8-6c12928f107e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.139s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:22.573981 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-f234eda3-0961-42ce-b0b8-6c12928f107e admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=2600adfa05634ab39d958b29ddd215f1&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3463297
May 20 04:23:22.577116 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 38658) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:23:22.623688 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-3649ebb2-347b-4cc6-9a5f-20f5b9d8e810 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:22.724671 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-d8997d66-4374-4872-b59e-aa6365d8fb4e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:22.756721 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-d8997d66-4374-4872-b59e-aa6365d8fb4e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:22.828990 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3649ebb2-347b-4cc6-9a5f-20f5b9d8e810 admin admin] Pushing event updated for resources: {'Port': ['ID=907a9337-b889-44b2-b856-48e472d2bc38,revision_number=2']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:22.830817 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-d8997d66-4374-4872-b59e-aa6365d8fb4e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:22.837522 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-3649ebb2-347b-4cc6-9a5f-20f5b9d8e810 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.215s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:22.846356 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-c4e3f0a4-da47-4d04-ad9b-ad701c7a8840 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:22.846538 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-3649ebb2-347b-4cc6-9a5f-20f5b9d8e810 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1781412', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1716318'] for router_interface, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:22.866188 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8997d66-4374-4872-b59e-aa6365d8fb4e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ddfa1598-a92c-4a5f-a6a7-3bf1fbf84b93,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:22.888079 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-d8997d66-4374-4872-b59e-aa6365d8fb4e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:22.891334 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-d8997d66-4374-4872-b59e-aa6365d8fb4e admin admin] Notify callbacks [] for security_group, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:22.902899 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-d8997d66-4374-4872-b59e-aa6365d8fb4e admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/ddfa1598-a92c-4a5f-a6a7-3bf1fbf84b93 HTTP/1.1" status: 204  len: 168 time: 0.3186791
May 20 04:23:23.262991 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3649ebb2-347b-4cc6-9a5f-20f5b9d8e810 admin admin] Network fdf92998-25fa-4179-ab1b-131af0ce059a is already hosted by enough agents. {{(pid=91686) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:23:23.264602 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.base_scheduler [None req-3649ebb2-347b-4cc6-9a5f-20f5b9d8e810 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91686) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:23:23.520924 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3649ebb2-347b-4cc6-9a5f-20f5b9d8e810 admin admin] Router 9c2e249a-3b4f-4271-8226-b44c455943cc has already been hosted by L3 agent 02733fc0-fc9c-4e29-bc03-c27a792d539d {{(pid=91686) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 04:23:23.666173 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-e039de00-973f-4bf9-95e5-80dd6a30e047 None None] Provisioning complete for port 907a9337-b889-44b2-b856-48e472d2bc38 triggered by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:23:23.666801 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-e039de00-973f-4bf9-95e5-80dd6a30e047 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:23.939987 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-e039de00-973f-4bf9-95e5-80dd6a30e047 None None] Port 907a9337-b889-44b2-b856-48e472d2bc38 cannot update to ACTIVE because it is not bound. {{(pid=91688) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 20 04:23:23.955553 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3649ebb2-347b-4cc6-9a5f-20f5b9d8e810 admin admin] Notify agent at l3_agent.dv-cinder-790910-4-iscsi the message routers_updated {{(pid=91686) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 04:23:23.983427 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-3649ebb2-347b-4cc6-9a5f-20f5b9d8e810 admin admin] 10.222.0.71 "PUT /v2.0/routers/9c2e249a-3b4f-4271-8226-b44c455943cc/add_router_interface HTTP/1.1" status: 200  len: 503 time: 5.8176148
May 20 04:23:24.006665 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device b4b174b3-1436-4e17-8fa3-97243bad59c3 up at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:23:24.153881 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning for port b4b174b3-1436-4e17-8fa3-97243bad59c3 completed by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:23:24.164770 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning complete for port b4b174b3-1436-4e17-8fa3-97243bad59c3 triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:23:24.165397 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:24.442826 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:24.483632 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] For port b4b174b3-1436-4e17-8fa3-97243bad59c3, host dv-cinder-790910-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=b4b174b3-1436-4e17-8fa3-97243bad59c3,segment=NetworkSegment(8df49ec5-3fb9-4715-bc9a-f4019a6b55f9),segment_id=8df49ec5-3fb9-4715-bc9a-f4019a6b55f9)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:23:24.494579 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:24.500478 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:24.624443 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Pushing event updated for resources: {'Port': ['ID=b4b174b3-1436-4e17-8fa3-97243bad59c3,revision_number=4']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:24.642691 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.144s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:25.143467 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d267e5a-9f6e-441d-b63a-fcc26c83b10e req-c9be7dc0-4a34-4153-9665-71c9845399cb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:25.145197 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-1d267e5a-9f6e-441d-b63a-fcc26c83b10e req-c9be7dc0-4a34-4153-9665-71c9845399cb service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=b7d86d894a5f420e86f4c28d7772bd22&device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 1098 time: 0.0958266
May 20 04:23:25.270696 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7eee89a1-b9e0-4cfc-87d1-bfc59dbd4fb7 req-99613eef-7532-4099-bcf4-636a1653301f tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:25.273777 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-7eee89a1-b9e0-4cfc-87d1-bfc59dbd4fb7 req-99613eef-7532-4099-bcf4-636a1653301f tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.1310229
May 20 04:23:25.352202 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-74f1c27a-f71e-433b-9850-06bfa0128658 None None] Sync routers for ids ['9c2e249a-3b4f-4271-8226-b44c455943cc'] in dv-cinder-790910-4-iscsi {{(pid=91688) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 04:23:25.366999 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-74f1c27a-f71e-433b-9850-06bfa0128658 None None] Routers {'9c2e249a-3b4f-4271-8226-b44c455943cc'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91688) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:23:25.369888 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-74f1c27a-f71e-433b-9850-06bfa0128658 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced16cf8e0>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:23:03Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['9c2e249a-3b4f-4271-8226-b44c455943cc'], 'active': True} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:23:25.374360 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-7eee89a1-b9e0-4cfc-87d1-bfc59dbd4fb7 req-861d31eb-a097-4e5c-8c66-8e8144b59e11 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0948310
May 20 04:23:25.405758 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d267e5a-9f6e-441d-b63a-fcc26c83b10e req-da90fbfe-7bf8-4099-9778-dc266b83be8e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:25.409033 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-1d267e5a-9f6e-441d-b63a-fcc26c83b10e req-da90fbfe-7bf8-4099-9778-dc266b83be8e service neutron] 10.222.0.82 "GET /v2.0/networks?id=348b2b0f-c826-45ab-ba85-8430235b9cac HTTP/1.1" status: 200  len: 920 time: 0.2557282
May 20 04:23:25.431933 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 38752) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:23:25.438383 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.v2.base [None req-b3db490c-a02d-4770-b2c7-f646fae58291 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-943774282-network', 'tenant_id': 'a588c51341504beda6a1803a15cc919c'}} {{(pid=91686) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:23:25.446885 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-b3db490c-a02d-4770-b2c7-f646fae58291 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:23:25.452660 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-b3db490c-a02d-4770-b2c7-f646fae58291 admin admin] Usage tracker for resource:network and tenant:a588c51341504beda6a1803a15cc919c is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:23:25.456579 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-b3db490c-a02d-4770-b2c7-f646fae58291 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:23:25.464786 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-b3db490c-a02d-4770-b2c7-f646fae58291 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:23:25.490576 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b3db490c-a02d-4770-b2c7-f646fae58291 admin admin] Made reservation on behalf of a588c51341504beda6a1803a15cc919c for: {'network': 1} {{(pid=91686) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 04:23:25.493565 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-b3db490c-a02d-4770-b2c7-f646fae58291 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-578118'] for network, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:25.510249 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-b3db490c-a02d-4770-b2c7-f646fae58291 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:25.523971 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-1d267e5a-9f6e-441d-b63a-fcc26c83b10e req-065afc10-0514-49c7-9fe5-f22de0c1cbdd service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=65d523e1-f132-4819-aa42-995ded4a1ad8 HTTP/1.1" status: 200  len: 217 time: 0.1033847
May 20 04:23:25.544694 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-b3db490c-a02d-4770-b2c7-f646fae58291 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:23:25.555573 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-b3db490c-a02d-4770-b2c7-f646fae58291 admin admin] Usage tracker for resource:security_group_rule and tenant:a588c51341504beda6a1803a15cc919c is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:23:25.559219 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-b3db490c-a02d-4770-b2c7-f646fae58291 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:23:25.569062 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-b3db490c-a02d-4770-b2c7-f646fae58291 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:23:25.663672 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d267e5a-9f6e-441d-b63a-fcc26c83b10e req-103c4521-7b6d-4d99-8826-c867b4615ce1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:25.667107 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-1d267e5a-9f6e-441d-b63a-fcc26c83b10e req-103c4521-7b6d-4d99-8826-c867b4615ce1 service neutron] 10.222.0.82 "GET /v2.0/subnets?id=b488dc7d-0e70-4e52-9179-7e6c3e4fb0a1 HTTP/1.1" status: 200  len: 859 time: 0.1319342
May 20 04:23:25.737840 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvr_db [None req-74f1c27a-f71e-433b-9850-06bfa0128658 None None] Set router 9c2e249a-3b4f-4271-8226-b44c455943cc gateway port host: dv-cinder-790910-4-iscsi {{(pid=91688) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:23:25.743025 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-b3db490c-a02d-4770-b2c7-f646fae58291 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:25.751117 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-b3db490c-a02d-4770-b2c7-f646fae58291 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:25.770937 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-5521b875-fbc2-43e6-86ef-5cd38cf2a9d3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:25.774602 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-1d267e5a-9f6e-441d-b63a-fcc26c83b10e req-73a9a630-5ddd-4d7a-92b2-8f3b365cc0a1 service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=348b2b0f-c826-45ab-ba85-8430235b9cac&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0993841
May 20 04:23:25.861482 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b3db490c-a02d-4770-b2c7-f646fae58291 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 894}  {{(pid=91686) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 20 04:23:25.902742 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-b3db490c-a02d-4770-b2c7-f646fae58291 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1501910'] for segment, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:25.902964 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.db.segments_db [None req-b3db490c-a02d-4770-b2c7-f646fae58291 admin admin] Added segment f495c6da-d858-4d7b-a7ae-2c30d9f73111 of type vlan for network fc681196-7d83-4764-b760-89961b7ffe54
May 20 04:23:25.956050 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-b3db490c-a02d-4770-b2c7-f646fae58291 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8782892092784'] for network, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:25.985267 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3db490c-a02d-4770-b2c7-f646fae58291 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=861e7b78-d952-4f46-aada-ea2d5d5cb8ab,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:25.989463 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-b3db490c-a02d-4770-b2c7-f646fae58291 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.221s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:26.019402 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-b3db490c-a02d-4770-b2c7-f646fae58291 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1590664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1781430'] for network, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:26.022171 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b3db490c-a02d-4770-b2c7-f646fae58291 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:26.022853 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-b3db490c-a02d-4770-b2c7-f646fae58291 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for network, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:26.059063 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:26.073392 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device b4b174b3-1436-4e17-8fa3-97243bad59c3 up at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:23:26.086756 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-b3db490c-a02d-4770-b2c7-f646fae58291 admin admin] 10.222.0.71 "POST /v2.0/networks HTTP/1.1" status: 201  len: 887 time: 0.6486847
May 20 04:23:26.094543 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 38774) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:23:26.103727 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [None req-84bc1f9e-7c7e-4774-b304-49838d2760ba admin admin] Request body: {'subnet': {'network_id': 'fc681196-7d83-4764-b760-89961b7ffe54', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-943774282-subnet', 'tenant_id': 'a588c51341504beda6a1803a15cc919c', 'ip_version': 4}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:23:26.124311 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-84bc1f9e-7c7e-4774-b304-49838d2760ba admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:23:26.147852 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-84bc1f9e-7c7e-4774-b304-49838d2760ba admin admin] Usage tracker for resource:subnet and tenant:a588c51341504beda6a1803a15cc919c is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:23:26.156676 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-84bc1f9e-7c7e-4774-b304-49838d2760ba admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:23:26.180435 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-84bc1f9e-7c7e-4774-b304-49838d2760ba admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:23:26.193492 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3db490c-a02d-4770-b2c7-f646fae58291 admin admin] Pushing event updated for resources: {'Network': ['ID=fc681196-7d83-4764-b760-89961b7ffe54,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:26.196136 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-b3db490c-a02d-4770-b2c7-f646fae58291 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.137s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:26.234831 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-84bc1f9e-7c7e-4774-b304-49838d2760ba admin admin] Made reservation on behalf of a588c51341504beda6a1803a15cc919c for: {'subnet': 1} {{(pid=91687) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 04:23:26.238496 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-84bc1f9e-7c7e-4774-b304-49838d2760ba admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-692271'] for subnet, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:26.265753 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Network fc681196-7d83-4764-b760-89961b7ffe54 details requested by agent ovs-agent-dv-cinder-790910-4-iscsi with host dv-cinder-790910-4-iscsi {{(pid=91688) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 20 04:23:26.426039 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-1d267e5a-9f6e-441d-b63a-fcc26c83b10e req-465cc032-86f0-4ce8-8028-90719f57089e service neutron] 10.222.0.82 "GET /v2.0/networks/348b2b0f-c826-45ab-ba85-8430235b9cac?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.6439521
May 20 04:23:26.776282 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13e7cc23-2088-4a17-bfe4-c50c0d69ce50 req-fdfd48f9-e7d5-487e-a1de-5ba0e3318ad8 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:26.779535 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-13e7cc23-2088-4a17-bfe4-c50c0d69ce50 req-fdfd48f9-e7d5-487e-a1de-5ba0e3318ad8 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.1504912
May 20 04:23:26.825756 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning complete for port b4b174b3-1436-4e17-8fa3-97243bad59c3 triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:23:26.829420 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:26.920208 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-13e7cc23-2088-4a17-bfe4-c50c0d69ce50 req-1c266e4a-fe4f-45db-876f-0d32c707255f tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1310048
May 20 04:23:27.040409 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-1d267e5a-9f6e-441d-b63a-fcc26c83b10e req-b4de5cc5-d67f-4cfb-8e70-67bb71e5424d service neutron] 10.222.0.82 "GET /v2.0/networks/348b2b0f-c826-45ab-ba85-8430235b9cac?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.6071019
May 20 04:23:27.220013 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-74f1c27a-f71e-433b-9850-06bfa0128658 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced16cf8e0>, [{'id': '9c2e249a-3b4f-4271-8226-b44c455943cc', 'name': 'tempest-TestMinimumBasicScenario-1023892954-router', 'tenant_id': 'e6fe6bea38b946a5a97ea42bf787f1b3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.213'}], 'enable_snat': True}, 'gw_port_id': 'b4b174b3-1436-4e17-8fa3-97243bad59c3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:23:14Z', 'updated_at': '2021-05-20T04:23:21Z', 'revision_number': 4, 'project_id': 'e6fe6bea38b946a5a97ea42bf787f1b3', 'gw_port': {'id': 'b4b174b3-1436-4e17-8fa3-97243bad59c3', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:4d:2f:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c2e249a-3b4f-4271-8226-b44c455943cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 330, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:23:15Z', 'updated_at': '2021-05-20T04:23:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_interfaces': [{'id': '907a9337-b889-44b2-b856-48e472d2bc38', 'name': '', 'network_id': 'fdf92998-25fa-4179-ab1b-131af0ce059a', 'tenant_id': 'e6fe6bea38b946a5a97ea42bf787f1b3', 'mac_address': 'fa:16:3e:0f:d2:47', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9c2e249a-3b4f-4271-8226-b44c455943cc', 'device_owner': 'network:router_interface', 'standard_attr_id': 333, 'fixed_ips': [{'subnet_id': 'e905ed23-00d1-4991-b3bb-e1a1e32b4c86', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:23:20Z', 'updated_at': '2021-05-20T04:23:22Z', 'revision_number': 2, 'project_id': 'e6fe6bea38b946a5a97ea42bf787f1b3', 'subnets': [{'id': 'e905ed23-00d1-4991-b3bb-e1a1e32b4c86', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:23:27.231255 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-74f1c27a-f71e-433b-9850-06bfa0128658 None None] Checking router: 9c2e249a-3b4f-4271-8226-b44c455943cc for host: dv-cinder-790910-4-iscsi {{(pid=91688) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 04:23:27.232340 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-74f1c27a-f71e-433b-9850-06bfa0128658 None None] Updating router 9c2e249a-3b4f-4271-8226-b44c455943cc port 907a9337-b889-44b2-b856-48e472d2bc38 binding host dv-cinder-790910-4-iscsi {{(pid=91688) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 20 04:23:27.492024 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-74f1c27a-f71e-433b-9850-06bfa0128658 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:27.550174 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 38814) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:23:27.618596 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-84bc1f9e-7c7e-4774-b304-49838d2760ba admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-255887', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-4160768', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-692253'] for subnet, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:27.624159 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-d0e6e9fa-6ae0-479f-9a37-60889828609f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:27.721353 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84bc1f9e-7c7e-4774-b304-49838d2760ba admin admin] Pushing event updated for resources: {'Subnet': ['ID=a34998b9-6684-4ced-a2bb-9b229ae96845,revision_number=0']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:27.725933 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-84bc1f9e-7c7e-4774-b304-49838d2760ba admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:27.732985 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-84bc1f9e-7c7e-4774-b304-49838d2760ba admin admin] Checking segment: {'id': 'f495c6da-d858-4d7b-a7ae-2c30d9f73111', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 894, 'network_id': 'fc681196-7d83-4764-b760-89961b7ffe54'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91687) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:23:27.733370 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-84bc1f9e-7c7e-4774-b304-49838d2760ba admin admin] Network hostable DHCP agents. Network: fc681196-7d83-4764-b760-89961b7ffe54, hostable agents: ['36d27813-c368-4fd7-ae26-0f662e0a96fd'], hosted agents: [] {{(pid=91687) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 20 04:23:27.768639 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-84bc1f9e-7c7e-4774-b304-49838d2760ba admin admin] Network fc681196-7d83-4764-b760-89961b7ffe54 is scheduled to be hosted by DHCP agent 36d27813-c368-4fd7-ae26-0f662e0a96fd with binding_index 1 {{(pid=91687) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 20 04:23:27.773806 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-64a4ac52-30d1-4ff2-80b7-4ed2d81b7d23 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:27.788853 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.base_scheduler [None req-84bc1f9e-7c7e-4774-b304-49838d2760ba admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-790910-4-iscsi, fc681196-7d83-4764-b760-89961b7ffe54) {{(pid=91687) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:23:27.839989 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-84bc1f9e-7c7e-4774-b304-49838d2760ba admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:27.841336 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-84bc1f9e-7c7e-4774-b304-49838d2760ba admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for subnet, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:27.846709 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-64a4ac52-30d1-4ff2-80b7-4ed2d81b7d23 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:23:27.865948 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-64a4ac52-30d1-4ff2-80b7-4ed2d81b7d23 admin admin] Usage tracker for resource:security_group_rule and tenant:68ef26dda6e74a718328e1dd7a1f030d is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:23:27.874078 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-64a4ac52-30d1-4ff2-80b7-4ed2d81b7d23 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:23:27.893483 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-84bc1f9e-7c7e-4774-b304-49838d2760ba admin admin] 10.222.0.71 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 850 time: 1.7976704
May 20 04:23:27.897870 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 38824) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:23:27.900238 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-baf317ce-53de-43fe-adda-368dbd1df48c None None] Network fc681196-7d83-4764-b760-89961b7ffe54 requested from dv-cinder-790910-4-iscsi {{(pid=91688) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 04:23:27.906472 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [None req-9a6106b1-d369-4030-8139-bb68fbb31bff admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-943774282-router', 'tenant_id': 'a588c51341504beda6a1803a15cc919c', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90'}}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:23:27.916209 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-9a6106b1-d369-4030-8139-bb68fbb31bff admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:23:27.919214 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-64a4ac52-30d1-4ff2-80b7-4ed2d81b7d23 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:23:27.923090 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-9a6106b1-d369-4030-8139-bb68fbb31bff admin admin] Usage tracker for resource:router and tenant:a588c51341504beda6a1803a15cc919c is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:23:27.928543 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-9a6106b1-d369-4030-8139-bb68fbb31bff admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:23:27.939807 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-9a6106b1-d369-4030-8139-bb68fbb31bff admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:23:27.969543 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-9a6106b1-d369-4030-8139-bb68fbb31bff admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1796465', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-6255'] for router, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:27.972567 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-9a6106b1-d369-4030-8139-bb68fbb31bff admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1713009', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1713968', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1590966', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-6244'] for router, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:28.026303 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-9a6106b1-d369-4030-8139-bb68fbb31bff admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:28.515811 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-64a4ac52-30d1-4ff2-80b7-4ed2d81b7d23 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:28.560764 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-64a4ac52-30d1-4ff2-80b7-4ed2d81b7d23 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:28.594805 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-4b580db9-0ada-4bb7-bc9b-ee104bea48cb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:28.668318 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64a4ac52-30d1-4ff2-80b7-4ed2d81b7d23 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=30cb25a2-27d7-41d3-9cde-f78817deb74b,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:28.679863 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-64a4ac52-30d1-4ff2-80b7-4ed2d81b7d23 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:28.734986 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a7f08e44-265b-4e1a-82e1-5cc49fc7642b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpfbdc8e9b-5136-5478-8aa8-b0b6b9be0f90-fc681196-7d83-4764-b760-89961b7ffe54', 'network_id': 'fc681196-7d83-4764-b760-89961b7ffe54', 'tenant_id': 'a588c51341504beda6a1803a15cc919c', 'fixed_ips': [{'subnet_id': 'a34998b9-6684-4ced-a2bb-9b229ae96845'}]}} from dv-cinder-790910-4-iscsi. {{(pid=91688) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 20 04:23:28.736012 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-a7f08e44-265b-4e1a-82e1-5cc49fc7642b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_create {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:28.752050 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-64a4ac52-30d1-4ff2-80b7-4ed2d81b7d23 admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=68ef26dda6e74a718328e1dd7a1f030d&name=default HTTP/1.1" status: 200  len: 2979 time: 1.2003658
May 20 04:23:28.762000 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 38846) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:23:28.812658 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44e1ef74-5d4e-44ef-8201-5e3564459d36 req-c1fd183f-4584-4927-b7de-a97f570939f8 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:28.825846 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-44e1ef74-5d4e-44ef-8201-5e3564459d36 req-c1fd183f-4584-4927-b7de-a97f570939f8 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.6554871
May 20 04:23:28.913912 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 38852) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:23:28.940079 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-74f1c27a-f71e-433b-9850-06bfa0128658 None None] Notify callbacks [] for port, precommit_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:28.997765 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-44e1ef74-5d4e-44ef-8201-5e3564459d36 req-84826c65-540c-4004-b61a-5c0a1c0212fa tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1666245
May 20 04:23:29.032434 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-74f1c27a-f71e-433b-9850-06bfa0128658 None None] Transition to ACTIVE for port object 907a9337-b889-44b2-b856-48e472d2bc38 will not be triggered until provisioned by entity L2. {{(pid=91688) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:23:29.054531 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-9a6106b1-d369-4030-8139-bb68fbb31bff admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1713977', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1796355', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-6218'] for router, precommit_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:29.067553 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-74f1c27a-f71e-433b-9850-06bfa0128658 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:29.080056 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-bf6b4424-34ec-44a8-b3c4-99d131ba17a8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:29.085512 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:29.152101 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-bf6b4424-34ec-44a8-b3c4-99d131ba17a8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:29.229475 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-ec00d13b-0ba0-426b-92ee-17355c844128 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:29.262919 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-ec00d13b-0ba0-426b-92ee-17355c844128 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:23:29.267943 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-ec00d13b-0ba0-426b-92ee-17355c844128 admin admin] Usage tracker for resource:security_group_rule and tenant:2564ddda0e114e9d9a0616cd1d5847a0 is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:23:29.274088 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-ec00d13b-0ba0-426b-92ee-17355c844128 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:23:29.291506 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-ec00d13b-0ba0-426b-92ee-17355c844128 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:23:29.349013 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.db_base_plugin_common [None req-a7f08e44-265b-4e1a-82e1-5cc49fc7642b None None] Allocated IP 172.20.0.2 (fc681196-7d83-4764-b760-89961b7ffe54/a34998b9-6684-4ced-a2bb-9b229ae96845/7c96d7de-6e5c-4184-9fe2-72490748c224) {{(pid=91688) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 04:23:29.377131 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19075ce2-40cd-40b1-bc7b-0370a9bf5412 None None] Pushing event updated for resources: {'Port': ['ID=907a9337-b889-44b2-b856-48e472d2bc38,revision_number=3']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:29.387248 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-19075ce2-40cd-40b1-bc7b-0370a9bf5412 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.302s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:29.451041 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-ec00d13b-0ba0-426b-92ee-17355c844128 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:29.451379 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.managers [None req-74f1c27a-f71e-433b-9850-06bfa0128658 None None] Attempting to bind port 907a9337-b889-44b2-b856-48e472d2bc38 on host dv-cinder-790910-4-iscsi for vnic_type normal with profile  {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 04:23:29.451592 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.managers [None req-74f1c27a-f71e-433b-9850-06bfa0128658 None None] Attempting to bind port 907a9337-b889-44b2-b856-48e472d2bc38 by drivers openvswitch,hyperv on host dv-cinder-790910-4-iscsi at level 0 using segments [{'id': 'b84e1e85-c58b-4982-b59b-cb9584098e15', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 893, 'network_id': 'fdf92998-25fa-4179-ab1b-131af0ce059a'}] {{(pid=91688) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 04:23:29.452182 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-74f1c27a-f71e-433b-9850-06bfa0128658 None None] Attempting to bind port 907a9337-b889-44b2-b856-48e472d2bc38 on network fdf92998-25fa-4179-ab1b-131af0ce059a {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:23:29.464714 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-ec00d13b-0ba0-426b-92ee-17355c844128 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:29.477976 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-1f76a0b1-fa74-4021-9162-22ac1baeacc4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:29.503274 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-74f1c27a-f71e-433b-9850-06bfa0128658 None None] Checking agent: {'id': '333121d4-1023-4a33-a54c-f4dd052e1612', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-790910-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 4, 13, 33), 'started_at': datetime.datetime(2021, 5, 20, 4, 14, 3), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 4, 23, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-790910-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 04:23:29.503666 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-74f1c27a-f71e-433b-9850-06bfa0128658 None None] Checking segment: {'id': 'b84e1e85-c58b-4982-b59b-cb9584098e15', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 893, 'network_id': 'fdf92998-25fa-4179-ab1b-131af0ce059a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91688) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:23:29.504078 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-74f1c27a-f71e-433b-9850-06bfa0128658 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:29.504482 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-74f1c27a-f71e-433b-9850-06bfa0128658 None None] Bound using segment: {'id': 'b84e1e85-c58b-4982-b59b-cb9584098e15', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 893, 'network_id': 'fdf92998-25fa-4179-ab1b-131af0ce059a'} {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 04:23:29.505851 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.managers [None req-74f1c27a-f71e-433b-9850-06bfa0128658 None None] Bound port: 907a9337-b889-44b2-b856-48e472d2bc38, host: dv-cinder-790910-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b84e1e85-c58b-4982-b59b-cb9584098e15', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 893, 'network_id': 'fdf92998-25fa-4179-ab1b-131af0ce059a'}}] {{(pid=91688) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 04:23:29.506249 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-74f1c27a-f71e-433b-9850-06bfa0128658 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:29.513734 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-9a6106b1-d369-4030-8139-bb68fbb31bff admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:29.518508 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec00d13b-0ba0-426b-92ee-17355c844128 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5c87697d-13d5-4b0e-b90b-a7a51dcef714,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:29.524410 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-ec00d13b-0ba0-426b-92ee-17355c844128 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:29.548807 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-ec00d13b-0ba0-426b-92ee-17355c844128 admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=2564ddda0e114e9d9a0616cd1d5847a0&name=default HTTP/1.1" status: 200  len: 2979 time: 0.6280785
May 20 04:23:29.549838 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 38860) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:23:29.568339 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-9a6106b1-d369-4030-8139-bb68fbb31bff admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:29.573790 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-bf6b4424-34ec-44a8-b3c4-99d131ba17a8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:29.585715 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-91ec9d45-2ce6-4b90-a8d1-4c313ae2eb72 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:29.618456 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf6b4424-34ec-44a8-b3c4-99d131ba17a8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=30cb25a2-27d7-41d3-9cde-f78817deb74b,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:29.640081 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-bf6b4424-34ec-44a8-b3c4-99d131ba17a8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:29.672728 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-bf6b4424-34ec-44a8-b3c4-99d131ba17a8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:29.682665 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-bf6b4424-34ec-44a8-b3c4-99d131ba17a8 admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/30cb25a2-27d7-41d3-9cde-f78817deb74b HTTP/1.1" status: 204  len: 168 time: 0.9192886
May 20 04:23:29.743405 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-03254c0c-5617-47e0-85f8-4225335c82a3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:29.758061 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.db_base_plugin_common [None req-9a6106b1-d369-4030-8139-bb68fbb31bff admin admin] Allocated IP 172.27.1.92 (aec557db-0c02-4008-8c9f-2efcd7462f90/217f4b55-4415-4d57-8b43-2ff4c8ac8e81/a73b9449-b261-4c62-b13c-b2c797730593) {{(pid=91687) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 04:23:29.785147 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-03254c0c-5617-47e0-85f8-4225335c82a3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:29.899688 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-74f1c27a-f71e-433b-9850-06bfa0128658 None None] For port 907a9337-b889-44b2-b856-48e472d2bc38, host dv-cinder-790910-4-iscsi, cleared binding levels {{(pid=91688) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 04:23:29.903689 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-03254c0c-5617-47e0-85f8-4225335c82a3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:29.911044 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-6fe20ac1-322d-46d2-b05c-8db732826bdc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:29.921366 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-74f1c27a-f71e-433b-9850-06bfa0128658 None None] For port 907a9337-b889-44b2-b856-48e472d2bc38, host dv-cinder-790910-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=907a9337-b889-44b2-b856-48e472d2bc38,segment=NetworkSegment(b84e1e85-c58b-4982-b59b-cb9584098e15),segment_id=b84e1e85-c58b-4982-b59b-cb9584098e15)] {{(pid=91688) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 04:23:29.938971 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-521b5ad4-3a0c-403a-be07-c75018668588 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:29.941256 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03254c0c-5617-47e0-85f8-4225335c82a3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5c87697d-13d5-4b0e-b90b-a7a51dcef714,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:29.944023 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-74f1c27a-f71e-433b-9850-06bfa0128658 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:29.955695 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-a7f08e44-265b-4e1a-82e1-5cc49fc7642b None None] Notify callbacks [] for port, precommit_create {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:29.956717 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-03254c0c-5617-47e0-85f8-4225335c82a3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:29.960364 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:29.969364 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-03254c0c-5617-47e0-85f8-4225335c82a3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:29.970728 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-03254c0c-5617-47e0-85f8-4225335c82a3 admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/5c87697d-13d5-4b0e-b90b-a7a51dcef714 HTTP/1.1" status: 204  len: 168 time: 0.4197593
May 20 04:23:30.051892 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-a7f08e44-265b-4e1a-82e1-5cc49fc7642b None None] Transition to ACTIVE for port object 7c96d7de-6e5c-4184-9fe2-72490748c224 will not be triggered until provisioned by entity L2. {{(pid=91688) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:23:30.078361 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-9a6106b1-d369-4030-8139-bb68fbb31bff admin admin] Notify callbacks [] for port, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:30.125615 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-9a6106b1-d369-4030-8139-bb68fbb31bff admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8782892106231', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4162192'] for port, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:30.125885 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-a7f08e44-265b-4e1a-82e1-5cc49fc7642b None None] Transition to ACTIVE for port object 7c96d7de-6e5c-4184-9fe2-72490748c224 will not be triggered until provisioned by entity DHCP. {{(pid=91688) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:23:30.146050 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-74f1c27a-f71e-433b-9850-06bfa0128658 None None] Routers {'9c2e249a-3b4f-4271-8226-b44c455943cc'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91688) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:23:30.148980 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-74f1c27a-f71e-433b-9850-06bfa0128658 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced16cf8e0>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:23:03Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['9c2e249a-3b4f-4271-8226-b44c455943cc'], 'active': True} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:23:30.160249 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-7b6806eb-2c6e-4ac4-83ec-fa177bc93335 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:30.265928 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-a7f08e44-265b-4e1a-82e1-5cc49fc7642b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8782892106231'] for port, after_create {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:30.277758 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19075ce2-40cd-40b1-bc7b-0370a9bf5412 None None] Pushing event updated for resources: {'Port': ['ID=907a9337-b889-44b2-b856-48e472d2bc38,revision_number=4']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:30.282754 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9a6106b1-d369-4030-8139-bb68fbb31bff admin admin] Network aec557db-0c02-4008-8c9f-2efcd7462f90 is already hosted by enough agents. {{(pid=91687) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:23:30.301450 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-19075ce2-40cd-40b1-bc7b-0370a9bf5412 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.341s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:30.302001 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.025s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:30.320923 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.base_scheduler [None req-9a6106b1-d369-4030-8139-bb68fbb31bff admin admin] Resources bound (agent type, host, resource id):  {{(pid=91687) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:23:30.391567 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9a6106b1-d369-4030-8139-bb68fbb31bff admin admin] Received port after_create {{(pid=91687) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 04:23:30.481956 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a6106b1-d369-4030-8139-bb68fbb31bff admin admin] Pushing event updated for resources: {'Port': ['ID=a73b9449-b261-4c62-b13c-b2c797730593,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:30.487725 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-9a6106b1-d369-4030-8139-bb68fbb31bff admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.328s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:30.590073 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a7f08e44-265b-4e1a-82e1-5cc49fc7642b None None] Network fc681196-7d83-4764-b760-89961b7ffe54 is already hosted by enough agents. {{(pid=91688) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:23:30.604554 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.scheduler.base_scheduler [None req-a7f08e44-265b-4e1a-82e1-5cc49fc7642b None None] Resources bound (agent type, host, resource id):  {{(pid=91688) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:23:30.616842 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a7f08e44-265b-4e1a-82e1-5cc49fc7642b None None] Received port after_create {{(pid=91688) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 04:23:30.629685 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c13c5f2b-1aa9-469e-952c-99ad7a58c8ec req-4243d722-e4e9-4611-8293-65152ccd0188 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:30.645537 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-c13c5f2b-1aa9-469e-952c-99ad7a58c8ec req-4243d722-e4e9-4611-8293-65152ccd0188 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.3151360
May 20 04:23:30.791733 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-c13c5f2b-1aa9-469e-952c-99ad7a58c8ec req-0f0745cc-25a0-4f25-966d-27b18ad305ba tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1446207
May 20 04:23:30.831248 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7f08e44-265b-4e1a-82e1-5cc49fc7642b None None] Pushing event updated for resources: {'Port': ['ID=7c96d7de-6e5c-4184-9fe2-72490748c224,revision_number=1']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:30.873270 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-a7f08e44-265b-4e1a-82e1-5cc49fc7642b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.571s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:30.941892 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.managers [None req-a7f08e44-265b-4e1a-82e1-5cc49fc7642b None None] Attempting to bind port 7c96d7de-6e5c-4184-9fe2-72490748c224 on host dv-cinder-790910-4-iscsi for vnic_type normal with profile  {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 04:23:30.942379 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.managers [None req-a7f08e44-265b-4e1a-82e1-5cc49fc7642b None None] Attempting to bind port 7c96d7de-6e5c-4184-9fe2-72490748c224 by drivers openvswitch,hyperv on host dv-cinder-790910-4-iscsi at level 0 using segments [{'id': 'f495c6da-d858-4d7b-a7ae-2c30d9f73111', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 894, 'network_id': 'fc681196-7d83-4764-b760-89961b7ffe54'}] {{(pid=91688) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 04:23:30.942682 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a7f08e44-265b-4e1a-82e1-5cc49fc7642b None None] Attempting to bind port 7c96d7de-6e5c-4184-9fe2-72490748c224 on network fc681196-7d83-4764-b760-89961b7ffe54 {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:23:30.951497 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvr_db [None req-74f1c27a-f71e-433b-9850-06bfa0128658 None None] Set router 9c2e249a-3b4f-4271-8226-b44c455943cc gateway port host: dv-cinder-790910-4-iscsi {{(pid=91688) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:23:31.009863 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a7f08e44-265b-4e1a-82e1-5cc49fc7642b None None] Checking agent: {'id': '333121d4-1023-4a33-a54c-f4dd052e1612', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-790910-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 4, 13, 33), 'started_at': datetime.datetime(2021, 5, 20, 4, 14, 3), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 4, 23, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-790910-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 04:23:31.011047 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a7f08e44-265b-4e1a-82e1-5cc49fc7642b None None] Checking segment: {'id': 'f495c6da-d858-4d7b-a7ae-2c30d9f73111', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 894, 'network_id': 'fc681196-7d83-4764-b760-89961b7ffe54'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91688) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:23:31.011047 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-a7f08e44-265b-4e1a-82e1-5cc49fc7642b None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:31.011455 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a7f08e44-265b-4e1a-82e1-5cc49fc7642b None None] Bound using segment: {'id': 'f495c6da-d858-4d7b-a7ae-2c30d9f73111', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 894, 'network_id': 'fc681196-7d83-4764-b760-89961b7ffe54'} {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 04:23:31.012064 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.managers [None req-a7f08e44-265b-4e1a-82e1-5cc49fc7642b None None] Bound port: 7c96d7de-6e5c-4184-9fe2-72490748c224, host: dv-cinder-790910-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f495c6da-d858-4d7b-a7ae-2c30d9f73111', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 894, 'network_id': 'fc681196-7d83-4764-b760-89961b7ffe54'}}] {{(pid=91688) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 04:23:31.012570 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-a7f08e44-265b-4e1a-82e1-5cc49fc7642b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:31.337137 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-a7f08e44-265b-4e1a-82e1-5cc49fc7642b None None] For port 7c96d7de-6e5c-4184-9fe2-72490748c224, host dv-cinder-790910-4-iscsi, cleared binding levels {{(pid=91688) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 04:23:31.352089 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-a7f08e44-265b-4e1a-82e1-5cc49fc7642b None None] For port 7c96d7de-6e5c-4184-9fe2-72490748c224, host dv-cinder-790910-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=7c96d7de-6e5c-4184-9fe2-72490748c224,segment=NetworkSegment(f495c6da-d858-4d7b-a7ae-2c30d9f73111),segment_id=f495c6da-d858-4d7b-a7ae-2c30d9f73111)] {{(pid=91688) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 04:23:31.364891 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-a7f08e44-265b-4e1a-82e1-5cc49fc7642b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:31.409267 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:31.755482 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-9a6106b1-d369-4030-8139-bb68fbb31bff admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:31.793542 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7f08e44-265b-4e1a-82e1-5cc49fc7642b None None] Pushing event updated for resources: {'Port': ['ID=7c96d7de-6e5c-4184-9fe2-72490748c224,revision_number=2']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:31.799345 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-a7f08e44-265b-4e1a-82e1-5cc49fc7642b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.392s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:31.873441 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-74f1c27a-f71e-433b-9850-06bfa0128658 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced16cf8e0>, [{'id': '9c2e249a-3b4f-4271-8226-b44c455943cc', 'name': 'tempest-TestMinimumBasicScenario-1023892954-router', 'tenant_id': 'e6fe6bea38b946a5a97ea42bf787f1b3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.213'}], 'enable_snat': True}, 'gw_port_id': 'b4b174b3-1436-4e17-8fa3-97243bad59c3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:23:14Z', 'updated_at': '2021-05-20T04:23:21Z', 'revision_number': 4, 'project_id': 'e6fe6bea38b946a5a97ea42bf787f1b3', 'gw_port': {'id': 'b4b174b3-1436-4e17-8fa3-97243bad59c3', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:4d:2f:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c2e249a-3b4f-4271-8226-b44c455943cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 330, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:23:15Z', 'updated_at': '2021-05-20T04:23:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_interfaces': [{'id': '907a9337-b889-44b2-b856-48e472d2bc38', 'name': '', 'network_id': 'fdf92998-25fa-4179-ab1b-131af0ce059a', 'tenant_id': 'e6fe6bea38b946a5a97ea42bf787f1b3', 'mac_address': 'fa:16:3e:0f:d2:47', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9c2e249a-3b4f-4271-8226-b44c455943cc', 'device_owner': 'network:router_interface', 'standard_attr_id': 333, 'fixed_ips': [{'subnet_id': 'e905ed23-00d1-4991-b3bb-e1a1e32b4c86', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:23:20Z', 'updated_at': '2021-05-20T04:23:29Z', 'revision_number': 4, 'project_id': 'e6fe6bea38b946a5a97ea42bf787f1b3', 'subnets': [{'id': 'e905ed23-00d1-4991-b3bb-e1a1e32b4c86', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:23:31.882233 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-74f1c27a-f71e-433b-9850-06bfa0128658 None None] The sync data for ids ['9c2e249a-3b4f-4271-8226-b44c455943cc'] in dv-cinder-790910-4-iscsi is: [{'id': '9c2e249a-3b4f-4271-8226-b44c455943cc', 'name': 'tempest-TestMinimumBasicScenario-1023892954-router', 'tenant_id': 'e6fe6bea38b946a5a97ea42bf787f1b3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.213'}], 'enable_snat': True}, 'gw_port_id': 'b4b174b3-1436-4e17-8fa3-97243bad59c3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:23:14Z', 'updated_at': '2021-05-20T04:23:21Z', 'revision_number': 4, 'project_id': 'e6fe6bea38b946a5a97ea42bf787f1b3', 'gw_port': {'id': 'b4b174b3-1436-4e17-8fa3-97243bad59c3', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:4d:2f:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c2e249a-3b4f-4271-8226-b44c455943cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 330, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:23:15Z', 'updated_at': '2021-05-20T04:23:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_interfaces': [{'id': '907a9337-b889-44b2-b856-48e472d2bc38', 'name': '', 'network_id': 'fdf92998-25fa-4179-ab1b-131af0ce059a', 'tenant_id': 'e6fe6bea38b946a5a97ea42bf787f1b3', 'mac_address': 'fa:16:3e:0f:d2:47', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9c2e249a-3b4f-4271-8226-b44c455943cc', 'device_owner': 'network:router_interface', 'standard_attr_id': 333, 'fixed_ips': [{'subnet_id': 'e905ed23-00d1-4991-b3bb-e1a1e32b4c86', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:23:20Z', 'updated_at': '2021-05-20T04:23:29Z', 'revision_number': 4, 'project_id': 'e6fe6bea38b946a5a97ea42bf787f1b3', 'subnets': [{'id': 'e905ed23-00d1-4991-b3bb-e1a1e32b4c86', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91688) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 04:23:32.448145 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbd4df14-263c-4e89-a7f9-027eeac87283 req-4496f88a-3fff-42d8-a78c-588bc609d37f tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:32.474255 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-dbd4df14-263c-4e89-a7f9-027eeac87283 req-4496f88a-3fff-42d8-a78c-588bc609d37f tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.3173184
May 20 04:23:32.564547 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:32.676430 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-dbd4df14-263c-4e89-a7f9-027eeac87283 req-144dfbd5-896b-4ebc-bcf0-f889e7275d5b tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1996739
May 20 04:23:32.721339 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-aed1577a-374b-44f8-b71c-9a4d0cd447c3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:33.064654 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbadb40b-47b6-44ec-8ad5-f94f9e377b10 req-e9ec20c6-6638-4a71-937c-e9e6c86234f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:33.066218 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-cbadb40b-47b6-44ec-8ad5-f94f9e377b10 req-e9ec20c6-6638-4a71-937c-e9e6c86234f9 service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=b7d86d894a5f420e86f4c28d7772bd22&device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 1098 time: 0.8474314
May 20 04:23:33.084436 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-9a6106b1-d369-4030-8139-bb68fbb31bff admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1796474', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1714058'] for router, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:33.335172 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ea4803bd-878f-47d5-9084-1ec41953c9db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:33.677344 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:33.820670 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73bdb546-374b-40a8-ad3d-dfccf98ac0f0 req-fd50796b-cace-4d77-9a86-07161cd08f88 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:33.828733 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-73bdb546-374b-40a8-ad3d-dfccf98ac0f0 req-fd50796b-cace-4d77-9a86-07161cd08f88 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/networks?id=20ab5e30-591a-443a-9e34-f3a1b7563f5d HTTP/1.1" status: 200  len: 815 time: 0.4289589
May 20 04:23:33.868327 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-73bdb546-374b-40a8-ad3d-dfccf98ac0f0 req-1d1430de-7bf3-4283-be66-1f70d755e8d0 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/quotas/6484c55ce8204dc3802efc929a51c4a5 HTTP/1.1" status: 200  len: 375 time: 0.0383999
May 20 04:23:34.097374 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5a49f526-d886-4002-9bb6-9ad2a47086e8 None None] Network fc681196-7d83-4764-b760-89961b7ffe54 requested from dv-cinder-790910-4-iscsi {{(pid=91688) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 04:23:34.167275 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbadb40b-47b6-44ec-8ad5-f94f9e377b10 req-b5297444-be73-4443-873f-6069b9b32406 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:34.169595 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-cbadb40b-47b6-44ec-8ad5-f94f9e377b10 req-b5297444-be73-4443-873f-6069b9b32406 service neutron] 10.222.0.82 "GET /v2.0/networks?id=348b2b0f-c826-45ab-ba85-8430235b9cac HTTP/1.1" status: 200  len: 920 time: 0.9203095
May 20 04:23:34.179015 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-73bdb546-374b-40a8-ad3d-dfccf98ac0f0 req-8634a2ac-7d52-45bd-b6bf-ca24d779cfbe tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?tenant_id=6484c55ce8204dc3802efc929a51c4a5&fields=id HTTP/1.1" status: 200  len: 255 time: 0.3090255
May 20 04:23:34.317431 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 7c96d7de-6e5c-4184-9fe2-72490748c224 up at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:23:34.337514 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-cbadb40b-47b6-44ec-8ad5-f94f9e377b10 req-b6905d95-3fb9-46d9-be42-f1e6df624f05 service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=65d523e1-f132-4819-aa42-995ded4a1ad8 HTTP/1.1" status: 200  len: 217 time: 0.1565020
May 20 04:23:34.348591 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9a6106b1-d369-4030-8139-bb68fbb31bff admin admin] Router 516c54ae-e378-44de-a7bf-14b9bb646228 is scheduled to L3 agent 02733fc0-fc9c-4e29-bc03-c27a792d539d with binding_index 1 {{(pid=91687) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 20 04:23:34.483321 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-b5c0b6c6-74e7-4605-8c67-0135368fecd7 None None] Provisioning for port 7c96d7de-6e5c-4184-9fe2-72490748c224 completed by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:23:34.582547 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning for port 7c96d7de-6e5c-4184-9fe2-72490748c224 completed by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:23:34.689611 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning complete for port 7c96d7de-6e5c-4184-9fe2-72490748c224 triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:23:34.690325 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:34.796147 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-73bdb546-374b-40a8-ad3d-dfccf98ac0f0 req-0b9cb07c-b290-4f2c-ba6b-cf5587e784d0 service neutron] 10.222.0.71 "GET /v2.0/networks/20ab5e30-591a-443a-9e34-f3a1b7563f5d?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.6091821
May 20 04:23:34.832725 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f24a578-8545-4350-b102-27aa24e2ded4 req-17ffde97-0e5e-490c-addf-c7dfef1887d7 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:34.840361 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-2f24a578-8545-4350-b102-27aa24e2ded4 req-17ffde97-0e5e-490c-addf-c7dfef1887d7 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.7562904
May 20 04:23:34.857331 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbadb40b-47b6-44ec-8ad5-f94f9e377b10 req-6e363707-e14d-42a1-ab49-a36bf1457567 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:34.859755 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-cbadb40b-47b6-44ec-8ad5-f94f9e377b10 req-6e363707-e14d-42a1-ab49-a36bf1457567 service neutron] 10.222.0.82 "GET /v2.0/subnets?id=b488dc7d-0e70-4e52-9179-7e6c3e4fb0a1 HTTP/1.1" status: 200  len: 859 time: 0.4858046
May 20 04:23:34.939178 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-cbadb40b-47b6-44ec-8ad5-f94f9e377b10 req-81aefecd-ebae-4cfd-af3d-cc5af7bf5eb0 service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=348b2b0f-c826-45ab-ba85-8430235b9cac&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0721481
May 20 04:23:35.003039 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:35.096909 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] For port 7c96d7de-6e5c-4184-9fe2-72490748c224, host dv-cinder-790910-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=7c96d7de-6e5c-4184-9fe2-72490748c224,segment=NetworkSegment(f495c6da-d858-4d7b-a7ae-2c30d9f73111),segment_id=f495c6da-d858-4d7b-a7ae-2c30d9f73111)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:23:35.106147 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:35.111162 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 907a9337-b889-44b2-b856-48e472d2bc38 up at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:23:35.213715 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-2f24a578-8545-4350-b102-27aa24e2ded4 req-01262e76-f319-4517-9ef1-5560a82902d4 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3679378
May 20 04:23:35.292246 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-73bdb546-374b-40a8-ad3d-dfccf98ac0f0 req-11c445e7-1345-4e90-a06a-b474b420f81a service neutron] 10.222.0.71 "GET /v2.0/networks/20ab5e30-591a-443a-9e34-f3a1b7563f5d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4845362
May 20 04:23:35.338706 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:35.378431 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9a6106b1-d369-4030-8139-bb68fbb31bff admin admin] Notify agent at l3_agent.dv-cinder-790910-4-iscsi the message routers_updated {{(pid=91687) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 04:23:35.389927 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c8deeba5-06d0-4801-9909-b46129db6cab None None] Sync routers for ids ['516c54ae-e378-44de-a7bf-14b9bb646228'] in dv-cinder-790910-4-iscsi {{(pid=91689) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 04:23:35.407624 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c8deeba5-06d0-4801-9909-b46129db6cab None None] Routers {'516c54ae-e378-44de-a7bf-14b9bb646228'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91689) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:23:35.409527 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-c8deeba5-06d0-4801-9909-b46129db6cab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced18e1850>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:23:33Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['516c54ae-e378-44de-a7bf-14b9bb646228'], 'active': True} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:23:35.455908 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac275768-fd4e-406a-a650-bb4e786b1c43 req-81a58c51-d0a1-4942-8775-9c1c15fb3377 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:35.461486 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-ac275768-fd4e-406a-a650-bb4e786b1c43 req-81a58c51-d0a1-4942-8775-9c1c15fb3377 service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 1098 time: 0.9141014
May 20 04:23:35.561964 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning for port 907a9337-b889-44b2-b856-48e472d2bc38 completed by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:23:35.603507 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning complete for port 907a9337-b889-44b2-b856-48e472d2bc38 triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:23:35.604439 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:35.679080 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-9a6106b1-d369-4030-8139-bb68fbb31bff admin admin] Notify callbacks [] for router, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:35.683216 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 39050) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:23:35.688115 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-9a6106b1-d369-4030-8139-bb68fbb31bff admin admin] 10.222.0.71 "POST /v2.0/routers HTTP/1.1" status: 201  len: 925 time: 7.7883615
May 20 04:23:35.792051 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f21320cc-6a25-4ec1-8a32-8b119b35fd55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:35.811653 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-cbadb40b-47b6-44ec-8ad5-f94f9e377b10 req-04483e4a-d553-48c3-aed6-49de2155f250 service neutron] 10.222.0.82 "GET /v2.0/networks/348b2b0f-c826-45ab-ba85-8430235b9cac?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.7792435
May 20 04:23:35.829210 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-ac275768-fd4e-406a-a650-bb4e786b1c43 req-3257a701-b8a3-4d56-b7c3-a858d95ff802 service neutron] 10.222.0.82 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3229868
May 20 04:23:35.844484 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-c5a76de8-ef8d-41a9-8abe-21f7436a6b9c req-30be43bf-4b03-475a-850a-0a5eda07beeb tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=07157b0a-98fc-4f60-bd6f-f1fd5c17dbfa HTTP/1.1" status: 200  len: 210 time: 0.1500185
May 20 04:23:35.913374 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Pushing event updated for resources: {'Port': ['ID=7c96d7de-6e5c-4184-9fe2-72490748c224,revision_number=3']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:35.925263 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-a69b3b03-3652-463c-a172-c8f9afeec5f2 None None] Provisioning complete for port 7c96d7de-6e5c-4184-9fe2-72490748c224 triggered by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:23:35.926112 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-a69b3b03-3652-463c-a172-c8f9afeec5f2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:35.960063 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.621s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:35.981776 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvr_db [None req-c8deeba5-06d0-4801-9909-b46129db6cab None None] Set router 516c54ae-e378-44de-a7bf-14b9bb646228 gateway port host: dv-cinder-790910-4-iscsi {{(pid=91689) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:23:36.332723 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-cbadb40b-47b6-44ec-8ad5-f94f9e377b10 req-1b5d2152-b50b-4ea9-b4b8-840c41f50257 service neutron] 10.222.0.82 "GET /v2.0/networks/348b2b0f-c826-45ab-ba85-8430235b9cac?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4974761
May 20 04:23:36.377608 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:36.490863 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] For port 907a9337-b889-44b2-b856-48e472d2bc38, host dv-cinder-790910-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=907a9337-b889-44b2-b856-48e472d2bc38,segment=NetworkSegment(b84e1e85-c58b-4982-b59b-cb9584098e15),segment_id=b84e1e85-c58b-4982-b59b-cb9584098e15)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:23:36.517920 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:36.523669 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:36.784779 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 7c96d7de-6e5c-4184-9fe2-72490748c224 up at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:23:36.994959 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-c8deeba5-06d0-4801-9909-b46129db6cab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced18e1850>, [{'id': '516c54ae-e378-44de-a7bf-14b9bb646228', 'name': 'tempest-TestMinimumBasicScenario-943774282-router', 'tenant_id': 'a588c51341504beda6a1803a15cc919c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.92'}], 'enable_snat': True}, 'gw_port_id': 'a73b9449-b261-4c62-b13c-b2c797730593', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:23:27Z', 'updated_at': '2021-05-20T04:23:31Z', 'revision_number': 3, 'project_id': 'a588c51341504beda6a1803a15cc919c', 'gw_port': {'id': 'a73b9449-b261-4c62-b13c-b2c797730593', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:bb:ad:48', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '516c54ae-e378-44de-a7bf-14b9bb646228', 'device_owner': 'network:router_gateway', 'standard_attr_id': 362, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.92', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:23:29Z', 'updated_at': '2021-05-20T04:23:29Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi'}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:23:37.007653 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c8deeba5-06d0-4801-9909-b46129db6cab None None] Checking router: 516c54ae-e378-44de-a7bf-14b9bb646228 for host: dv-cinder-790910-4-iscsi {{(pid=91689) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 04:23:37.008158 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c8deeba5-06d0-4801-9909-b46129db6cab None None] Updating router 516c54ae-e378-44de-a7bf-14b9bb646228 port a73b9449-b261-4c62-b13c-b2c797730593 binding host dv-cinder-790910-4-iscsi {{(pid=91689) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 20 04:23:37.131529 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c2d1f83-5610-4556-afca-3004fbfef13e req-329d5426-466a-4265-b326-957a1d33f91c tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:37.142234 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-5c2d1f83-5610-4556-afca-3004fbfef13e req-329d5426-466a-4265-b326-957a1d33f91c tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.6156325
May 20 04:23:37.152006 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron_lib.callbacks.manager [None req-c8deeba5-06d0-4801-9909-b46129db6cab None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:37.152871 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Pushing event updated for resources: {'Port': ['ID=907a9337-b889-44b2-b856-48e472d2bc38,revision_number=5']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:37.165472 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.640s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:37.214542 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-68873b2f-7c2f-4dec-a154-2cbed222ae58 req-3cfd9cfa-fbd4-427b-b205-b884de83c19a tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=07157b0a-98fc-4f60-bd6f-f1fd5c17dbfa HTTP/1.1" status: 200  len: 210 time: 0.1431375
May 20 04:23:37.219877 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning complete for port 7c96d7de-6e5c-4184-9fe2-72490748c224 triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:23:37.220563 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:37.330045 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-5c2d1f83-5610-4556-afca-3004fbfef13e req-56b97054-3f21-4492-ba96-9a2e4cb0ceaf tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1844838
May 20 04:23:37.993149 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron_lib.callbacks.manager [None req-c8deeba5-06d0-4801-9909-b46129db6cab None None] Notify callbacks [] for port, precommit_update {{(pid=91689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:38.048212 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.provisioning_blocks [None req-c8deeba5-06d0-4801-9909-b46129db6cab None None] Transition to ACTIVE for port object a73b9449-b261-4c62-b13c-b2c797730593 will not be triggered until provisioned by entity L2. {{(pid=91689) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:23:38.065956 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron_lib.callbacks.manager [None req-c8deeba5-06d0-4801-9909-b46129db6cab None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:38.081686 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG oslo_concurrency.lockutils [None req-d3f2dc05-eeae-48f7-a3e4-de7be39120f3 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:38.096854 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-f28047f7-f002-47de-b08e-30c9d2c39970 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:38.321264 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.managers [None req-c8deeba5-06d0-4801-9909-b46129db6cab None None] Attempting to bind port a73b9449-b261-4c62-b13c-b2c797730593 on host dv-cinder-790910-4-iscsi for vnic_type normal with profile  {{(pid=91689) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 04:23:38.321914 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.managers [None req-c8deeba5-06d0-4801-9909-b46129db6cab None None] Attempting to bind port a73b9449-b261-4c62-b13c-b2c797730593 by drivers openvswitch,hyperv on host dv-cinder-790910-4-iscsi at level 0 using segments [{'id': '8df49ec5-3fb9-4715-bc9a-f4019a6b55f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90'}] {{(pid=91689) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 04:23:38.322499 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c8deeba5-06d0-4801-9909-b46129db6cab None None] Attempting to bind port a73b9449-b261-4c62-b13c-b2c797730593 on network aec557db-0c02-4008-8c9f-2efcd7462f90 {{(pid=91689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:23:38.355221 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c8deeba5-06d0-4801-9909-b46129db6cab None None] Checking agent: {'id': '333121d4-1023-4a33-a54c-f4dd052e1612', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-790910-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 4, 13, 33), 'started_at': datetime.datetime(2021, 5, 20, 4, 14, 3), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 4, 23, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-790910-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 04:23:38.365668 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c8deeba5-06d0-4801-9909-b46129db6cab None None] Checking segment: {'id': '8df49ec5-3fb9-4715-bc9a-f4019a6b55f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91689) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:23:38.366974 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron_lib.callbacks.manager [None req-c8deeba5-06d0-4801-9909-b46129db6cab None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:38.367803 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c8deeba5-06d0-4801-9909-b46129db6cab None None] Bound using segment: {'id': '8df49ec5-3fb9-4715-bc9a-f4019a6b55f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90'} {{(pid=91689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 04:23:38.370410 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.managers [None req-c8deeba5-06d0-4801-9909-b46129db6cab None None] Bound port: a73b9449-b261-4c62-b13c-b2c797730593, host: dv-cinder-790910-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8df49ec5-3fb9-4715-bc9a-f4019a6b55f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90'}}] {{(pid=91689) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 04:23:38.372219 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron_lib.callbacks.manager [None req-c8deeba5-06d0-4801-9909-b46129db6cab None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:38.533157 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d959e1a6-bb4b-4c54-b542-bf60e2ca2268 None None] Pushing event updated for resources: {'Port': ['ID=a73b9449-b261-4c62-b13c-b2c797730593,revision_number=2']} {{(pid=91689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:38.550010 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG oslo_concurrency.lockutils [None req-d959e1a6-bb4b-4c54-b542-bf60e2ca2268 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.468s {{(pid=91689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:38.752545 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.db [None req-c8deeba5-06d0-4801-9909-b46129db6cab None None] For port a73b9449-b261-4c62-b13c-b2c797730593, host dv-cinder-790910-4-iscsi, cleared binding levels {{(pid=91689) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 04:23:38.767829 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.db [None req-c8deeba5-06d0-4801-9909-b46129db6cab None None] For port a73b9449-b261-4c62-b13c-b2c797730593, host dv-cinder-790910-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=a73b9449-b261-4c62-b13c-b2c797730593,segment=NetworkSegment(8df49ec5-3fb9-4715-bc9a-f4019a6b55f9),segment_id=8df49ec5-3fb9-4715-bc9a-f4019a6b55f9)] {{(pid=91689) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 04:23:38.785097 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron_lib.callbacks.manager [None req-c8deeba5-06d0-4801-9909-b46129db6cab None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:38.790298 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:38.804402 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-52e2058f-76ad-4ed6-adb2-44ce7c163585 req-e9daf83e-8ca4-415d-96ae-85dbb19ceba5 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=07157b0a-98fc-4f60-bd6f-f1fd5c17dbfa HTTP/1.1" status: 200  len: 210 time: 0.1943004
May 20 04:23:38.821583 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c079b25d-bad7-40a7-8152-83bb37096b10 req-135766b2-1bec-47c8-a727-accd4ddad28c tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:38.833424 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-c079b25d-bad7-40a7-8152-83bb37096b10 req-135766b2-1bec-47c8-a727-accd4ddad28c tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.1920550
May 20 04:23:38.836873 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 907a9337-b889-44b2-b856-48e472d2bc38 up at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:23:38.883599 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.db_base_plugin_common [None req-f28047f7-f002-47de-b08e-30c9d2c39970 admin admin] Allocated IP 172.20.0.1 (fc681196-7d83-4764-b760-89961b7ffe54/a34998b9-6684-4ced-a2bb-9b229ae96845/1a9566c0-910b-4abb-b1c3-865c2789dc16) {{(pid=91686) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 04:23:38.977686 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-c079b25d-bad7-40a7-8152-83bb37096b10 req-f462076d-8f21-44c9-9b4b-b74d47eaac76 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1277690
May 20 04:23:38.993483 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning complete for port 907a9337-b889-44b2-b856-48e472d2bc38 triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:23:38.993696 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:39.020052 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 39124) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:23:39.030561 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d959e1a6-bb4b-4c54-b542-bf60e2ca2268 None None] Pushing event updated for resources: {'Port': ['ID=a73b9449-b261-4c62-b13c-b2c797730593,revision_number=3']} {{(pid=91689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:39.099074 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c8deeba5-06d0-4801-9909-b46129db6cab None None] Routers {'516c54ae-e378-44de-a7bf-14b9bb646228'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91689) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:23:39.099802 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-c8deeba5-06d0-4801-9909-b46129db6cab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced18e1850>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:23:33Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['516c54ae-e378-44de-a7bf-14b9bb646228'], 'active': True} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:23:39.198347 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG oslo_concurrency.lockutils [None req-d959e1a6-bb4b-4c54-b542-bf60e2ca2268 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.408s {{(pid=91689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:39.263292 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.db_base_plugin_v2 [None req-b1ef2d4c-e8b3-4cd8-a419-16891c391909 admin admin] Deleting subnet e5bf6e02-06bc-4842-ba8e-1bdd1c661e53 {{(pid=91687) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 20 04:23:39.271798 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-b1ef2d4c-e8b3-4cd8-a419-16891c391909 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:39.308201 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-f28047f7-f002-47de-b08e-30c9d2c39970 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:39.349510 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.provisioning_blocks [None req-f28047f7-f002-47de-b08e-30c9d2c39970 admin admin] Transition to ACTIVE for port object 1a9566c0-910b-4abb-b1c3-865c2789dc16 will not be triggered until provisioned by entity DHCP. {{(pid=91686) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:23:39.397401 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-f28047f7-f002-47de-b08e-30c9d2c39970 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8782892106231', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2145052'] for port, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:39.405157 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-9e95cf86-6b6b-4903-bd41-b6946cacf5a5 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:39.494701 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvr_db [None req-c8deeba5-06d0-4801-9909-b46129db6cab None None] Set router 516c54ae-e378-44de-a7bf-14b9bb646228 gateway port host: dv-cinder-790910-4-iscsi {{(pid=91689) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:23:39.567204 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-b1ef2d4c-e8b3-4cd8-a419-16891c391909 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-936634'] for subnet, precommit_delete_associations {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:39.626552 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f28047f7-f002-47de-b08e-30c9d2c39970 admin admin] Network fc681196-7d83-4764-b760-89961b7ffe54 is already hosted by enough agents. {{(pid=91686) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:23:39.660715 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.base_scheduler [None req-f28047f7-f002-47de-b08e-30c9d2c39970 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91686) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:23:39.678489 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f28047f7-f002-47de-b08e-30c9d2c39970 admin admin] Pushing event updated for resources: {'Port': ['ID=1a9566c0-910b-4abb-b1c3-865c2789dc16,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:39.679748 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-b1ef2d4c-e8b3-4cd8-a419-16891c391909 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1504133'] for subnet, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:39.693559 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f28047f7-f002-47de-b08e-30c9d2c39970 admin admin] Received port after_create {{(pid=91686) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 04:23:39.803228 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-f28047f7-f002-47de-b08e-30c9d2c39970 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.398s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:39.928623 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-f28047f7-f002-47de-b08e-30c9d2c39970 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1716281'] for router_interface, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:40.119347 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-c8deeba5-06d0-4801-9909-b46129db6cab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced18e1850>, [{'id': '516c54ae-e378-44de-a7bf-14b9bb646228', 'name': 'tempest-TestMinimumBasicScenario-943774282-router', 'tenant_id': 'a588c51341504beda6a1803a15cc919c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.92'}], 'enable_snat': True}, 'gw_port_id': 'a73b9449-b261-4c62-b13c-b2c797730593', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:23:27Z', 'updated_at': '2021-05-20T04:23:31Z', 'revision_number': 3, 'project_id': 'a588c51341504beda6a1803a15cc919c', 'gw_port': {'id': 'a73b9449-b261-4c62-b13c-b2c797730593', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:bb:ad:48', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '516c54ae-e378-44de-a7bf-14b9bb646228', 'device_owner': 'network:router_gateway', 'standard_attr_id': 362, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.92', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:23:29Z', 'updated_at': '2021-05-20T04:23:38Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi'}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:23:40.132362 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c8deeba5-06d0-4801-9909-b46129db6cab None None] The sync data for ids ['516c54ae-e378-44de-a7bf-14b9bb646228'] in dv-cinder-790910-4-iscsi is: [{'id': '516c54ae-e378-44de-a7bf-14b9bb646228', 'name': 'tempest-TestMinimumBasicScenario-943774282-router', 'tenant_id': 'a588c51341504beda6a1803a15cc919c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.92'}], 'enable_snat': True}, 'gw_port_id': 'a73b9449-b261-4c62-b13c-b2c797730593', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:23:27Z', 'updated_at': '2021-05-20T04:23:31Z', 'revision_number': 3, 'project_id': 'a588c51341504beda6a1803a15cc919c', 'gw_port': {'id': 'a73b9449-b261-4c62-b13c-b2c797730593', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:bb:ad:48', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '516c54ae-e378-44de-a7bf-14b9bb646228', 'device_owner': 'network:router_gateway', 'standard_attr_id': 362, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.92', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:23:29Z', 'updated_at': '2021-05-20T04:23:38Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi'}] {{(pid=91689) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 04:23:40.241710 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-2603e141-e6f8-495f-9d39-2fed3d9a8aff None None] Provisioning for port 1a9566c0-910b-4abb-b1c3-865c2789dc16 completed by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:23:40.254533 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-2603e141-e6f8-495f-9d39-2fed3d9a8aff None None] Provisioning complete for port 1a9566c0-910b-4abb-b1c3-865c2789dc16 triggered by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:23:40.255520 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-2603e141-e6f8-495f-9d39-2fed3d9a8aff None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:40.346339 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-86a2ccff-513d-4bff-8bc6-4e6fd6558def req-bc9ebd94-0901-4a1d-9171-abe470a87e5a tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=07157b0a-98fc-4f60-bd6f-f1fd5c17dbfa HTTP/1.1" status: 200  len: 210 time: 0.0804012
May 20 04:23:40.407666 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73bdb546-374b-40a8-ad3d-dfccf98ac0f0 req-e0e2a4f8-86c2-4b59-8935-e1b45a1eff89 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:40.409511 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-73bdb546-374b-40a8-ad3d-dfccf98ac0f0 req-e0e2a4f8-86c2-4b59-8935-e1b45a1eff89 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.82 "GET /v2.0/networks?id=20ab5e30-591a-443a-9e34-f3a1b7563f5d HTTP/1.1" status: 200  len: 815 time: 1.2502866
May 20 04:23:40.442281 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [req-73bdb546-374b-40a8-ad3d-dfccf98ac0f0 req-42cd291f-943f-49c0-9eb1-9bdc08033972 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Request body: {'port': {'device_id': '07157b0a-98fc-4f60-bd6f-f1fd5c17dbfa', 'network_id': '20ab5e30-591a-443a-9e34-f3a1b7563f5d', 'admin_state_up': True, 'tenant_id': '6484c55ce8204dc3802efc929a51c4a5'}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:23:40.477619 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-2603e141-e6f8-495f-9d39-2fed3d9a8aff None None] Port 1a9566c0-910b-4abb-b1c3-865c2789dc16 cannot update to ACTIVE because it is not bound. {{(pid=91688) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 20 04:23:40.532625 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-f28047f7-f002-47de-b08e-30c9d2c39970 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:40.615399 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-b1ef2d4c-e8b3-4cd8-a419-16891c391909 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1504178', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-255887', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-4160847', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-692244'] for subnet, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:40.681951 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:40.877618 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-b1ef2d4c-e8b3-4cd8-a419-16891c391909 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for subnet, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:40.895991 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1ef2d4c-e8b3-4cd8-a419-16891c391909 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=e5bf6e02-06bc-4842-ba8e-1bdd1c661e53,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:40.902357 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-b1ef2d4c-e8b3-4cd8-a419-16891c391909 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.221s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:40.906339 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-b1ef2d4c-e8b3-4cd8-a419-16891c391909 admin admin] 10.222.0.71 "DELETE /v2.0/subnets/e5bf6e02-06bc-4842-ba8e-1bdd1c661e53 HTTP/1.1" status: 204  len: 168 time: 1.8822889
May 20 04:23:40.909987 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 39162) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:23:40.973798 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-f28047f7-f002-47de-b08e-30c9d2c39970 admin admin] Notify callbacks [] for port, precommit_update {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:40.980397 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-f28047f7-f002-47de-b08e-30c9d2c39970 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2145029'] for port, after_update {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:40.994614 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb36c3aa-91f3-46e1-9b6a-c242efec3e0d req-d764de8f-ea00-4442-b8f1-e4d465c2a100 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:41.002866 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-cb36c3aa-91f3-46e1-9b6a-c242efec3e0d req-d764de8f-ea00-4442-b8f1-e4d465c2a100 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.7268193
May 20 04:23:41.046046 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7934a142-c9a8-487a-846e-6383216cfa79 req-51a4de46-4858-4ab6-8af1-f91e1626657b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:41.047826 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-7934a142-c9a8-487a-846e-6383216cfa79 req-51a4de46-4858-4ab6-8af1-f91e1626657b service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=b7d86d894a5f420e86f4c28d7772bd22&device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 1098 time: 0.7764196
May 20 04:23:41.066254 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:41.306153 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f28047f7-f002-47de-b08e-30c9d2c39970 admin admin] Pushing event updated for resources: {'Port': ['ID=1a9566c0-910b-4abb-b1c3-865c2789dc16,revision_number=2']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:41.308172 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7934a142-c9a8-487a-846e-6383216cfa79 req-3cd52cea-1316-4e50-9b63-59f3f9ccd93c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:41.310158 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-7934a142-c9a8-487a-846e-6383216cfa79 req-3cd52cea-1316-4e50-9b63-59f3f9ccd93c service neutron] 10.222.0.82 "GET /v2.0/networks?id=348b2b0f-c826-45ab-ba85-8430235b9cac HTTP/1.1" status: 200  len: 920 time: 0.1798553
May 20 04:23:41.320572 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-f28047f7-f002-47de-b08e-30c9d2c39970 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.254s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:41.322373 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-f28047f7-f002-47de-b08e-30c9d2c39970 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1781412', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1716318'] for router_interface, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:41.411772 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-cb36c3aa-91f3-46e1-9b6a-c242efec3e0d req-363d14f5-abf1-4928-83bb-45187805b7ee tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.4074812
May 20 04:23:41.427535 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [req-73bdb546-374b-40a8-ad3d-dfccf98ac0f0 req-42cd291f-943f-49c0-9eb1-9bdc08033972 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:23:41.440918 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [req-73bdb546-374b-40a8-ad3d-dfccf98ac0f0 req-42cd291f-943f-49c0-9eb1-9bdc08033972 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:23:41.453814 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-d7f746a0-2bc6-47f7-a8cb-e1ed4558d150 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-593149'] for network, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:41.457120 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-7934a142-c9a8-487a-846e-6383216cfa79 req-6279b898-6ff2-47e8-8846-360d6de97abf service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=65d523e1-f132-4819-aa42-995ded4a1ad8 HTTP/1.1" status: 200  len: 217 time: 0.1302741
May 20 04:23:41.459643 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-73bdb546-374b-40a8-ad3d-dfccf98ac0f0 req-42cd291f-943f-49c0-9eb1-9bdc08033972 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Made reservation on behalf of 6484c55ce8204dc3802efc929a51c4a5 for: {'port': 1} {{(pid=91687) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 04:23:41.464597 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-73bdb546-374b-40a8-ad3d-dfccf98ac0f0 req-42cd291f-943f-49c0-9eb1-9bdc08033972 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:41.693843 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-115cfc02-be9a-465f-9797-94ea6b52c508 req-6157a0c6-f01e-4176-bf68-1e4db666d8bc tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=07157b0a-98fc-4f60-bd6f-f1fd5c17dbfa HTTP/1.1" status: 200  len: 210 time: 0.1162183
May 20 04:23:41.704483 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7934a142-c9a8-487a-846e-6383216cfa79 req-ce47090a-a78f-468f-98f0-23b78fc5b730 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:41.706035 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-7934a142-c9a8-487a-846e-6383216cfa79 req-ce47090a-a78f-468f-98f0-23b78fc5b730 service neutron] 10.222.0.82 "GET /v2.0/subnets?id=b488dc7d-0e70-4e52-9179-7e6c3e4fb0a1 HTTP/1.1" status: 200  len: 859 time: 0.2265785
May 20 04:23:41.757958 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f28047f7-f002-47de-b08e-30c9d2c39970 admin admin] Network fc681196-7d83-4764-b760-89961b7ffe54 is already hosted by enough agents. {{(pid=91686) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:23:41.759659 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.base_scheduler [None req-f28047f7-f002-47de-b08e-30c9d2c39970 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91686) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:23:41.854123 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-d7f746a0-2bc6-47f7-a8cb-e1ed4558d150 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1505550', 'neutron.services.segments.db._delete_segments_for_network-8782892550274'] for network, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:41.863628 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-7934a142-c9a8-487a-846e-6383216cfa79 req-6066ab9d-a5ee-4835-8401-1fcb7a278ff8 service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=348b2b0f-c826-45ab-ba85-8430235b9cac&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1467335
May 20 04:23:41.878376 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.services.segments.db [None req-d7f746a0-2bc6-47f7-a8cb-e1ed4558d150 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fced0d5ac40>,) {'filters': {'network_id': ['bcfef78b-d50f-4b70-a8f4-439d5e27267a']}} {{(pid=91687) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:23:41.949735 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.services.segments.db [None req-d7f746a0-2bc6-47f7-a8cb-e1ed4558d150 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fced0d5ac40>, 'f8bf9c6a-2558-4b0d-b485-baae4b399c00') {'for_net_delete': True} {{(pid=91687) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:23:41.950036 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.services.segments.db [None req-d7f746a0-2bc6-47f7-a8cb-e1ed4558d150 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fced0d5ac40>, 'f8bf9c6a-2558-4b0d-b485-baae4b399c00') {} {{(pid=91687) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:23:42.025962 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-d7f746a0-2bc6-47f7-a8cb-e1ed4558d150 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8782892560523', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-936621'] for segment, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:42.057838 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.db_base_plugin_common [req-73bdb546-374b-40a8-ad3d-dfccf98ac0f0 req-42cd291f-943f-49c0-9eb1-9bdc08033972 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Allocated IP 172.20.0.9 (20ab5e30-591a-443a-9e34-f3a1b7563f5d/2a9c681d-a9be-4897-91bb-31aeb6432254/c84df5e2-cd07-4d01-87c9-ec3a35e2ad93) {{(pid=91687) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 04:23:42.071683 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-d7f746a0-2bc6-47f7-a8cb-e1ed4558d150 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1501910'] for segment, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:42.073553 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f28047f7-f002-47de-b08e-30c9d2c39970 admin admin] Router 516c54ae-e378-44de-a7bf-14b9bb646228 has already been hosted by L3 agent 02733fc0-fc9c-4e29-bc03-c27a792d539d {{(pid=91686) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 04:23:42.086312 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d7f746a0-2bc6-47f7-a8cb-e1ed4558d150 admin admin] Releasing vlan 863 on physical network physnet1 to pool {{(pid=91687) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 20 04:23:42.086863 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-d7f746a0-2bc6-47f7-a8cb-e1ed4558d150 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1501910', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-4162285'] for segment, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:42.102145 dv-cinder-790910-4-iscsi neutron-server[91687]: Traceback (most recent call last):
May 20 04:23:42.102145 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 20 04:23:42.102145 dv-cinder-790910-4-iscsi neutron-server[91687]:     timer()
May 20 04:23:42.102145 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 20 04:23:42.102145 dv-cinder-790910-4-iscsi neutron-server[91687]:     cb(*args, **kw)
May 20 04:23:42.102145 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 20 04:23:42.102145 dv-cinder-790910-4-iscsi neutron-server[91687]:     return func(*args, **kwargs)
May 20 04:23:42.102145 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 20 04:23:42.102145 dv-cinder-790910-4-iscsi neutron-server[91687]:     self._notify()
May 20 04:23:42.102145 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 20 04:23:42.102145 dv-cinder-790910-4-iscsi neutron-server[91687]:     self.callback(batched_events)
May 20 04:23:42.102145 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 20 04:23:42.102145 dv-cinder-790910-4-iscsi neutron-server[91687]:     event.method(event)
May 20 04:23:42.102145 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 20 04:23:42.102145 dv-cinder-790910-4-iscsi neutron-server[91687]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 20 04:23:42.102145 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 20 04:23:42.102145 dv-cinder-790910-4-iscsi neutron-server[91687]:     aggregate_uuid = self.p_client.list_aggregates(
May 20 04:23:42.102145 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 20 04:23:42.102145 dv-cinder-790910-4-iscsi neutron-server[91687]:     return f(self, *a, **k)
May 20 04:23:42.102145 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 20 04:23:42.102145 dv-cinder-790910-4-iscsi neutron-server[91687]:     return self._get(url).json()
May 20 04:23:42.102145 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 20 04:23:42.102145 dv-cinder-790910-4-iscsi neutron-server[91687]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 20 04:23:42.102145 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 20 04:23:42.102145 dv-cinder-790910-4-iscsi neutron-server[91687]:     return self.request(url, 'GET', **kwargs)
May 20 04:23:42.102145 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 20 04:23:42.102145 dv-cinder-790910-4-iscsi neutron-server[91687]:     base_url = self.get_endpoint(auth, allow=allow,
May 20 04:23:42.102145 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 20 04:23:42.102145 dv-cinder-790910-4-iscsi neutron-server[91687]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 20 04:23:42.102145 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 20 04:23:42.102145 dv-cinder-790910-4-iscsi neutron-server[91687]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 20 04:23:42.102145 dv-cinder-790910-4-iscsi neutron-server[91687]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 20 04:23:42.135270 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-37902a5d-ec0b-48a4-aec4-fc66336f9b05 None None] Provisioning complete for port 1a9566c0-910b-4abb-b1c3-865c2789dc16 triggered by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:23:42.137154 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-37902a5d-ec0b-48a4-aec4-fc66336f9b05 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:42.243386 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-7934a142-c9a8-487a-846e-6383216cfa79 req-fa16cc34-b944-4c07-9be4-11a364913e48 service neutron] 10.222.0.82 "GET /v2.0/networks/348b2b0f-c826-45ab-ba85-8430235b9cac?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3493981
May 20 04:23:42.274202 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-37902a5d-ec0b-48a4-aec4-fc66336f9b05 None None] Port 1a9566c0-910b-4abb-b1c3-865c2789dc16 cannot update to ACTIVE because it is not bound. {{(pid=91688) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 20 04:23:42.292832 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-d7f746a0-2bc6-47f7-a8cb-e1ed4558d150 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1505543', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1590664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1781430', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1713996'] for network, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:42.326096 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-d7f746a0-2bc6-47f7-a8cb-e1ed4558d150 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for network, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:42.343002 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:42.452095 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f28047f7-f002-47de-b08e-30c9d2c39970 admin admin] Notify agent at l3_agent.dv-cinder-790910-4-iscsi the message routers_updated {{(pid=91686) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 04:23:42.473008 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-f28047f7-f002-47de-b08e-30c9d2c39970 admin admin] 10.222.0.71 "PUT /v2.0/routers/516c54ae-e378-44de-a7bf-14b9bb646228/add_router_interface HTTP/1.1" status: 200  len: 503 time: 6.7883015
May 20 04:23:42.708531 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7f746a0-2bc6-47f7-a8cb-e1ed4558d150 admin admin] Pushing event deleted for resources: {'Network': ['ID=bcfef78b-d50f-4b70-a8f4-439d5e27267a,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:42.729812 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-d7f746a0-2bc6-47f7-a8cb-e1ed4558d150 admin admin] 10.222.0.71 "DELETE /v2.0/networks/bcfef78b-d50f-4b70-a8f4-439d5e27267a HTTP/1.1" status: 204  len: 168 time: 1.8155768
May 20 04:23:42.733380 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 39198) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:23:42.738202 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-d7f746a0-2bc6-47f7-a8cb-e1ed4558d150 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.395s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:42.807265 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device a73b9449-b261-4c62-b13c-b2c797730593 up at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:23:42.866706 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-7934a142-c9a8-487a-846e-6383216cfa79 req-6cdafcfb-48e4-41ba-8c18-cb2b76e50ac0 service neutron] 10.222.0.82 "GET /v2.0/networks/348b2b0f-c826-45ab-ba85-8430235b9cac?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.6139207
May 20 04:23:42.896644 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b555ab05-6749-476e-b1c1-16bb4075baac None None] Sync routers for ids ['516c54ae-e378-44de-a7bf-14b9bb646228'] in dv-cinder-790910-4-iscsi {{(pid=91688) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 04:23:42.909589 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bcbda9d-221b-4ad9-a267-65bba0be2ccb req-46106afd-9fb8-43d8-a336-6fee4dfa6162 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:42.927560 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-5bcbda9d-221b-4ad9-a267-65bba0be2ccb req-46106afd-9fb8-43d8-a336-6fee4dfa6162 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.2831695
May 20 04:23:43.013705 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b555ab05-6749-476e-b1c1-16bb4075baac None None] Routers {'516c54ae-e378-44de-a7bf-14b9bb646228'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91688) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:23:43.013705 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-b555ab05-6749-476e-b1c1-16bb4075baac None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced1bb85e0>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:23:33Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['516c54ae-e378-44de-a7bf-14b9bb646228'], 'active': True} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:23:43.061967 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-5bcbda9d-221b-4ad9-a267-65bba0be2ccb req-92fe177a-23ef-4ced-a2ce-fabd43bd7417 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1330004
May 20 04:23:43.079482 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-73bdb546-374b-40a8-ad3d-dfccf98ac0f0 req-42cd291f-943f-49c0-9eb1-9bdc08033972 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Notify callbacks [] for port, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:43.106611 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.db_base_plugin_v2 [None req-402b9c9c-32d9-4b61-aada-e84b874ae708 admin admin] Deleting subnet 4aa0ec79-5f1d-4162-8cc7-e398d6e1a4c0 {{(pid=91687) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 20 04:23:43.122899 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-402b9c9c-32d9-4b61-aada-e84b874ae708 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:43.409644 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning for port a73b9449-b261-4c62-b13c-b2c797730593 completed by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:23:43.438013 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-e7b30af8-e16e-4172-ada0-2ad5403e5cc2 req-9beb36e0-7078-498f-9f0f-adc7b4dc5c5c tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Synchronizing usage tracker for tenant:6484c55ce8204dc3802efc929a51c4a5 on resource:port {{(pid=91687) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:23:43.480521 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning complete for port a73b9449-b261-4c62-b13c-b2c797730593 triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:23:43.482778 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:43.505808 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-402b9c9c-32d9-4b61-aada-e84b874ae708 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-936634'] for subnet, precommit_delete_associations {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:43.646152 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-73bdb546-374b-40a8-ad3d-dfccf98ac0f0 req-42cd291f-943f-49c0-9eb1-9bdc08033972 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8782892106231', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4162192'] for port, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:43.671854 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] get_ports_and_sgs() called for port_ids ['9a903ca5-2762-405a-81bb-5c3dce3d256a'] {{(pid=91688) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 04:23:43.679704 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-58ec3c4d-2fce-4f74-91c4-6ecd46daf319 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:43.804104 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvr_db [None req-b555ab05-6749-476e-b1c1-16bb4075baac None None] Set router 516c54ae-e378-44de-a7bf-14b9bb646228 gateway port host: dv-cinder-790910-4-iscsi {{(pid=91688) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:23:43.818509 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-e7b30af8-e16e-4172-ada0-2ad5403e5cc2 req-9beb36e0-7078-498f-9f0f-adc7b4dc5c5c tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Unset dirty status for tenant:6484c55ce8204dc3802efc929a51c4a5 on resource:port {{(pid=91687) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:23:43.830775 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-e7b30af8-e16e-4172-ada0-2ad5403e5cc2 req-9beb36e0-7078-498f-9f0f-adc7b4dc5c5c tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=07157b0a-98fc-4f60-bd6f-f1fd5c17dbfa HTTP/1.1" status: 200  len: 210 time: 0.6286788
May 20 04:23:43.885423 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42cd291f-943f-49c0-9eb1-9bdc08033972 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Pushing event updated for resources: {'Port': ['ID=c84df5e2-cd07-4d01-87c9-ec3a35e2ad93,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:43.900331 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-42cd291f-943f-49c0-9eb1-9bdc08033972 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.221s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:43.911612 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-73bdb546-374b-40a8-ad3d-dfccf98ac0f0 req-42cd291f-943f-49c0-9eb1-9bdc08033972 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Network 20ab5e30-591a-443a-9e34-f3a1b7563f5d is already hosted by enough agents. {{(pid=91687) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:23:43.919072 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.base_scheduler [req-73bdb546-374b-40a8-ad3d-dfccf98ac0f0 req-42cd291f-943f-49c0-9eb1-9bdc08033972 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Resources bound (agent type, host, resource id):  {{(pid=91687) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:23:43.927090 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.l3_dvrscheduler_db [req-73bdb546-374b-40a8-ad3d-dfccf98ac0f0 req-42cd291f-943f-49c0-9eb1-9bdc08033972 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Received port after_create {{(pid=91687) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 04:23:43.979116 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-402b9c9c-32d9-4b61-aada-e84b874ae708 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1504133'] for subnet, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:44.013990 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:44.085105 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] For port a73b9449-b261-4c62-b13c-b2c797730593, host dv-cinder-790910-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=a73b9449-b261-4c62-b13c-b2c797730593,segment=NetworkSegment(8df49ec5-3fb9-4715-bc9a-f4019a6b55f9),segment_id=8df49ec5-3fb9-4715-bc9a-f4019a6b55f9)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:23:44.145135 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:44.159285 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-8644445b-4d14-465a-a116-1e1f3a9585b8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:44.204181 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73bdb546-374b-40a8-ad3d-dfccf98ac0f0 req-42cd291f-943f-49c0-9eb1-9bdc08033972 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:44.205293 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-73bdb546-374b-40a8-ad3d-dfccf98ac0f0 req-42cd291f-943f-49c0-9eb1-9bdc08033972 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for port, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:44.319317 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-73bdb546-374b-40a8-ad3d-dfccf98ac0f0 req-42cd291f-943f-49c0-9eb1-9bdc08033972 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 3.8917747
May 20 04:23:44.367356 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [req-73bdb546-374b-40a8-ad3d-dfccf98ac0f0 req-1fbdcfa0-acc0-43fd-a4f6-2b2dfaae1471 service neutron] Request body: {'port': {'device_id': '07157b0a-98fc-4f60-bd6f-f1fd5c17dbfa', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79091'}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:23:44.684272 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcea3dea-9cc5-41e8-b8a8-01651cbe46b1 req-4af42107-84f2-4868-88a3-faa39dc354d2 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:44.687626 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-bcea3dea-9cc5-41e8-b8a8-01651cbe46b1 req-4af42107-84f2-4868-88a3-faa39dc354d2 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.2619348
May 20 04:23:44.706781 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-b555ab05-6749-476e-b1c1-16bb4075baac None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced1bb85e0>, [{'id': '516c54ae-e378-44de-a7bf-14b9bb646228', 'name': 'tempest-TestMinimumBasicScenario-943774282-router', 'tenant_id': 'a588c51341504beda6a1803a15cc919c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.92'}], 'enable_snat': True}, 'gw_port_id': 'a73b9449-b261-4c62-b13c-b2c797730593', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:23:27Z', 'updated_at': '2021-05-20T04:23:40Z', 'revision_number': 4, 'project_id': 'a588c51341504beda6a1803a15cc919c', 'gw_port': {'id': 'a73b9449-b261-4c62-b13c-b2c797730593', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:bb:ad:48', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '516c54ae-e378-44de-a7bf-14b9bb646228', 'device_owner': 'network:router_gateway', 'standard_attr_id': 362, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.92', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:23:29Z', 'updated_at': '2021-05-20T04:23:38Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_interfaces': [{'id': '1a9566c0-910b-4abb-b1c3-865c2789dc16', 'name': '', 'network_id': 'fc681196-7d83-4764-b760-89961b7ffe54', 'tenant_id': 'a588c51341504beda6a1803a15cc919c', 'mac_address': 'fa:16:3e:2b:7c:44', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '516c54ae-e378-44de-a7bf-14b9bb646228', 'device_owner': 'network:router_interface', 'standard_attr_id': 363, 'fixed_ips': [{'subnet_id': 'a34998b9-6684-4ced-a2bb-9b229ae96845', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:23:38Z', 'updated_at': '2021-05-20T04:23:40Z', 'revision_number': 2, 'project_id': 'a588c51341504beda6a1803a15cc919c', 'subnets': [{'id': 'a34998b9-6684-4ced-a2bb-9b229ae96845', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:23:44.740858 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Pushing event updated for resources: {'Port': ['ID=a73b9449-b261-4c62-b13c-b2c797730593,revision_number=4']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:44.745827 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.587s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:44.755229 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b555ab05-6749-476e-b1c1-16bb4075baac None None] Checking router: 516c54ae-e378-44de-a7bf-14b9bb646228 for host: dv-cinder-790910-4-iscsi {{(pid=91688) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 04:23:44.755594 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b555ab05-6749-476e-b1c1-16bb4075baac None None] Updating router 516c54ae-e378-44de-a7bf-14b9bb646228 port 1a9566c0-910b-4abb-b1c3-865c2789dc16 binding host dv-cinder-790910-4-iscsi {{(pid=91688) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 20 04:23:44.840865 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-bcea3dea-9cc5-41e8-b8a8-01651cbe46b1 req-55456153-2528-4602-9909-a67ed6c46cc9 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1377978
May 20 04:23:44.842776 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-73bdb546-374b-40a8-ad3d-dfccf98ac0f0 req-1fbdcfa0-acc0-43fd-a4f6-2b2dfaae1471 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:44.873616 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-b555ab05-6749-476e-b1c1-16bb4075baac None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:45.106061 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-402b9c9c-32d9-4b61-aada-e84b874ae708 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1504178', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-255887', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-4160847', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-692244'] for subnet, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:45.226525 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:45.294445 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-402b9c9c-32d9-4b61-aada-e84b874ae708 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=4aa0ec79-5f1d-4162-8cc7-e398d6e1a4c0,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:45.310095 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-402b9c9c-32d9-4b61-aada-e84b874ae708 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:45.314266 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-402b9c9c-32d9-4b61-aada-e84b874ae708 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for subnet, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:45.337060 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-402b9c9c-32d9-4b61-aada-e84b874ae708 admin admin] 10.222.0.71 "DELETE /v2.0/subnets/4aa0ec79-5f1d-4162-8cc7-e398d6e1a4c0 HTTP/1.1" status: 204  len: 168 time: 2.5974078
May 20 04:23:45.341049 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 39272) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:23:45.410466 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 39276) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:23:45.566323 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8cb6bbf-bc8c-42e0-8f86-3f328c1fcd3d req-f716375b-9909-4b15-bceb-96257282bd84 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:45.569048 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-e8cb6bbf-bc8c-42e0-8f86-3f328c1fcd3d req-f716375b-9909-4b15-bceb-96257282bd84 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=07157b0a-98fc-4f60-bd6f-f1fd5c17dbfa HTTP/1.1" status: 200  len: 931 time: 0.4708016
May 20 04:23:45.628919 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-b555ab05-6749-476e-b1c1-16bb4075baac None None] Notify callbacks [] for port, precommit_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:45.661124 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-e8cb6bbf-bc8c-42e0-8f86-3f328c1fcd3d req-7cd0c557-b073-4cc7-8c01-897c189cf304 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0800023
May 20 04:23:45.681901 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-b555ab05-6749-476e-b1c1-16bb4075baac None None] Transition to ACTIVE for port object 1a9566c0-910b-4abb-b1c3-865c2789dc16 will not be triggered until provisioned by entity L2. {{(pid=91688) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:23:45.696108 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-b555ab05-6749-476e-b1c1-16bb4075baac None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:45.722981 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-570b83a9-8ac5-4ed6-8bc5-060a29629c3b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-593149'] for network, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:45.723585 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-aad9ef34-d62d-4fb9-b027-6d9ca14d151f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:45.824593 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68b48814-8bc9-4aba-93fd-f82daf481a5e None None] Pushing event updated for resources: {'Port': ['ID=1a9566c0-910b-4abb-b1c3-865c2789dc16,revision_number=3']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:45.836221 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-68b48814-8bc9-4aba-93fd-f82daf481a5e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:45.987274 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.notifiers.nova [req-73bdb546-374b-40a8-ad3d-dfccf98ac0f0 req-1fbdcfa0-acc0-43fd-a4f6-2b2dfaae1471 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c84df5e2-cd07-4d01-87c9-ec3a35e2ad93 {{(pid=91687) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 04:23:46.045841 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-73bdb546-374b-40a8-ad3d-dfccf98ac0f0 req-1fbdcfa0-acc0-43fd-a4f6-2b2dfaae1471 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:46.135329 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.provisioning_blocks [req-73bdb546-374b-40a8-ad3d-dfccf98ac0f0 req-1fbdcfa0-acc0-43fd-a4f6-2b2dfaae1471 service neutron] Transition to ACTIVE for port object c84df5e2-cd07-4d01-87c9-ec3a35e2ad93 will not be triggered until provisioned by entity L2. {{(pid=91687) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:23:46.178709 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-73bdb546-374b-40a8-ad3d-dfccf98ac0f0 req-1fbdcfa0-acc0-43fd-a4f6-2b2dfaae1471 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4162185'] for port, after_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:46.192761 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-22ef3c6e-af85-4ddf-bb7f-2c17e97927bf tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:46.321795 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.managers [None req-b555ab05-6749-476e-b1c1-16bb4075baac None None] Attempting to bind port 1a9566c0-910b-4abb-b1c3-865c2789dc16 on host dv-cinder-790910-4-iscsi for vnic_type normal with profile  {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 04:23:46.326377 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.managers [None req-b555ab05-6749-476e-b1c1-16bb4075baac None None] Attempting to bind port 1a9566c0-910b-4abb-b1c3-865c2789dc16 by drivers openvswitch,hyperv on host dv-cinder-790910-4-iscsi at level 0 using segments [{'id': 'f495c6da-d858-4d7b-a7ae-2c30d9f73111', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 894, 'network_id': 'fc681196-7d83-4764-b760-89961b7ffe54'}] {{(pid=91688) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 04:23:46.327769 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b555ab05-6749-476e-b1c1-16bb4075baac None None] Attempting to bind port 1a9566c0-910b-4abb-b1c3-865c2789dc16 on network fc681196-7d83-4764-b760-89961b7ffe54 {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:23:46.341580 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b555ab05-6749-476e-b1c1-16bb4075baac None None] Checking agent: {'id': '333121d4-1023-4a33-a54c-f4dd052e1612', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-790910-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 4, 13, 33), 'started_at': datetime.datetime(2021, 5, 20, 4, 14, 3), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 4, 23, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-790910-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 04:23:46.344401 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b555ab05-6749-476e-b1c1-16bb4075baac None None] Checking segment: {'id': 'f495c6da-d858-4d7b-a7ae-2c30d9f73111', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 894, 'network_id': 'fc681196-7d83-4764-b760-89961b7ffe54'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91688) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:23:46.345107 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-b555ab05-6749-476e-b1c1-16bb4075baac None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:46.345537 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b555ab05-6749-476e-b1c1-16bb4075baac None None] Bound using segment: {'id': 'f495c6da-d858-4d7b-a7ae-2c30d9f73111', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 894, 'network_id': 'fc681196-7d83-4764-b760-89961b7ffe54'} {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 04:23:46.356995 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.managers [None req-b555ab05-6749-476e-b1c1-16bb4075baac None None] Bound port: 1a9566c0-910b-4abb-b1c3-865c2789dc16, host: dv-cinder-790910-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f495c6da-d858-4d7b-a7ae-2c30d9f73111', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 894, 'network_id': 'fc681196-7d83-4764-b760-89961b7ffe54'}}] {{(pid=91688) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 04:23:46.356995 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-b555ab05-6749-476e-b1c1-16bb4075baac None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:46.525883 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-570b83a9-8ac5-4ed6-8bc5-060a29629c3b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1505550', 'neutron.services.segments.db._delete_segments_for_network-8782892550274'] for network, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:46.542209 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-1aad96a7-c93d-4a6f-be42-2760f0d1b0c9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:46.567103 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.services.segments.db [None req-570b83a9-8ac5-4ed6-8bc5-060a29629c3b admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fced11546a0>,) {'filters': {'network_id': ['0ac44429-2f1c-490b-8866-f86839542644']}} {{(pid=91686) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:23:46.689910 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.services.segments.db [None req-570b83a9-8ac5-4ed6-8bc5-060a29629c3b admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fced11546a0>, '9b287152-3ebe-4833-9a63-0fd3a7e44b78') {'for_net_delete': True} {{(pid=91686) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:23:46.694102 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.services.segments.db [None req-570b83a9-8ac5-4ed6-8bc5-060a29629c3b admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fced11546a0>, '9b287152-3ebe-4833-9a63-0fd3a7e44b78') {} {{(pid=91686) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:23:46.701828 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-b555ab05-6749-476e-b1c1-16bb4075baac None None] For port 1a9566c0-910b-4abb-b1c3-865c2789dc16, host dv-cinder-790910-4-iscsi, cleared binding levels {{(pid=91688) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 04:23:46.706673 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-b555ab05-6749-476e-b1c1-16bb4075baac None None] For port 1a9566c0-910b-4abb-b1c3-865c2789dc16, host dv-cinder-790910-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=1a9566c0-910b-4abb-b1c3-865c2789dc16,segment=NetworkSegment(f495c6da-d858-4d7b-a7ae-2c30d9f73111),segment_id=f495c6da-d858-4d7b-a7ae-2c30d9f73111)] {{(pid=91688) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 04:23:46.715379 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-b555ab05-6749-476e-b1c1-16bb4075baac None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:46.720043 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:46.728092 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-570b83a9-8ac5-4ed6-8bc5-060a29629c3b admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8782892560523', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4081441'] for segment, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:46.769881 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-570b83a9-8ac5-4ed6-8bc5-060a29629c3b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1501910'] for segment, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:46.777671 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-570b83a9-8ac5-4ed6-8bc5-060a29629c3b admin admin] Releasing vlan 859 on physical network physnet1 to pool {{(pid=91686) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 20 04:23:46.778495 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-570b83a9-8ac5-4ed6-8bc5-060a29629c3b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1501910', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2145121'] for segment, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:46.849509 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fbdcfa0-acc0-43fd-a4f6-2b2dfaae1471 service neutron] Pushing event updated for resources: {'Port': ['ID=c84df5e2-cd07-4d01-87c9-ec3a35e2ad93,revision_number=2']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:46.875210 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device a73b9449-b261-4c62-b13c-b2c797730593 up at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:23:46.880059 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-1fbdcfa0-acc0-43fd-a4f6-2b2dfaae1471 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.688s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:46.907208 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.managers [req-73bdb546-374b-40a8-ad3d-dfccf98ac0f0 req-1fbdcfa0-acc0-43fd-a4f6-2b2dfaae1471 service neutron] Attempting to bind port c84df5e2-cd07-4d01-87c9-ec3a35e2ad93 on host hv-cinder-79091 for vnic_type normal with profile  {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 04:23:46.907920 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.managers [req-73bdb546-374b-40a8-ad3d-dfccf98ac0f0 req-1fbdcfa0-acc0-43fd-a4f6-2b2dfaae1471 service neutron] Attempting to bind port c84df5e2-cd07-4d01-87c9-ec3a35e2ad93 by drivers openvswitch,hyperv on host hv-cinder-79091 at level 0 using segments [{'id': '0ad1d987-000a-4092-8d15-811f90922b00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': '20ab5e30-591a-443a-9e34-f3a1b7563f5d'}] {{(pid=91687) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 04:23:46.908412 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-73bdb546-374b-40a8-ad3d-dfccf98ac0f0 req-1fbdcfa0-acc0-43fd-a4f6-2b2dfaae1471 service neutron] Attempting to bind port c84df5e2-cd07-4d01-87c9-ec3a35e2ad93 on network 20ab5e30-591a-443a-9e34-f3a1b7563f5d {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:23:46.911495 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-1aad96a7-c93d-4a6f-be42-2760f0d1b0c9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:23:46.919383 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-1aad96a7-c93d-4a6f-be42-2760f0d1b0c9 admin admin] Usage tracker for resource:security_group_rule and tenant:a209537864ef4eec81ac12d5e2637bdc is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:23:46.923914 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-1aad96a7-c93d-4a6f-be42-2760f0d1b0c9 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:23:46.930826 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-73bdb546-374b-40a8-ad3d-dfccf98ac0f0 req-1fbdcfa0-acc0-43fd-a4f6-2b2dfaae1471 service neutron] Port c84df5e2-cd07-4d01-87c9-ec3a35e2ad93 on network 20ab5e30-591a-443a-9e34-f3a1b7563f5d not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79091 {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 20 04:23:46.931445 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-73bdb546-374b-40a8-ad3d-dfccf98ac0f0 req-1fbdcfa0-acc0-43fd-a4f6-2b2dfaae1471 service neutron] Attempting to bind port c84df5e2-cd07-4d01-87c9-ec3a35e2ad93 on network 20ab5e30-591a-443a-9e34-f3a1b7563f5d {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:23:46.932445 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-1aad96a7-c93d-4a6f-be42-2760f0d1b0c9 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:23:46.950457 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-73bdb546-374b-40a8-ad3d-dfccf98ac0f0 req-1fbdcfa0-acc0-43fd-a4f6-2b2dfaae1471 service neutron] Checking agent: {'id': '7cc947fd-92eb-4d43-ad6b-ea002afff217', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79091', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 4, 19, 34), 'started_at': datetime.datetime(2021, 5, 20, 4, 19, 34), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 4, 23, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 04:23:46.951103 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-73bdb546-374b-40a8-ad3d-dfccf98ac0f0 req-1fbdcfa0-acc0-43fd-a4f6-2b2dfaae1471 service neutron] Checking segment: {'id': '0ad1d987-000a-4092-8d15-811f90922b00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': '20ab5e30-591a-443a-9e34-f3a1b7563f5d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91687) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:23:46.951676 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-73bdb546-374b-40a8-ad3d-dfccf98ac0f0 req-1fbdcfa0-acc0-43fd-a4f6-2b2dfaae1471 service neutron] Bound using segment: {'id': '0ad1d987-000a-4092-8d15-811f90922b00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': '20ab5e30-591a-443a-9e34-f3a1b7563f5d'} {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 04:23:46.952313 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.managers [req-73bdb546-374b-40a8-ad3d-dfccf98ac0f0 req-1fbdcfa0-acc0-43fd-a4f6-2b2dfaae1471 service neutron] Bound port: c84df5e2-cd07-4d01-87c9-ec3a35e2ad93, host: hv-cinder-79091, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '0ad1d987-000a-4092-8d15-811f90922b00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': '20ab5e30-591a-443a-9e34-f3a1b7563f5d'}}] {{(pid=91687) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 04:23:46.952859 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-73bdb546-374b-40a8-ad3d-dfccf98ac0f0 req-1fbdcfa0-acc0-43fd-a4f6-2b2dfaae1471 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:47.080534 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-1aad96a7-c93d-4a6f-be42-2760f0d1b0c9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:47.081955 dv-cinder-790910-4-iscsi neutron-server[91686]: Traceback (most recent call last):
May 20 04:23:47.081955 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 20 04:23:47.081955 dv-cinder-790910-4-iscsi neutron-server[91686]:     timer()
May 20 04:23:47.081955 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 20 04:23:47.081955 dv-cinder-790910-4-iscsi neutron-server[91686]:     cb(*args, **kw)
May 20 04:23:47.081955 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 20 04:23:47.081955 dv-cinder-790910-4-iscsi neutron-server[91686]:     return func(*args, **kwargs)
May 20 04:23:47.081955 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 20 04:23:47.081955 dv-cinder-790910-4-iscsi neutron-server[91686]:     self._notify()
May 20 04:23:47.081955 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 20 04:23:47.081955 dv-cinder-790910-4-iscsi neutron-server[91686]:     self.callback(batched_events)
May 20 04:23:47.081955 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 20 04:23:47.081955 dv-cinder-790910-4-iscsi neutron-server[91686]:     event.method(event)
May 20 04:23:47.081955 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 20 04:23:47.081955 dv-cinder-790910-4-iscsi neutron-server[91686]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 20 04:23:47.081955 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 20 04:23:47.081955 dv-cinder-790910-4-iscsi neutron-server[91686]:     aggregate_uuid = self.p_client.list_aggregates(
May 20 04:23:47.081955 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 20 04:23:47.081955 dv-cinder-790910-4-iscsi neutron-server[91686]:     return f(self, *a, **k)
May 20 04:23:47.081955 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 20 04:23:47.081955 dv-cinder-790910-4-iscsi neutron-server[91686]:     return self._get(url).json()
May 20 04:23:47.081955 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 20 04:23:47.081955 dv-cinder-790910-4-iscsi neutron-server[91686]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 20 04:23:47.081955 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 20 04:23:47.081955 dv-cinder-790910-4-iscsi neutron-server[91686]:     return self.request(url, 'GET', **kwargs)
May 20 04:23:47.081955 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 20 04:23:47.081955 dv-cinder-790910-4-iscsi neutron-server[91686]:     base_url = self.get_endpoint(auth, allow=allow,
May 20 04:23:47.081955 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 20 04:23:47.081955 dv-cinder-790910-4-iscsi neutron-server[91686]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 20 04:23:47.081955 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 20 04:23:47.081955 dv-cinder-790910-4-iscsi neutron-server[91686]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 20 04:23:47.081955 dv-cinder-790910-4-iscsi neutron-server[91686]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 20 04:23:47.086036 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-570b83a9-8ac5-4ed6-8bc5-060a29629c3b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1505543', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1590664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1781430', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1713996'] for network, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:47.159163 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-570b83a9-8ac5-4ed6-8bc5-060a29629c3b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for network, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:47.172071 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning complete for port a73b9449-b261-4c62-b13c-b2c797730593 triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:23:47.172071 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:47.173313 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5831497b-9d80-4b1e-b462-6d53129cba96 req-f234ef3a-aa66-4271-bb2d-ea224d3279e2 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:47.175010 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-5831497b-9d80-4b1e-b462-6d53129cba96 req-f234ef3a-aa66-4271-bb2d-ea224d3279e2 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.8933554
May 20 04:23:47.202648 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:47.227915 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b555ab05-6749-476e-b1c1-16bb4075baac None None] Routers {'516c54ae-e378-44de-a7bf-14b9bb646228'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91688) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:23:47.232318 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-b555ab05-6749-476e-b1c1-16bb4075baac None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced1bb85e0>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:23:33Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['516c54ae-e378-44de-a7bf-14b9bb646228'], 'active': True} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:23:47.266627 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [req-73bdb546-374b-40a8-ad3d-dfccf98ac0f0 req-1fbdcfa0-acc0-43fd-a4f6-2b2dfaae1471 service neutron] For port c84df5e2-cd07-4d01-87c9-ec3a35e2ad93, host hv-cinder-79091, cleared binding levels {{(pid=91687) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 04:23:47.271544 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-5831497b-9d80-4b1e-b462-6d53129cba96 req-6e653274-52a8-4847-aec7-c3baa4644367 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0722191
May 20 04:23:47.273753 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [req-73bdb546-374b-40a8-ad3d-dfccf98ac0f0 req-1fbdcfa0-acc0-43fd-a4f6-2b2dfaae1471 service neutron] For port c84df5e2-cd07-4d01-87c9-ec3a35e2ad93, host hv-cinder-79091, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=c84df5e2-cd07-4d01-87c9-ec3a35e2ad93,segment=NetworkSegment(0ad1d987-000a-4092-8d15-811f90922b00),segment_id=0ad1d987-000a-4092-8d15-811f90922b00)] {{(pid=91687) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 04:23:47.277233 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-570b83a9-8ac5-4ed6-8bc5-060a29629c3b admin admin] 10.222.0.71 "DELETE /v2.0/networks/0ac44429-2f1c-490b-8866-f86839542644 HTTP/1.1" status: 204  len: 168 time: 1.9349215
May 20 04:23:47.278910 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-1aad96a7-c93d-4a6f-be42-2760f0d1b0c9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:47.285455 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-73bdb546-374b-40a8-ad3d-dfccf98ac0f0 req-1fbdcfa0-acc0-43fd-a4f6-2b2dfaae1471 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4162185'] for port, after_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:47.291041 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-570b83a9-8ac5-4ed6-8bc5-060a29629c3b admin admin] Pushing event deleted for resources: {'Network': ['ID=0ac44429-2f1c-490b-8866-f86839542644,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:47.299595 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-a9b31bd2-3651-495f-8937-e84a49b57e3e tempest-DeleteServersTestJSON-1653320155 tempest-DeleteServersTestJSON-1653320155-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:47.313995 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-570b83a9-8ac5-4ed6-8bc5-060a29629c3b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:47.315228 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-ead2fbea-7f2a-43f3-82be-9c91e4557460 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.024s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:47.409719 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-1aad96a7-c93d-4a6f-be42-2760f0d1b0c9 admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=a209537864ef4eec81ac12d5e2637bdc&name=default HTTP/1.1" status: 200  len: 2979 time: 1.9539936
May 20 04:23:47.416490 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 39308) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:23:47.444617 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73bdb546-374b-40a8-ad3d-dfccf98ac0f0 req-1fbdcfa0-acc0-43fd-a4f6-2b2dfaae1471 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:47.445280 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-73bdb546-374b-40a8-ad3d-dfccf98ac0f0 req-1fbdcfa0-acc0-43fd-a4f6-2b2dfaae1471 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for port, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:47.446757 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-73bdb546-374b-40a8-ad3d-dfccf98ac0f0 req-1fbdcfa0-acc0-43fd-a4f6-2b2dfaae1471 service neutron] 10.222.0.82 "PUT /v2.0/ports/c84df5e2-cd07-4d01-87c9-ec3a35e2ad93 HTTP/1.1" status: 200  len: 1093 time: 3.1083734
May 20 04:23:47.447299 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '07157b0a-98fc-4f60-bd6f-f1fd5c17dbfa', 'tag': 'c84df5e2-cd07-4d01-87c9-ec3a35e2ad93'}] {{(pid=91687) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:23:47.478856 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1aad96a7-c93d-4a6f-be42-2760f0d1b0c9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=45534e25-1922-4b25-9593-779493c43e22,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:47.491632 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-1aad96a7-c93d-4a6f-be42-2760f0d1b0c9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.177s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:47.564316 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27a56bc1-c7f4-4e61-ac77-8060b9efc53e req-ed12badd-873f-477b-a03e-e78f5c77d959 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:47.572757 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-27a56bc1-c7f4-4e61-ac77-8060b9efc53e req-ed12badd-873f-477b-a03e-e78f5c77d959 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=07157b0a-98fc-4f60-bd6f-f1fd5c17dbfa HTTP/1.1" status: 200  len: 943 time: 0.4884119
May 20 04:23:47.663456 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68b48814-8bc9-4aba-93fd-f82daf481a5e None None] Pushing event updated for resources: {'Port': ['ID=1a9566c0-910b-4abb-b1c3-865c2789dc16,revision_number=4']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:47.695245 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-68b48814-8bc9-4aba-93fd-f82daf481a5e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.975s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:47.748472 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 39318) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:23:47.763459 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-a75ebe20-6797-4750-bfee-b06789954d38 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:47.849116 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-27a56bc1-c7f4-4e61-ac77-8060b9efc53e req-f2b28292-de31-42b2-9aba-a55432694e4f tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2752714
May 20 04:23:47.896797 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-a75ebe20-6797-4750-bfee-b06789954d38 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:47.959185 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-f86d0eeb-29ce-4aac-9b11-afa6b2fb304b admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=3256e447aabc4919ab44697ceab8e6cf&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1979823
May 20 04:23:47.960366 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 39326) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:23:48.025571 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fbdcfa0-acc0-43fd-a4f6-2b2dfaae1471 service neutron] Pushing event updated for resources: {'Port': ['ID=c84df5e2-cd07-4d01-87c9-ec3a35e2ad93,revision_number=3']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:48.052822 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '07157b0a-98fc-4f60-bd6f-f1fd5c17dbfa', 'tag': 'c84df5e2-cd07-4d01-87c9-ec3a35e2ad93', 'status': 'completed', 'code': 200}
May 20 04:23:48.064205 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-1fbdcfa0-acc0-43fd-a4f6-2b2dfaae1471 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.771s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:48.066224 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-a75ebe20-6797-4750-bfee-b06789954d38 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:48.080030 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-b3db490c-a02d-4770-b2c7-f646fae58291 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:48.105236 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a75ebe20-6797-4750-bfee-b06789954d38 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=45534e25-1922-4b25-9593-779493c43e22,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:48.109016 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-a75ebe20-6797-4750-bfee-b06789954d38 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:48.114359 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-a75ebe20-6797-4750-bfee-b06789954d38 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:48.114359 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-a75ebe20-6797-4750-bfee-b06789954d38 admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/45534e25-1922-4b25-9593-779493c43e22 HTTP/1.1" status: 204  len: 168 time: 0.6903088
May 20 04:23:48.144928 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-f85f1d60-6fc4-4ab2-a61a-5fa49fbf303d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:48.171316 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73bdb546-374b-40a8-ad3d-dfccf98ac0f0 req-4b1c6635-c176-460f-a181-8af0603ecf1e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:48.182241 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-73bdb546-374b-40a8-ad3d-dfccf98ac0f0 req-4b1c6635-c176-460f-a181-8af0603ecf1e service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=6484c55ce8204dc3802efc929a51c4a5&device_id=07157b0a-98fc-4f60-bd6f-f1fd5c17dbfa HTTP/1.1" status: 200  len: 1096 time: 0.6752179
May 20 04:23:48.194303 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-f85f1d60-6fc4-4ab2-a61a-5fa49fbf303d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:48.279319 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvr_db [None req-b555ab05-6749-476e-b1c1-16bb4075baac None None] Set router 516c54ae-e378-44de-a7bf-14b9bb646228 gateway port host: dv-cinder-790910-4-iscsi {{(pid=91688) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:23:48.288704 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-f85f1d60-6fc4-4ab2-a61a-5fa49fbf303d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:48.414738 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-d7a094e8-9ac7-4d7a-b135-63c7b606835e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:48.414738 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-f85f1d60-6fc4-4ab2-a61a-5fa49fbf303d admin admin] Notify callbacks [] for security_group, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:48.414738 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-f85f1d60-6fc4-4ab2-a61a-5fa49fbf303d admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/28e1d321-f7b0-4b59-9e60-b859e2b9c22e HTTP/1.1" status: 204  len: 168 time: 0.3787498
May 20 04:23:48.414738 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f85f1d60-6fc4-4ab2-a61a-5fa49fbf303d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=28e1d321-f7b0-4b59-9e60-b859e2b9c22e,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:48.414738 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-f85f1d60-6fc4-4ab2-a61a-5fa49fbf303d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:48.432342 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-73bdb546-374b-40a8-ad3d-dfccf98ac0f0 req-4e048232-9743-4d1b-afb3-043c00bf02cb service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=c84df5e2-cd07-4d01-87c9-ec3a35e2ad93 HTTP/1.1" status: 200  len: 217 time: 0.2349958
May 20 04:23:48.668632 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73bdb546-374b-40a8-ad3d-dfccf98ac0f0 req-b0e1c265-74fc-4191-bbac-3550c7cb3640 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:48.672468 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-73bdb546-374b-40a8-ad3d-dfccf98ac0f0 req-b0e1c265-74fc-4191-bbac-3550c7cb3640 service neutron] 10.222.0.82 "GET /v2.0/subnets?id=2a9c681d-a9be-4897-91bb-31aeb6432254 HTTP/1.1" status: 200  len: 855 time: 0.2289906
May 20 04:23:48.875331 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-73bdb546-374b-40a8-ad3d-dfccf98ac0f0 req-e5f02e53-f7e1-4c54-b2e3-b110f75d22fb service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=20ab5e30-591a-443a-9e34-f3a1b7563f5d&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1899407
May 20 04:23:48.892474 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20400311-57a5-42d6-af8e-ca0cb02083a5 req-d5660408-5553-4d06-b998-e64aee9dfa99 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:48.911768 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-20400311-57a5-42d6-af8e-ca0cb02083a5 req-d5660408-5553-4d06-b998-e64aee9dfa99 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.2596338
May 20 04:23:49.057572 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-20400311-57a5-42d6-af8e-ca0cb02083a5 req-a1d8c593-bef2-427d-a3de-4b6c1c9e3b5e tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1447299
May 20 04:23:49.491887 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 39362) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:23:49.610964 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 39366) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:23:49.641798 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-cd8a7f6c-f00e-43c7-a5d6-251660c008d6 admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=82107fe100164c8c9c1e62c9952b59e9&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1484413
May 20 04:23:49.642319 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 39372) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:23:49.684755 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-73bdb546-374b-40a8-ad3d-dfccf98ac0f0 req-86070fdc-1f93-4d0b-91ff-f4e9041ec37e service neutron] 10.222.0.82 "GET /v2.0/networks/20ab5e30-591a-443a-9e34-f3a1b7563f5d?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.8056800
May 20 04:23:49.686743 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-9af795ca-9add-4c3a-a307-79af1358f1c1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:49.801401 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-18fd85f2-b085-4191-b532-997c180257cf admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:49.874556 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-18fd85f2-b085-4191-b532-997c180257cf admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:50.008411 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-b555ab05-6749-476e-b1c1-16bb4075baac None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced1bb85e0>, [{'id': '516c54ae-e378-44de-a7bf-14b9bb646228', 'name': 'tempest-TestMinimumBasicScenario-943774282-router', 'tenant_id': 'a588c51341504beda6a1803a15cc919c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.92'}], 'enable_snat': True}, 'gw_port_id': 'a73b9449-b261-4c62-b13c-b2c797730593', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:23:27Z', 'updated_at': '2021-05-20T04:23:40Z', 'revision_number': 4, 'project_id': 'a588c51341504beda6a1803a15cc919c', 'gw_port': {'id': 'a73b9449-b261-4c62-b13c-b2c797730593', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:bb:ad:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '516c54ae-e378-44de-a7bf-14b9bb646228', 'device_owner': 'network:router_gateway', 'standard_attr_id': 362, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.92', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:23:29Z', 'updated_at': '2021-05-20T04:23:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_interfaces': [{'id': '1a9566c0-910b-4abb-b1c3-865c2789dc16', 'name': '', 'network_id': 'fc681196-7d83-4764-b760-89961b7ffe54', 'tenant_id': 'a588c51341504beda6a1803a15cc919c', 'mac_address': 'fa:16:3e:2b:7c:44', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '516c54ae-e378-44de-a7bf-14b9bb646228', 'device_owner': 'network:router_interface', 'standard_attr_id': 363, 'fixed_ips': [{'subnet_id': 'a34998b9-6684-4ced-a2bb-9b229ae96845', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:23:38Z', 'updated_at': '2021-05-20T04:23:46Z', 'revision_number': 4, 'project_id': 'a588c51341504beda6a1803a15cc919c', 'subnets': [{'id': 'a34998b9-6684-4ced-a2bb-9b229ae96845', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:23:50.020482 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b555ab05-6749-476e-b1c1-16bb4075baac None None] The sync data for ids ['516c54ae-e378-44de-a7bf-14b9bb646228'] in dv-cinder-790910-4-iscsi is: [{'id': '516c54ae-e378-44de-a7bf-14b9bb646228', 'name': 'tempest-TestMinimumBasicScenario-943774282-router', 'tenant_id': 'a588c51341504beda6a1803a15cc919c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.92'}], 'enable_snat': True}, 'gw_port_id': 'a73b9449-b261-4c62-b13c-b2c797730593', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:23:27Z', 'updated_at': '2021-05-20T04:23:40Z', 'revision_number': 4, 'project_id': 'a588c51341504beda6a1803a15cc919c', 'gw_port': {'id': 'a73b9449-b261-4c62-b13c-b2c797730593', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:bb:ad:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '516c54ae-e378-44de-a7bf-14b9bb646228', 'device_owner': 'network:router_gateway', 'standard_attr_id': 362, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.92', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:23:29Z', 'updated_at': '2021-05-20T04:23:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_interfaces': [{'id': '1a9566c0-910b-4abb-b1c3-865c2789dc16', 'name': '', 'network_id': 'fc681196-7d83-4764-b760-89961b7ffe54', 'tenant_id': 'a588c51341504beda6a1803a15cc919c', 'mac_address': 'fa:16:3e:2b:7c:44', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '516c54ae-e378-44de-a7bf-14b9bb646228', 'device_owner': 'network:router_interface', 'standard_attr_id': 363, 'fixed_ips': [{'subnet_id': 'a34998b9-6684-4ced-a2bb-9b229ae96845', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:23:38Z', 'updated_at': '2021-05-20T04:23:46Z', 'revision_number': 4, 'project_id': 'a588c51341504beda6a1803a15cc919c', 'subnets': [{'id': 'a34998b9-6684-4ced-a2bb-9b229ae96845', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91688) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 04:23:50.042861 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-9af795ca-9add-4c3a-a307-79af1358f1c1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:23:50.048689 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-9af795ca-9add-4c3a-a307-79af1358f1c1 admin admin] Usage tracker for resource:security_group_rule and tenant:3a53463f439b4d169302d132551cf4cd is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:23:50.052533 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-9af795ca-9add-4c3a-a307-79af1358f1c1 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:23:50.063195 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-9af795ca-9add-4c3a-a307-79af1358f1c1 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:23:50.082870 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78c0ad1a-770c-4507-a489-18acc76a09ef req-d702ad12-af79-4daf-955b-2decd2b22a31 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:50.091941 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-78c0ad1a-770c-4507-a489-18acc76a09ef req-d702ad12-af79-4daf-955b-2decd2b22a31 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=07157b0a-98fc-4f60-bd6f-f1fd5c17dbfa HTTP/1.1" status: 200  len: 943 time: 0.7949855
May 20 04:23:50.226742 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-18fd85f2-b085-4191-b532-997c180257cf admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:50.239064 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-261749fc-f0d6-4526-8e38-5f97a6d37a91 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:50.347562 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18fd85f2-b085-4191-b532-997c180257cf admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a6f587a7-e577-43d6-91f8-8ece790cfafb,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:50.374788 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-18fd85f2-b085-4191-b532-997c180257cf admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.130s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:50.388123 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-78c0ad1a-770c-4507-a489-18acc76a09ef req-20165b99-d69e-467d-89e2-9ee3fddf7f54 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2949867
May 20 04:23:50.407001 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-18fd85f2-b085-4191-b532-997c180257cf admin admin] Notify callbacks [] for security_group, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:50.408235 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-18fd85f2-b085-4191-b532-997c180257cf admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/a6f587a7-e577-43d6-91f8-8ece790cfafb HTTP/1.1" status: 204  len: 168 time: 0.7649412
May 20 04:23:50.417656 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-73bdb546-374b-40a8-ad3d-dfccf98ac0f0 req-d9c30621-2ac2-4384-9ee2-7efe782d31bc service neutron] 10.222.0.82 "GET /v2.0/networks/20ab5e30-591a-443a-9e34-f3a1b7563f5d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.6866403
May 20 04:23:50.727103 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-9af795ca-9add-4c3a-a307-79af1358f1c1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:50.743043 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-9af795ca-9add-4c3a-a307-79af1358f1c1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:50.751914 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-cd301e67-fb58-4f7e-bd44-e52cbeffea9c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:50.836113 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 1a9566c0-910b-4abb-b1c3-865c2789dc16 up at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:23:50.868635 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 39396) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:23:50.869955 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-9af795ca-9add-4c3a-a307-79af1358f1c1 admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=3a53463f439b4d169302d132551cf4cd&name=default HTTP/1.1" status: 200  len: 2979 time: 1.2569597
May 20 04:23:50.881656 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96de3290-9fff-4ead-b818-667769374fa7 req-f906c007-764d-4ed4-b5c1-fd05ca680d49 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:50.884771 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-96de3290-9fff-4ead-b818-667769374fa7 req-f906c007-764d-4ed4-b5c1-fd05ca680d49 service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=6484c55ce8204dc3802efc929a51c4a5&device_id=07157b0a-98fc-4f60-bd6f-f1fd5c17dbfa HTTP/1.1" status: 200  len: 1096 time: 0.3659217
May 20 04:23:50.890341 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9af795ca-9add-4c3a-a307-79af1358f1c1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1b7676f8-de02-4550-86b3-677dec184662,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:50.898598 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-9af795ca-9add-4c3a-a307-79af1358f1c1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.146s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:51.046536 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning for port 1a9566c0-910b-4abb-b1c3-865c2789dc16 completed by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:23:51.091479 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning complete for port 1a9566c0-910b-4abb-b1c3-865c2789dc16 triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:23:51.093855 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:51.111582 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-a1ba94c5-e2f9-4115-b8b6-ab8fe4c85cc8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:51.208153 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-a1ba94c5-e2f9-4115-b8b6-ab8fe4c85cc8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:51.414144 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-a1ba94c5-e2f9-4115-b8b6-ab8fe4c85cc8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:51.417726 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96de3290-9fff-4ead-b818-667769374fa7 req-cc91b22f-c8f4-4de7-8c51-ee883dc0fca0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:51.423992 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-96de3290-9fff-4ead-b818-667769374fa7 req-cc91b22f-c8f4-4de7-8c51-ee883dc0fca0 service neutron] 10.222.0.82 "GET /v2.0/networks?id=20ab5e30-591a-443a-9e34-f3a1b7563f5d HTTP/1.1" status: 200  len: 916 time: 0.5271640
May 20 04:23:51.445148 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-e8cec438-7d58-4b9e-a716-5d9f6335edd1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:51.488413 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1ba94c5-e2f9-4115-b8b6-ab8fe4c85cc8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1b7676f8-de02-4550-86b3-677dec184662,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:51.524355 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-a1ba94c5-e2f9-4115-b8b6-ab8fe4c85cc8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:51.526519 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-a1ba94c5-e2f9-4115-b8b6-ab8fe4c85cc8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:51.529034 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-a1ba94c5-e2f9-4115-b8b6-ab8fe4c85cc8 admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/1b7676f8-de02-4550-86b3-677dec184662 HTTP/1.1" status: 204  len: 168 time: 0.6585808
May 20 04:23:51.751642 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-96de3290-9fff-4ead-b818-667769374fa7 req-6e1211f0-2c3e-4999-a1bd-0b5d643b0fee service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=c84df5e2-cd07-4d01-87c9-ec3a35e2ad93 HTTP/1.1" status: 200  len: 217 time: 0.3193903
May 20 04:23:51.877549 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:52.032445 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96de3290-9fff-4ead-b818-667769374fa7 req-553f183b-49c7-4588-8b80-e9c6cf79758e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:52.034515 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-96de3290-9fff-4ead-b818-667769374fa7 req-553f183b-49c7-4588-8b80-e9c6cf79758e service neutron] 10.222.0.82 "GET /v2.0/subnets?id=2a9c681d-a9be-4897-91bb-31aeb6432254 HTTP/1.1" status: 200  len: 855 time: 0.2737923
May 20 04:23:52.036074 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] For port 1a9566c0-910b-4abb-b1c3-865c2789dc16, host dv-cinder-790910-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=1a9566c0-910b-4abb-b1c3-865c2789dc16,segment=NetworkSegment(f495c6da-d858-4d7b-a7ae-2c30d9f73111),segment_id=f495c6da-d858-4d7b-a7ae-2c30d9f73111)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:23:52.051294 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:52.064759 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-19075ce2-40cd-40b1-bc7b-0370a9bf5412 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:52.111093 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-96de3290-9fff-4ead-b818-667769374fa7 req-7c32c110-f489-4f48-a128-6dcdbce25b42 service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=20ab5e30-591a-443a-9e34-f3a1b7563f5d&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0662272
May 20 04:23:52.211968 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Pushing event updated for resources: {'Port': ['ID=1a9566c0-910b-4abb-b1c3-865c2789dc16,revision_number=5']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:52.222459 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.157s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:52.409547 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac4c7b87-7853-45af-8fe9-ee433e553740 req-89b2bfed-0698-459a-9b1b-d7a944d65293 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:52.419867 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-ac4c7b87-7853-45af-8fe9-ee433e553740 req-89b2bfed-0698-459a-9b1b-d7a944d65293 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=07157b0a-98fc-4f60-bd6f-f1fd5c17dbfa HTTP/1.1" status: 200  len: 943 time: 0.4473388
May 20 04:23:52.442936 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-96de3290-9fff-4ead-b818-667769374fa7 req-0fb08034-796f-4a72-be6c-5efe526b5eed service neutron] 10.222.0.82 "GET /v2.0/networks/20ab5e30-591a-443a-9e34-f3a1b7563f5d?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3201926
May 20 04:23:52.529951 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-ac4c7b87-7853-45af-8fe9-ee433e553740 req-cf4b041e-b4ad-4ce8-820b-c2e64d1dc24f tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1085498
May 20 04:23:52.824991 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-96de3290-9fff-4ead-b818-667769374fa7 req-9a03aef5-d13d-43a1-a6dc-1af50bfef4f3 service neutron] 10.222.0.82 "GET /v2.0/networks/20ab5e30-591a-443a-9e34-f3a1b7563f5d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3680060
May 20 04:23:52.858496 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 1a9566c0-910b-4abb-b1c3-865c2789dc16 up at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:23:53.036061 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning complete for port 1a9566c0-910b-4abb-b1c3-865c2789dc16 triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:23:53.036447 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:53.886091 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcff69be-9e8c-4d34-8d8c-62017961d6ec req-8b346a48-4f29-4cb4-b554-8f8fdccfe900 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:53.897239 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-bcff69be-9e8c-4d34-8d8c-62017961d6ec req-8b346a48-4f29-4cb4-b554-8f8fdccfe900 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=07157b0a-98fc-4f60-bd6f-f1fd5c17dbfa HTTP/1.1" status: 200  len: 943 time: 0.1550875
May 20 04:23:54.040562 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-bcff69be-9e8c-4d34-8d8c-62017961d6ec req-03dc667f-f576-452b-9d5c-e914a6a710ad tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1420224
May 20 04:23:54.059613 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c01601a-3e8f-4843-b6cd-7c3ed76bfb3c req-4bcd92e5-f44b-49dc-a4f4-f388a0512bdf tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:54.066673 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-7c01601a-3e8f-4843-b6cd-7c3ed76bfb3c req-4bcd92e5-f44b-49dc-a4f4-f388a0512bdf tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.5237768
May 20 04:23:54.185653 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-7c01601a-3e8f-4843-b6cd-7c3ed76bfb3c req-3ba84792-ecff-4417-893e-8e45c9ca580d tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1120579
May 20 04:23:54.831287 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 39514) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:23:54.913036 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device c84df5e2-cd07-4d01-87c9-ec3a35e2ad93 details requested by agent hyperv_hv-cinder-79091 with host hv-cinder-79091 {{(pid=91688) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 20 04:23:55.081053 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-8b76a888-93bc-4be0-ad6c-57f016c31113 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:55.169535 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-8b76a888-93bc-4be0-ad6c-57f016c31113 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:23:55.187790 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-8b76a888-93bc-4be0-ad6c-57f016c31113 admin admin] Usage tracker for resource:security_group_rule and tenant:93e3cfdf0b36423ba9d9d08d3054b745 is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:23:55.202828 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-8b76a888-93bc-4be0-ad6c-57f016c31113 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:23:55.214572 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-8b76a888-93bc-4be0-ad6c-57f016c31113 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:23:55.398551 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port c84df5e2-cd07-4d01-87c9-ec3a35e2ad93, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=c84df5e2-cd07-4d01-87c9-ec3a35e2ad93,segment=NetworkSegment(0ad1d987-000a-4092-8d15-811f90922b00),segment_id=0ad1d987-000a-4092-8d15-811f90922b00)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:23:55.439365 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Returning: {'device': 'c84df5e2-cd07-4d01-87c9-ec3a35e2ad93', 'network_id': '20ab5e30-591a-443a-9e34-f3a1b7563f5d', 'port_id': 'c84df5e2-cd07-4d01-87c9-ec3a35e2ad93', 'mac_address': 'fa:16:3e:74:cb:d7', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 876, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2a9c681d-a9be-4897-91bb-31aeb6432254', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91688) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 20 04:23:55.559482 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-8b76a888-93bc-4be0-ad6c-57f016c31113 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:55.575065 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-8b76a888-93bc-4be0-ad6c-57f016c31113 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:55.726109 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 39536) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:23:55.749323 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:55.763735 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-bf6b4424-34ec-44a8-b3c4-99d131ba17a8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.003s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:55.796489 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.notifiers.nova [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c84df5e2-cd07-4d01-87c9-ec3a35e2ad93 {{(pid=91688) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 04:23:55.848143 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port c84df5e2-cd07-4d01-87c9-ec3a35e2ad93, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=c84df5e2-cd07-4d01-87c9-ec3a35e2ad93,segment=NetworkSegment(0ad1d987-000a-4092-8d15-811f90922b00),segment_id=0ad1d987-000a-4092-8d15-811f90922b00)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:23:55.861684 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:55.866311 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:55.875793 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b76a888-93bc-4be0-ad6c-57f016c31113 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=64c89bea-b0e7-40cb-914e-e5a03a480d8b,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:55.901093 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 39542) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:23:55.906563 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-8b76a888-93bc-4be0-ad6c-57f016c31113 admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=93e3cfdf0b36423ba9d9d08d3054b745&name=default HTTP/1.1" status: 200  len: 2979 time: 1.0737448
May 20 04:23:55.915015 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-8b76a888-93bc-4be0-ad6c-57f016c31113 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.151s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:55.993597 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Pushing event updated for resources: {'Port': ['ID=c84df5e2-cd07-4d01-87c9-ec3a35e2ad93,revision_number=4']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:56.005137 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.135s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:56.049481 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30b8ee7f-1d57-493d-af52-29355cb95ef8 req-d407867b-05c9-4a0a-bd1c-4d61cde81d7b tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:56.051620 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-30b8ee7f-1d57-493d-af52-29355cb95ef8 req-d407867b-05c9-4a0a-bd1c-4d61cde81d7b tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=07157b0a-98fc-4f60-bd6f-f1fd5c17dbfa HTTP/1.1" status: 200  len: 943 time: 0.4844849
May 20 04:23:56.093896 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-3ea673ca-8b97-4f52-b502-37ee28f1fa53 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:56.114016 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-b18a6785-b5f3-4f4e-90d6-2f8b1bd16550 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:56.127007 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-30b8ee7f-1d57-493d-af52-29355cb95ef8 req-e47e6713-4472-4814-a4d9-1f7333ba9c01 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0650642
May 20 04:23:56.137831 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-3ea673ca-8b97-4f52-b502-37ee28f1fa53 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:23:56.156387 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-3ea673ca-8b97-4f52-b502-37ee28f1fa53 admin admin] Usage tracker for resource:security_group_rule and tenant:ad4e59dfb9b34a7791c8fa0e1b5feaf7 is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:23:56.160101 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-3ea673ca-8b97-4f52-b502-37ee28f1fa53 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:23:56.179738 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-3ea673ca-8b97-4f52-b502-37ee28f1fa53 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:23:56.187574 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-b18a6785-b5f3-4f4e-90d6-2f8b1bd16550 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:56.397609 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-b18a6785-b5f3-4f4e-90d6-2f8b1bd16550 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:56.409916 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-2bca636c-b2eb-4cc3-b788-87e936f035b4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:56.434949 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] get_ports_and_sgs() called for port_ids ['c84df5e2-cd07-4d01-87c9-ec3a35e2ad93'] {{(pid=91688) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 04:23:56.451301 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b18a6785-b5f3-4f4e-90d6-2f8b1bd16550 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=64c89bea-b0e7-40cb-914e-e5a03a480d8b,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:56.464365 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-b18a6785-b5f3-4f4e-90d6-2f8b1bd16550 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:56.475558 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-3ea673ca-8b97-4f52-b502-37ee28f1fa53 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:56.483466 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-3ea673ca-8b97-4f52-b502-37ee28f1fa53 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:56.539695 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:56.558387 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-3ea673ca-8b97-4f52-b502-37ee28f1fa53 admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=ad4e59dfb9b34a7791c8fa0e1b5feaf7&name=default HTTP/1.1" status: 200  len: 2979 time: 0.8303037
May 20 04:23:56.566450 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 39550) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:23:56.597619 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-b18a6785-b5f3-4f4e-90d6-2f8b1bd16550 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:56.602927 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-b18a6785-b5f3-4f4e-90d6-2f8b1bd16550 admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/64c89bea-b0e7-40cb-914e-e5a03a480d8b HTTP/1.1" status: 204  len: 168 time: 0.6962848
May 20 04:23:56.658285 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ea673ca-8b97-4f52-b502-37ee28f1fa53 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0cfae6ff-9e77-4ac1-ac71-4769a488d3cc,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:56.668538 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-3ea673ca-8b97-4f52-b502-37ee28f1fa53 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.129s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:56.746767 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-2f94c9a8-736b-4659-b1a5-3697f84a5da0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:56.839689 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-2f94c9a8-736b-4659-b1a5-3697f84a5da0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:56.948144 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.agents_db [None req-92d61f12-17bc-4bf9-9eab-8a69b8c6da2f None None] Agent healthcheck: found 6 active agents {{(pid=91689) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 04:23:57.016192 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-2f94c9a8-736b-4659-b1a5-3697f84a5da0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:57.021444 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-64a4ac52-30d1-4ff2-80b7-4ed2d81b7d23 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:57.078741 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f94c9a8-736b-4659-b1a5-3697f84a5da0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0cfae6ff-9e77-4ac1-ac71-4769a488d3cc,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:57.082862 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-2f94c9a8-736b-4659-b1a5-3697f84a5da0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:57.092341 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-2f94c9a8-736b-4659-b1a5-3697f84a5da0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:57.094204 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-2f94c9a8-736b-4659-b1a5-3697f84a5da0 admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/0cfae6ff-9e77-4ac1-ac71-4769a488d3cc HTTP/1.1" status: 204  len: 168 time: 0.5262983
May 20 04:23:57.455936 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2597bf0e-2e96-4da7-8e14-206f78b7129c req-f640abc2-ae86-4550-b639-d0dfeeac0834 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:57.472736 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-2597bf0e-2e96-4da7-8e14-206f78b7129c req-f640abc2-ae86-4550-b639-d0dfeeac0834 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=07157b0a-98fc-4f60-bd6f-f1fd5c17dbfa HTTP/1.1" status: 200  len: 944 time: 0.1394377
May 20 04:23:57.603630 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-2597bf0e-2e96-4da7-8e14-206f78b7129c req-92309536-0bb9-4e4c-be85-1963531350ee tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1280856
May 20 04:23:58.800359 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 39622) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:23:58.896371 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device c84df5e2-cd07-4d01-87c9-ec3a35e2ad93 up at agent hyperv_hv-cinder-79091 {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:23:58.940347 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-506042fc-da35-425b-9687-b4ca3a4a6b49 req-895d693a-11c7-4ea6-a329-26144ad4a73c tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:23:58.949758 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-506042fc-da35-425b-9687-b4ca3a4a6b49 req-895d693a-11c7-4ea6-a329-26144ad4a73c tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=07157b0a-98fc-4f60-bd6f-f1fd5c17dbfa HTTP/1.1" status: 200  len: 944 time: 0.1711206
May 20 04:23:59.009331 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-506042fc-da35-425b-9687-b4ca3a4a6b49 req-aff81248-47b1-4597-95af-c8b21e34a1a3 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0582519
May 20 04:23:59.121626 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [None req-e765311a-9423-4b14-82bd-260cf53842c7 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-1799598596-network', 'tenant_id': 'a1319e4a0fc74f98ba4bb88d8a04086b'}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:23:59.132210 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-e765311a-9423-4b14-82bd-260cf53842c7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:23:59.140105 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-e765311a-9423-4b14-82bd-260cf53842c7 admin admin] Usage tracker for resource:network and tenant:a1319e4a0fc74f98ba4bb88d8a04086b is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:23:59.154514 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-e765311a-9423-4b14-82bd-260cf53842c7 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:23:59.166060 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Provisioning for port c84df5e2-cd07-4d01-87c9-ec3a35e2ad93 completed by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:23:59.170776 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-e765311a-9423-4b14-82bd-260cf53842c7 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:23:59.179372 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Provisioning complete for port c84df5e2-cd07-4d01-87c9-ec3a35e2ad93 triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:23:59.181070 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:59.211946 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e765311a-9423-4b14-82bd-260cf53842c7 admin admin] Made reservation on behalf of a1319e4a0fc74f98ba4bb88d8a04086b for: {'network': 1} {{(pid=91687) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 04:23:59.227264 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-e765311a-9423-4b14-82bd-260cf53842c7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-578118'] for network, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:59.313819 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-e765311a-9423-4b14-82bd-260cf53842c7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:59.405781 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-e765311a-9423-4b14-82bd-260cf53842c7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:23:59.417541 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-e765311a-9423-4b14-82bd-260cf53842c7 admin admin] Usage tracker for resource:security_group_rule and tenant:a1319e4a0fc74f98ba4bb88d8a04086b is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:23:59.429134 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-e765311a-9423-4b14-82bd-260cf53842c7 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:23:59.443189 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-e765311a-9423-4b14-82bd-260cf53842c7 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:23:59.653062 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:59.659109 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-e765311a-9423-4b14-82bd-260cf53842c7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:59.681174 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-e765311a-9423-4b14-82bd-260cf53842c7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:59.695505 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-176bd93f-f0df-4e24-80a1-5b60f4a9dc8e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:59.748877 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '07157b0a-98fc-4f60-bd6f-f1fd5c17dbfa', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c84df5e2-cd07-4d01-87c9-ec3a35e2ad93'}] {{(pid=91688) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:23:59.773063 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port c84df5e2-cd07-4d01-87c9-ec3a35e2ad93, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=c84df5e2-cd07-4d01-87c9-ec3a35e2ad93,segment=NetworkSegment(0ad1d987-000a-4092-8d15-811f90922b00),segment_id=0ad1d987-000a-4092-8d15-811f90922b00)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:23:59.781736 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:59.784335 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:23:59.786653 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e765311a-9423-4b14-82bd-260cf53842c7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5caf5bf6-4479-4098-bb89-e9d1c971ca8a,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:23:59.795127 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-e765311a-9423-4b14-82bd-260cf53842c7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.101s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:23:59.822920 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e765311a-9423-4b14-82bd-260cf53842c7 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 880}  {{(pid=91687) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 20 04:23:59.868063 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-e765311a-9423-4b14-82bd-260cf53842c7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1501910'] for segment, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:23:59.868543 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.db.segments_db [None req-e765311a-9423-4b14-82bd-260cf53842c7 admin admin] Added segment e5874c72-d111-4955-a5aa-fbad5f078a34 of type vlan for network e31171ff-f097-446e-b691-bef7aad2fb3b
May 20 04:23:59.986207 dv-cinder-790910-4-iscsi neutron-server[91688]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '07157b0a-98fc-4f60-bd6f-f1fd5c17dbfa', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c84df5e2-cd07-4d01-87c9-ec3a35e2ad93', 'code': 200}
May 20 04:23:59.993435 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-e765311a-9423-4b14-82bd-260cf53842c7 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8782892092784'] for network, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:00.066407 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-e765311a-9423-4b14-82bd-260cf53842c7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1590664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1781430'] for network, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:00.077359 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e765311a-9423-4b14-82bd-260cf53842c7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:00.078897 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-e765311a-9423-4b14-82bd-260cf53842c7 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for network, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:00.106563 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:24:00.134955 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-7d4f851b-a993-4152-b90a-acd64b40f27b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:00.216667 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Pushing event updated for resources: {'Port': ['ID=c84df5e2-cd07-4d01-87c9-ec3a35e2ad93,revision_number=5']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:24:00.227960 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.443s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:24:00.643628 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 39654) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:24:00.655596 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.v2.base [None req-b6fd1a16-26ae-4eb4-ad56-4b37f13e55ce admin admin] Request body: {'subnet': {'network_id': 'e31171ff-f097-446e-b691-bef7aad2fb3b', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-1799598596-subnet', 'tenant_id': 'a1319e4a0fc74f98ba4bb88d8a04086b', 'ip_version': 4}} {{(pid=91686) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:24:00.657350 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-e765311a-9423-4b14-82bd-260cf53842c7 admin admin] 10.222.0.71 "POST /v2.0/networks HTTP/1.1" status: 201  len: 882 time: 1.8540337
May 20 04:24:00.672141 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-b6fd1a16-26ae-4eb4-ad56-4b37f13e55ce admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:24:00.686612 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-b6fd1a16-26ae-4eb4-ad56-4b37f13e55ce admin admin] Usage tracker for resource:subnet and tenant:a1319e4a0fc74f98ba4bb88d8a04086b is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:24:00.695709 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-b6fd1a16-26ae-4eb4-ad56-4b37f13e55ce admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:24:00.713502 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-b6fd1a16-26ae-4eb4-ad56-4b37f13e55ce admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:24:00.742331 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e765311a-9423-4b14-82bd-260cf53842c7 admin admin] Pushing event updated for resources: {'Network': ['ID=e31171ff-f097-446e-b691-bef7aad2fb3b,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:24:00.742715 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b6fd1a16-26ae-4eb4-ad56-4b37f13e55ce admin admin] Made reservation on behalf of a1319e4a0fc74f98ba4bb88d8a04086b for: {'subnet': 1} {{(pid=91686) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 04:24:00.747931 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-e765311a-9423-4b14-82bd-260cf53842c7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.643s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:24:00.749203 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-b6fd1a16-26ae-4eb4-ad56-4b37f13e55ce admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-2442182'] for subnet, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:00.756341 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Network e31171ff-f097-446e-b691-bef7aad2fb3b details requested by agent ovs-agent-dv-cinder-790910-4-iscsi with host dv-cinder-790910-4-iscsi {{(pid=91688) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 20 04:24:00.767661 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6899fd55-0346-4590-a51c-f0ba03465990 req-1ee35bdc-7812-42a7-a75f-1d8fe9d1bf05 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:00.769823 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-6899fd55-0346-4590-a51c-f0ba03465990 req-1ee35bdc-7812-42a7-a75f-1d8fe9d1bf05 service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=07157b0a-98fc-4f60-bd6f-f1fd5c17dbfa HTTP/1.1" status: 200  len: 1098 time: 0.4529772
May 20 04:24:00.829860 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42db2058-33cc-4fe4-a9b5-1f74dbd3d8ea req-61ce5da4-d560-4bad-8d43-bd7948eff666 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:00.837829 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-42db2058-33cc-4fe4-a9b5-1f74dbd3d8ea req-61ce5da4-d560-4bad-8d43-bd7948eff666 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=07157b0a-98fc-4f60-bd6f-f1fd5c17dbfa HTTP/1.1" status: 200  len: 945 time: 0.4531083
May 20 04:24:01.056699 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-42db2058-33cc-4fe4-a9b5-1f74dbd3d8ea req-877862c9-7c3c-4424-b368-3c509a9fa3ce tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2177298
May 20 04:24:01.106825 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-6899fd55-0346-4590-a51c-f0ba03465990 req-4ac3a33a-e35b-4861-93e6-f1a56ac6fcb3 service neutron] 10.222.0.82 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3289340
May 20 04:24:01.730629 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-b6fd1a16-26ae-4eb4-ad56-4b37f13e55ce admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-255887', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2114700', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-2442228'] for subnet, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:01.737531 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:24:01.825517 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6fd1a16-26ae-4eb4-ad56-4b37f13e55ce admin admin] Pushing event updated for resources: {'Subnet': ['ID=410f59de-055d-4298-96bf-5d9a7712368d,revision_number=0']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:24:01.830435 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-b6fd1a16-26ae-4eb4-ad56-4b37f13e55ce admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:24:01.838425 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b6fd1a16-26ae-4eb4-ad56-4b37f13e55ce admin admin] Checking segment: {'id': 'e5874c72-d111-4955-a5aa-fbad5f078a34', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': 'e31171ff-f097-446e-b691-bef7aad2fb3b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91686) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:24:01.838826 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b6fd1a16-26ae-4eb4-ad56-4b37f13e55ce admin admin] Network hostable DHCP agents. Network: e31171ff-f097-446e-b691-bef7aad2fb3b, hostable agents: ['36d27813-c368-4fd7-ae26-0f662e0a96fd'], hosted agents: [] {{(pid=91686) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 20 04:24:01.864345 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b6fd1a16-26ae-4eb4-ad56-4b37f13e55ce admin admin] Network e31171ff-f097-446e-b691-bef7aad2fb3b is scheduled to be hosted by DHCP agent 36d27813-c368-4fd7-ae26-0f662e0a96fd with binding_index 1 {{(pid=91686) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 20 04:24:01.876749 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.base_scheduler [None req-b6fd1a16-26ae-4eb4-ad56-4b37f13e55ce admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-790910-4-iscsi, e31171ff-f097-446e-b691-bef7aad2fb3b) {{(pid=91686) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:24:01.892417 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8760adda-a9e3-4d97-a59e-effa21493a4e None None] Network e31171ff-f097-446e-b691-bef7aad2fb3b requested from dv-cinder-790910-4-iscsi {{(pid=91688) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 04:24:01.895464 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b6fd1a16-26ae-4eb4-ad56-4b37f13e55ce admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:01.896162 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-b6fd1a16-26ae-4eb4-ad56-4b37f13e55ce admin admin] Notify callbacks [] for subnet, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:01.938265 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-b6fd1a16-26ae-4eb4-ad56-4b37f13e55ce admin admin] 10.222.0.71 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 845 time: 1.2910001
May 20 04:24:01.942237 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 39682) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:24:01.952336 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.v2.base [None req-0041ed67-7ce9-4377-8030-8f566be96be7 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-1799598596-router', 'tenant_id': 'a1319e4a0fc74f98ba4bb88d8a04086b', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90'}}} {{(pid=91686) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:24:01.958570 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-0041ed67-7ce9-4377-8030-8f566be96be7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:24:01.969769 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-0041ed67-7ce9-4377-8030-8f566be96be7 admin admin] Usage tracker for resource:router and tenant:a1319e4a0fc74f98ba4bb88d8a04086b is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:24:01.975393 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-0041ed67-7ce9-4377-8030-8f566be96be7 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:24:01.984305 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-0041ed67-7ce9-4377-8030-8f566be96be7 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:24:02.004494 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-0041ed67-7ce9-4377-8030-8f566be96be7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1796465', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-6255'] for router, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:02.005756 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-0041ed67-7ce9-4377-8030-8f566be96be7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1713009', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1713968', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1590966', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-6244'] for router, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:02.028672 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-0041ed67-7ce9-4377-8030-8f566be96be7 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:02.392716 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-32e43669-0933-43a9-94fa-9395e9758bc6 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpfbdc8e9b-5136-5478-8aa8-b0b6b9be0f90-e31171ff-f097-446e-b691-bef7aad2fb3b', 'network_id': 'e31171ff-f097-446e-b691-bef7aad2fb3b', 'tenant_id': 'a1319e4a0fc74f98ba4bb88d8a04086b', 'fixed_ips': [{'subnet_id': '410f59de-055d-4298-96bf-5d9a7712368d'}]}} from dv-cinder-790910-4-iscsi. {{(pid=91688) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 20 04:24:02.393669 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-32e43669-0933-43a9-94fa-9395e9758bc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_create {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:02.467081 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-0041ed67-7ce9-4377-8030-8f566be96be7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1713977', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1796355', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-6218'] for router, precommit_update {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:02.675107 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:02.779502 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f35da1e3-ec7e-4a50-a47e-adceff9efeef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:02.845757 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4941ecf3-be3c-46ff-83ce-02566f4e14f4 req-74201283-c18a-4248-9cd3-ad6103116978 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:02.861993 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4941ecf3-be3c-46ff-83ce-02566f4e14f4 req-74201283-c18a-4248-9cd3-ad6103116978 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=07157b0a-98fc-4f60-bd6f-f1fd5c17dbfa HTTP/1.1" status: 200  len: 945 time: 0.4045622
May 20 04:24:02.927097 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.db_base_plugin_common [None req-32e43669-0933-43a9-94fa-9395e9758bc6 None None] Allocated IP 172.20.0.2 (e31171ff-f097-446e-b691-bef7aad2fb3b/410f59de-055d-4298-96bf-5d9a7712368d/2e3c2da6-ee6a-4206-a46f-a624e7511262) {{(pid=91688) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 04:24:03.123775 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4941ecf3-be3c-46ff-83ce-02566f4e14f4 req-5bf189f7-76b9-4475-96f8-0c4d1e46a57f tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2589948
May 20 04:24:03.451986 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 39706) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:24:03.516257 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-32e43669-0933-43a9-94fa-9395e9758bc6 None None] Notify callbacks [] for port, precommit_create {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:03.518638 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-0041ed67-7ce9-4377-8030-8f566be96be7 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:03.548291 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-32e43669-0933-43a9-94fa-9395e9758bc6 None None] Transition to ACTIVE for port object 2e3c2da6-ee6a-4206-a46f-a624e7511262 will not be triggered until provisioned by entity L2. {{(pid=91688) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:24:03.622846 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-0041ed67-7ce9-4377-8030-8f566be96be7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:03.633988 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-32e43669-0933-43a9-94fa-9395e9758bc6 None None] Transition to ACTIVE for port object 2e3c2da6-ee6a-4206-a46f-a624e7511262 will not be triggered until provisioned by entity DHCP. {{(pid=91688) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:24:03.642062 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ea4803bd-878f-47d5-9084-1ec41953c9db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:03.680612 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-32e43669-0933-43a9-94fa-9395e9758bc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8782892106231'] for port, after_create {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:03.691776 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:24:03.734448 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:03.737591 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-cf582247-4fee-4469-93ea-4dbb87178c40 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:03.767687 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-32e43669-0933-43a9-94fa-9395e9758bc6 None None] Network e31171ff-f097-446e-b691-bef7aad2fb3b is already hosted by enough agents. {{(pid=91688) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:24:03.772402 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.scheduler.base_scheduler [None req-32e43669-0933-43a9-94fa-9395e9758bc6 None None] Resources bound (agent type, host, resource id):  {{(pid=91688) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:24:03.780775 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-32e43669-0933-43a9-94fa-9395e9758bc6 None None] Received port after_create {{(pid=91688) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 04:24:03.802797 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-cf582247-4fee-4469-93ea-4dbb87178c40 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:24:03.824469 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-cf582247-4fee-4469-93ea-4dbb87178c40 admin admin] Usage tracker for resource:security_group_rule and tenant:83b71d5686da4d48a6c263c9504fabe4 is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:24:03.836085 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-cf582247-4fee-4469-93ea-4dbb87178c40 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:24:03.899507 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-cf582247-4fee-4469-93ea-4dbb87178c40 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:24:03.926774 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32e43669-0933-43a9-94fa-9395e9758bc6 None None] Pushing event updated for resources: {'Port': ['ID=2e3c2da6-ee6a-4206-a46f-a624e7511262,revision_number=1']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:24:03.957970 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-32e43669-0933-43a9-94fa-9395e9758bc6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.266s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:24:04.137943 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.db_base_plugin_common [None req-0041ed67-7ce9-4377-8030-8f566be96be7 admin admin] Allocated IP 172.27.1.187 (aec557db-0c02-4008-8c9f-2efcd7462f90/217f4b55-4415-4d57-8b43-2ff4c8ac8e81/283f3ebf-83f3-4e30-ae78-4ec7e8841e26) {{(pid=91686) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 04:24:04.144430 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.managers [None req-32e43669-0933-43a9-94fa-9395e9758bc6 None None] Attempting to bind port 2e3c2da6-ee6a-4206-a46f-a624e7511262 on host dv-cinder-790910-4-iscsi for vnic_type normal with profile  {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 04:24:04.147025 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.managers [None req-32e43669-0933-43a9-94fa-9395e9758bc6 None None] Attempting to bind port 2e3c2da6-ee6a-4206-a46f-a624e7511262 by drivers openvswitch,hyperv on host dv-cinder-790910-4-iscsi at level 0 using segments [{'id': 'e5874c72-d111-4955-a5aa-fbad5f078a34', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': 'e31171ff-f097-446e-b691-bef7aad2fb3b'}] {{(pid=91688) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 04:24:04.148462 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-32e43669-0933-43a9-94fa-9395e9758bc6 None None] Attempting to bind port 2e3c2da6-ee6a-4206-a46f-a624e7511262 on network e31171ff-f097-446e-b691-bef7aad2fb3b {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:24:04.168389 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-32e43669-0933-43a9-94fa-9395e9758bc6 None None] Checking agent: {'id': '333121d4-1023-4a33-a54c-f4dd052e1612', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-790910-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 4, 13, 33), 'started_at': datetime.datetime(2021, 5, 20, 4, 14, 3), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 4, 24, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-790910-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 04:24:04.170200 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-32e43669-0933-43a9-94fa-9395e9758bc6 None None] Checking segment: {'id': 'e5874c72-d111-4955-a5aa-fbad5f078a34', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': 'e31171ff-f097-446e-b691-bef7aad2fb3b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91688) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:24:04.172159 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-32e43669-0933-43a9-94fa-9395e9758bc6 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:04.173845 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-32e43669-0933-43a9-94fa-9395e9758bc6 None None] Bound using segment: {'id': 'e5874c72-d111-4955-a5aa-fbad5f078a34', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': 'e31171ff-f097-446e-b691-bef7aad2fb3b'} {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 04:24:04.193133 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.managers [None req-32e43669-0933-43a9-94fa-9395e9758bc6 None None] Bound port: 2e3c2da6-ee6a-4206-a46f-a624e7511262, host: dv-cinder-790910-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e5874c72-d111-4955-a5aa-fbad5f078a34', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': 'e31171ff-f097-446e-b691-bef7aad2fb3b'}}] {{(pid=91688) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 04:24:04.194546 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-32e43669-0933-43a9-94fa-9395e9758bc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:04.247117 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-cf582247-4fee-4469-93ea-4dbb87178c40 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:04.257052 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-cf582247-4fee-4469-93ea-4dbb87178c40 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:04.350223 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-51daa051-2602-4bf6-85e1-71e5af2d2ff2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:24:04.478454 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-32e43669-0933-43a9-94fa-9395e9758bc6 None None] For port 2e3c2da6-ee6a-4206-a46f-a624e7511262, host dv-cinder-790910-4-iscsi, cleared binding levels {{(pid=91688) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 04:24:04.487647 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-32e43669-0933-43a9-94fa-9395e9758bc6 None None] For port 2e3c2da6-ee6a-4206-a46f-a624e7511262, host dv-cinder-790910-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=2e3c2da6-ee6a-4206-a46f-a624e7511262,segment=NetworkSegment(e5874c72-d111-4955-a5aa-fbad5f078a34),segment_id=e5874c72-d111-4955-a5aa-fbad5f078a34)] {{(pid=91688) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 04:24:04.493698 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-32e43669-0933-43a9-94fa-9395e9758bc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:04.507047 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:24:04.591604 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32e43669-0933-43a9-94fa-9395e9758bc6 None None] Pushing event updated for resources: {'Port': ['ID=2e3c2da6-ee6a-4206-a46f-a624e7511262,revision_number=2']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:24:04.597538 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-32e43669-0933-43a9-94fa-9395e9758bc6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:24:04.616171 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-cf582247-4fee-4469-93ea-4dbb87178c40 admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=83b71d5686da4d48a6c263c9504fabe4&name=default HTTP/1.1" status: 200  len: 2979 time: 1.1620321
May 20 04:24:04.621030 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-0041ed67-7ce9-4377-8030-8f566be96be7 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:04.634933 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 39724) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:24:04.637096 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf582247-4fee-4469-93ea-4dbb87178c40 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0e486425-a78a-4ee5-8d62-4b01fbf871ed,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:24:04.642381 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-cf582247-4fee-4469-93ea-4dbb87178c40 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.292s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:24:04.685355 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-0041ed67-7ce9-4377-8030-8f566be96be7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8782892106231', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2145052'] for port, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:04.710759 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-f28047f7-f002-47de-b08e-30c9d2c39970 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:24:04.754811 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-49590bdd-73dd-441d-98ab-582de0d39fd5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:04.793448 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-49590bdd-73dd-441d-98ab-582de0d39fd5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:04.894131 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-daa5b333-0465-4d5e-a6fe-486c78bc5408 req-91d89965-145c-4160-9b75-89a3393f0cbd tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:04.896218 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0041ed67-7ce9-4377-8030-8f566be96be7 admin admin] Network aec557db-0c02-4008-8c9f-2efcd7462f90 is already hosted by enough agents. {{(pid=91686) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:24:04.900107 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.base_scheduler [None req-0041ed67-7ce9-4377-8030-8f566be96be7 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91686) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:24:04.904948 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0041ed67-7ce9-4377-8030-8f566be96be7 admin admin] Received port after_create {{(pid=91686) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 04:24:04.905811 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-daa5b333-0465-4d5e-a6fe-486c78bc5408 req-91d89965-145c-4160-9b75-89a3393f0cbd tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=07157b0a-98fc-4f60-bd6f-f1fd5c17dbfa HTTP/1.1" status: 200  len: 945 time: 0.3904223
May 20 04:24:04.992021 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-49590bdd-73dd-441d-98ab-582de0d39fd5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:04.994833 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0041ed67-7ce9-4377-8030-8f566be96be7 admin admin] Pushing event updated for resources: {'Port': ['ID=283f3ebf-83f3-4e30-ae78-4ec7e8841e26,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:24:05.002377 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-43f22283-03a5-4492-8916-3f0b3b3abcba admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:24:05.010471 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-0041ed67-7ce9-4377-8030-8f566be96be7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.300s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:24:05.018913 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49590bdd-73dd-441d-98ab-582de0d39fd5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0e486425-a78a-4ee5-8d62-4b01fbf871ed,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:24:05.021742 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-49590bdd-73dd-441d-98ab-582de0d39fd5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:24:05.028840 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-daa5b333-0465-4d5e-a6fe-486c78bc5408 req-740e2474-3059-4649-b8a8-5f1d98e6e5a8 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1218829
May 20 04:24:05.035827 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-49590bdd-73dd-441d-98ab-582de0d39fd5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:05.036903 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-49590bdd-73dd-441d-98ab-582de0d39fd5 admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/0e486425-a78a-4ee5-8d62-4b01fbf871ed HTTP/1.1" status: 204  len: 168 time: 0.3966231
May 20 04:24:05.297562 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f21320cc-6a25-4ec1-8a32-8b119b35fd55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:06.453164 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-0041ed67-7ce9-4377-8030-8f566be96be7 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:06.570561 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e300cadc-b8c0-4c57-8346-b7892d07fcb9 None None] Network e31171ff-f097-446e-b691-bef7aad2fb3b requested from dv-cinder-790910-4-iscsi {{(pid=91688) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 04:24:07.027775 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 2e3c2da6-ee6a-4206-a46f-a624e7511262 up at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:24:07.180305 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-97df0352-c346-41c3-812b-ba4a6d3e7cf7 None None] Provisioning for port 2e3c2da6-ee6a-4206-a46f-a624e7511262 completed by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:24:07.400921 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning for port 2e3c2da6-ee6a-4206-a46f-a624e7511262 completed by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:24:07.411103 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning complete for port 2e3c2da6-ee6a-4206-a46f-a624e7511262 triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:24:07.411716 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:07.663421 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:07.716753 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] For port 2e3c2da6-ee6a-4206-a46f-a624e7511262, host dv-cinder-790910-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=2e3c2da6-ee6a-4206-a46f-a624e7511262,segment=NetworkSegment(e5874c72-d111-4955-a5aa-fbad5f078a34),segment_id=e5874c72-d111-4955-a5aa-fbad5f078a34)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:24:07.735337 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:07.740434 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:24:07.794426 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-0041ed67-7ce9-4377-8030-8f566be96be7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1796474', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1714058'] for router, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:07.865625 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Pushing event updated for resources: {'Port': ['ID=2e3c2da6-ee6a-4206-a46f-a624e7511262,revision_number=3']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:24:07.888404 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.148s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:24:07.949051 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f7c16ad-0e55-4b3a-89de-be53a22552f0 req-edd7cea4-6f43-4a33-82aa-9282d9f76249 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:07.951777 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-9f7c16ad-0e55-4b3a-89de-be53a22552f0 req-edd7cea4-6f43-4a33-82aa-9282d9f76249 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 1.3666277
May 20 04:24:08.060657 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-9f4c5331-47a4-42c7-8fb3-ad2cf6414d38 None None] Provisioning complete for port 2e3c2da6-ee6a-4206-a46f-a624e7511262 triggered by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:24:08.061828 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-9f4c5331-47a4-42c7-8fb3-ad2cf6414d38 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:08.100998 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-9f7c16ad-0e55-4b3a-89de-be53a22552f0 req-8288c3a9-4323-4722-90e8-f29d4638c5a2 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1244898
May 20 04:24:08.532430 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0041ed67-7ce9-4377-8030-8f566be96be7 admin admin] Router 093b6879-26f9-4912-a2fc-dab73a0df7cb is scheduled to L3 agent 02733fc0-fc9c-4e29-bc03-c27a792d539d with binding_index 1 {{(pid=91686) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 20 04:24:08.847535 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efeb07a5-7732-473b-8a10-26c80a965ce8 req-84a021dc-76fc-48d4-a3e9-668928c291f5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:08.852455 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-efeb07a5-7732-473b-8a10-26c80a965ce8 req-84a021dc-76fc-48d4-a3e9-668928c291f5 service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=b7d86d894a5f420e86f4c28d7772bd22&device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 1098 time: 0.2328498
May 20 04:24:08.915537 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 2e3c2da6-ee6a-4206-a46f-a624e7511262 up at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:24:09.168129 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0041ed67-7ce9-4377-8030-8f566be96be7 admin admin] Notify agent at l3_agent.dv-cinder-790910-4-iscsi the message routers_updated {{(pid=91686) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 04:24:09.179176 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning complete for port 2e3c2da6-ee6a-4206-a46f-a624e7511262 triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:24:09.179835 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:09.190605 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-637c0c8a-d0dc-4c9b-bfa2-f4a8616a0048 None None] Sync routers for ids ['093b6879-26f9-4912-a2fc-dab73a0df7cb'] in dv-cinder-790910-4-iscsi {{(pid=91689) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 04:24:09.246521 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efeb07a5-7732-473b-8a10-26c80a965ce8 req-2fe1173b-5cd5-478a-8f6b-bece775174ed service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:09.248560 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-efeb07a5-7732-473b-8a10-26c80a965ce8 req-2fe1173b-5cd5-478a-8f6b-bece775174ed service neutron] 10.222.0.82 "GET /v2.0/networks?id=348b2b0f-c826-45ab-ba85-8430235b9cac HTTP/1.1" status: 200  len: 920 time: 0.3886557
May 20 04:24:09.249238 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-637c0c8a-d0dc-4c9b-bfa2-f4a8616a0048 None None] Routers {'093b6879-26f9-4912-a2fc-dab73a0df7cb'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91689) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:24:09.250328 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-637c0c8a-d0dc-4c9b-bfa2-f4a8616a0048 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced1662dc0>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:24:03Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['093b6879-26f9-4912-a2fc-dab73a0df7cb'], 'active': True} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:24:09.277525 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-0041ed67-7ce9-4377-8030-8f566be96be7 admin admin] Notify callbacks [] for router, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:09.279528 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-0041ed67-7ce9-4377-8030-8f566be96be7 admin admin] 10.222.0.71 "POST /v2.0/routers HTTP/1.1" status: 201  len: 921 time: 7.3352821
May 20 04:24:09.292344 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 39800) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:24:09.583434 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-efeb07a5-7732-473b-8a10-26c80a965ce8 req-48c7c09b-3644-400a-8b92-38c74fc3b1f3 service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=65d523e1-f132-4819-aa42-995ded4a1ad8 HTTP/1.1" status: 200  len: 217 time: 0.3101404
May 20 04:24:09.909466 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dffc7588-9811-42bf-b7eb-3ec32b702433 req-bc29d83a-e0ef-43b4-ad25-4f1705fb6eef tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:09.928948 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-dffc7588-9811-42bf-b7eb-3ec32b702433 req-bc29d83a-e0ef-43b4-ad25-4f1705fb6eef tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.3423135
May 20 04:24:09.948775 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efeb07a5-7732-473b-8a10-26c80a965ce8 req-3349e5bb-68bb-4e5b-a359-266da0566c45 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:09.952322 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-efeb07a5-7732-473b-8a10-26c80a965ce8 req-3349e5bb-68bb-4e5b-a359-266da0566c45 service neutron] 10.222.0.82 "GET /v2.0/subnets?id=b488dc7d-0e70-4e52-9179-7e6c3e4fb0a1 HTTP/1.1" status: 200  len: 859 time: 0.2398438
May 20 04:24:10.133855 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvr_db [None req-637c0c8a-d0dc-4c9b-bfa2-f4a8616a0048 None None] Set router 093b6879-26f9-4912-a2fc-dab73a0df7cb gateway port host: dv-cinder-790910-4-iscsi {{(pid=91689) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:24:10.213659 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-efeb07a5-7732-473b-8a10-26c80a965ce8 req-8385ac5d-a504-4060-b516-f4944b176679 service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=348b2b0f-c826-45ab-ba85-8430235b9cac&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.2538073
May 20 04:24:10.639995 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-dffc7588-9811-42bf-b7eb-3ec32b702433 req-58ba08af-0b0d-4771-b770-6ece1533e122 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.6971891
May 20 04:24:10.717224 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-efeb07a5-7732-473b-8a10-26c80a965ce8 req-b35fd889-68a2-4522-a451-25445c9bd9f4 service neutron] 10.222.0.82 "GET /v2.0/networks/348b2b0f-c826-45ab-ba85-8430235b9cac?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4684277
May 20 04:24:10.970547 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-03e7c26f-7d2e-4047-815e-dd4016e30f08 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:11.141715 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-efeb07a5-7732-473b-8a10-26c80a965ce8 req-0de6e185-c1d3-42e3-95a0-eac27aecb6b1 service neutron] 10.222.0.82 "GET /v2.0/networks/348b2b0f-c826-45ab-ba85-8430235b9cac?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4148986
May 20 04:24:11.154636 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-637c0c8a-d0dc-4c9b-bfa2-f4a8616a0048 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced1662dc0>, [{'id': '093b6879-26f9-4912-a2fc-dab73a0df7cb', 'name': 'tempest-TestShelveInstance-1799598596-router', 'tenant_id': 'a1319e4a0fc74f98ba4bb88d8a04086b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.187'}], 'enable_snat': True}, 'gw_port_id': '283f3ebf-83f3-4e30-ae78-4ec7e8841e26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:24:02Z', 'updated_at': '2021-05-20T04:24:05Z', 'revision_number': 3, 'project_id': 'a1319e4a0fc74f98ba4bb88d8a04086b', 'gw_port': {'id': '283f3ebf-83f3-4e30-ae78-4ec7e8841e26', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:d2:40', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '093b6879-26f9-4912-a2fc-dab73a0df7cb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 395, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.187', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:24:03Z', 'updated_at': '2021-05-20T04:24:04Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi'}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:24:11.172944 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-637c0c8a-d0dc-4c9b-bfa2-f4a8616a0048 None None] Checking router: 093b6879-26f9-4912-a2fc-dab73a0df7cb for host: dv-cinder-790910-4-iscsi {{(pid=91689) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 04:24:11.173354 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-637c0c8a-d0dc-4c9b-bfa2-f4a8616a0048 None None] Updating router 093b6879-26f9-4912-a2fc-dab73a0df7cb port 283f3ebf-83f3-4e30-ae78-4ec7e8841e26 binding host dv-cinder-790910-4-iscsi {{(pid=91689) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 20 04:24:11.341203 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron_lib.callbacks.manager [None req-637c0c8a-d0dc-4c9b-bfa2-f4a8616a0048 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:11.559219 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.db_base_plugin_common [None req-03e7c26f-7d2e-4047-815e-dd4016e30f08 admin admin] Allocated IP 172.20.0.1 (e31171ff-f097-446e-b691-bef7aad2fb3b/410f59de-055d-4298-96bf-5d9a7712368d/a97d355e-c698-41a6-8ed6-aaec93b83e2a) {{(pid=91686) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 04:24:11.762074 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-03e7c26f-7d2e-4047-815e-dd4016e30f08 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:11.796268 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.provisioning_blocks [None req-03e7c26f-7d2e-4047-815e-dd4016e30f08 admin admin] Transition to ACTIVE for port object a97d355e-c698-41a6-8ed6-aaec93b83e2a will not be triggered until provisioned by entity DHCP. {{(pid=91686) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:24:11.826255 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron_lib.callbacks.manager [None req-637c0c8a-d0dc-4c9b-bfa2-f4a8616a0048 None None] Notify callbacks [] for port, precommit_update {{(pid=91689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:11.842568 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.provisioning_blocks [None req-637c0c8a-d0dc-4c9b-bfa2-f4a8616a0048 None None] Transition to ACTIVE for port object 283f3ebf-83f3-4e30-ae78-4ec7e8841e26 will not be triggered until provisioned by entity L2. {{(pid=91689) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:24:11.850645 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron_lib.callbacks.manager [None req-637c0c8a-d0dc-4c9b-bfa2-f4a8616a0048 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:11.855963 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG oslo_concurrency.lockutils [None req-11bf997e-acdf-4d42-a7ff-1c2f72a29d58 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:24:11.872018 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-03e7c26f-7d2e-4047-815e-dd4016e30f08 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8782892106231', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2145052'] for port, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:11.884410 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:24:11.923808 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8731d2b6-6443-4004-9381-96016b96d47c req-1053b922-2d0f-44b5-b39f-7ba367c4231f tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:11.933077 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.managers [None req-637c0c8a-d0dc-4c9b-bfa2-f4a8616a0048 None None] Attempting to bind port 283f3ebf-83f3-4e30-ae78-4ec7e8841e26 on host dv-cinder-790910-4-iscsi for vnic_type normal with profile  {{(pid=91689) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 04:24:11.933528 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.managers [None req-637c0c8a-d0dc-4c9b-bfa2-f4a8616a0048 None None] Attempting to bind port 283f3ebf-83f3-4e30-ae78-4ec7e8841e26 by drivers openvswitch,hyperv on host dv-cinder-790910-4-iscsi at level 0 using segments [{'id': '8df49ec5-3fb9-4715-bc9a-f4019a6b55f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90'}] {{(pid=91689) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 04:24:11.933825 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-637c0c8a-d0dc-4c9b-bfa2-f4a8616a0048 None None] Attempting to bind port 283f3ebf-83f3-4e30-ae78-4ec7e8841e26 on network aec557db-0c02-4008-8c9f-2efcd7462f90 {{(pid=91689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:24:11.938183 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-8731d2b6-6443-4004-9381-96016b96d47c req-1053b922-2d0f-44b5-b39f-7ba367c4231f tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/networks?id=fdf92998-25fa-4179-ab1b-131af0ce059a HTTP/1.1" status: 200  len: 815 time: 0.2797523
May 20 04:24:11.940197 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c2f4c9a-1e0f-43e2-9984-19c1b954e4d1 None None] Pushing event updated for resources: {'Port': ['ID=283f3ebf-83f3-4e30-ae78-4ec7e8841e26,revision_number=2']} {{(pid=91689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:24:11.944170 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG oslo_concurrency.lockutils [None req-2c2f4c9a-1e0f-43e2-9984-19c1b954e4d1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=91689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:24:11.945102 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-637c0c8a-d0dc-4c9b-bfa2-f4a8616a0048 None None] Checking agent: {'id': '333121d4-1023-4a33-a54c-f4dd052e1612', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-790910-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 4, 13, 33), 'started_at': datetime.datetime(2021, 5, 20, 4, 14, 3), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 4, 24, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-790910-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 04:24:11.945477 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-637c0c8a-d0dc-4c9b-bfa2-f4a8616a0048 None None] Checking segment: {'id': '8df49ec5-3fb9-4715-bc9a-f4019a6b55f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91689) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:24:11.945872 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron_lib.callbacks.manager [None req-637c0c8a-d0dc-4c9b-bfa2-f4a8616a0048 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:11.946251 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-637c0c8a-d0dc-4c9b-bfa2-f4a8616a0048 None None] Bound using segment: {'id': '8df49ec5-3fb9-4715-bc9a-f4019a6b55f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90'} {{(pid=91689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 04:24:11.947370 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.managers [None req-637c0c8a-d0dc-4c9b-bfa2-f4a8616a0048 None None] Bound port: 283f3ebf-83f3-4e30-ae78-4ec7e8841e26, host: dv-cinder-790910-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8df49ec5-3fb9-4715-bc9a-f4019a6b55f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90'}}] {{(pid=91689) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 04:24:11.947370 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron_lib.callbacks.manager [None req-637c0c8a-d0dc-4c9b-bfa2-f4a8616a0048 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:11.960067 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-03e7c26f-7d2e-4047-815e-dd4016e30f08 admin admin] Network e31171ff-f097-446e-b691-bef7aad2fb3b is already hosted by enough agents. {{(pid=91686) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:24:11.967717 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-8731d2b6-6443-4004-9381-96016b96d47c req-d011905f-3ddf-4419-9993-96f4ed06a0a2 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/quotas/e6fe6bea38b946a5a97ea42bf787f1b3 HTTP/1.1" status: 200  len: 375 time: 0.0279863
May 20 04:24:11.974095 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.base_scheduler [None req-03e7c26f-7d2e-4047-815e-dd4016e30f08 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91686) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:24:11.978680 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.l3_dvrscheduler_db [None req-03e7c26f-7d2e-4047-815e-dd4016e30f08 admin admin] Received port after_create {{(pid=91686) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 04:24:12.020367 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03e7c26f-7d2e-4047-815e-dd4016e30f08 admin admin] Pushing event updated for resources: {'Port': ['ID=a97d355e-c698-41a6-8ed6-aaec93b83e2a,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:24:12.035386 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-03e7c26f-7d2e-4047-815e-dd4016e30f08 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.151s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:24:12.049378 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.db [None req-637c0c8a-d0dc-4c9b-bfa2-f4a8616a0048 None None] For port 283f3ebf-83f3-4e30-ae78-4ec7e8841e26, host dv-cinder-790910-4-iscsi, cleared binding levels {{(pid=91689) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 04:24:12.057967 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.db [None req-637c0c8a-d0dc-4c9b-bfa2-f4a8616a0048 None None] For port 283f3ebf-83f3-4e30-ae78-4ec7e8841e26, host dv-cinder-790910-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=283f3ebf-83f3-4e30-ae78-4ec7e8841e26,segment=NetworkSegment(8df49ec5-3fb9-4715-bc9a-f4019a6b55f9),segment_id=8df49ec5-3fb9-4715-bc9a-f4019a6b55f9)] {{(pid=91689) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 04:24:12.066196 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron_lib.callbacks.manager [None req-637c0c8a-d0dc-4c9b-bfa2-f4a8616a0048 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:12.076702 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:24:12.081328 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8cca689-2c16-435c-8b1e-684d56500181 req-64d82457-1f1b-47e3-b971-a0d035ef0a4d tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:12.091042 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-a8cca689-2c16-435c-8b1e-684d56500181 req-64d82457-1f1b-47e3-b971-a0d035ef0a4d tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.2757018
May 20 04:24:12.113829 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-03e7c26f-7d2e-4047-815e-dd4016e30f08 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1716281'] for router_interface, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:12.128652 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-8731d2b6-6443-4004-9381-96016b96d47c req-682f08e7-2337-4241-92da-f05d216718bb tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?tenant_id=e6fe6bea38b946a5a97ea42bf787f1b3&fields=id HTTP/1.1" status: 200  len: 302 time: 0.1595120
May 20 04:24:12.149255 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c2f4c9a-1e0f-43e2-9984-19c1b954e4d1 None None] Pushing event updated for resources: {'Port': ['ID=283f3ebf-83f3-4e30-ae78-4ec7e8841e26,revision_number=3']} {{(pid=91689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:24:12.152847 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG oslo_concurrency.lockutils [None req-2c2f4c9a-1e0f-43e2-9984-19c1b954e4d1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=91689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:24:12.165882 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-637c0c8a-d0dc-4c9b-bfa2-f4a8616a0048 None None] Routers {'093b6879-26f9-4912-a2fc-dab73a0df7cb'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91689) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:24:12.166885 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-637c0c8a-d0dc-4c9b-bfa2-f4a8616a0048 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced1662dc0>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:24:03Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['093b6879-26f9-4912-a2fc-dab73a0df7cb'], 'active': True} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:24:12.249445 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-a8cca689-2c16-435c-8b1e-684d56500181 req-192882d0-8580-40d0-9ca5-7ff0516d5f61 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1531625
May 20 04:24:12.309072 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-8731d2b6-6443-4004-9381-96016b96d47c req-a3d4d188-38f7-4043-8cb2-03dac54b373b service neutron] 10.222.0.71 "GET /v2.0/networks/fdf92998-25fa-4179-ab1b-131af0ce059a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1768377
May 20 04:24:12.355152 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvr_db [None req-637c0c8a-d0dc-4c9b-bfa2-f4a8616a0048 None None] Set router 093b6879-26f9-4912-a2fc-dab73a0df7cb gateway port host: dv-cinder-790910-4-iscsi {{(pid=91689) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:24:12.355755 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-03b217d7-b6d4-4018-802e-f0d92c5e4b5e None None] Provisioning for port a97d355e-c698-41a6-8ed6-aaec93b83e2a completed by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:24:12.362397 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-03b217d7-b6d4-4018-802e-f0d92c5e4b5e None None] Provisioning complete for port a97d355e-c698-41a6-8ed6-aaec93b83e2a triggered by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:24:12.363974 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-03b217d7-b6d4-4018-802e-f0d92c5e4b5e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:12.453607 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-03e7c26f-7d2e-4047-815e-dd4016e30f08 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:12.527318 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-03b217d7-b6d4-4018-802e-f0d92c5e4b5e None None] Port a97d355e-c698-41a6-8ed6-aaec93b83e2a cannot update to ACTIVE because it is not bound. {{(pid=91688) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 20 04:24:12.575265 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-8731d2b6-6443-4004-9381-96016b96d47c req-31ac6e8f-257d-4124-9c4a-9d3f9eed3cec service neutron] 10.222.0.71 "GET /v2.0/networks/fdf92998-25fa-4179-ab1b-131af0ce059a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2580760
May 20 04:24:12.768414 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-03e7c26f-7d2e-4047-815e-dd4016e30f08 admin admin] Notify callbacks [] for port, precommit_update {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:12.776051 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-03e7c26f-7d2e-4047-815e-dd4016e30f08 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2145029'] for port, after_update {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:12.831978 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-aeb1e64d-3311-487d-9486-4ddea3c06c4c tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:24:12.867995 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-637c0c8a-d0dc-4c9b-bfa2-f4a8616a0048 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced1662dc0>, [{'id': '093b6879-26f9-4912-a2fc-dab73a0df7cb', 'name': 'tempest-TestShelveInstance-1799598596-router', 'tenant_id': 'a1319e4a0fc74f98ba4bb88d8a04086b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.187'}], 'enable_snat': True}, 'gw_port_id': '283f3ebf-83f3-4e30-ae78-4ec7e8841e26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:24:02Z', 'updated_at': '2021-05-20T04:24:05Z', 'revision_number': 3, 'project_id': 'a1319e4a0fc74f98ba4bb88d8a04086b', 'gw_port': {'id': '283f3ebf-83f3-4e30-ae78-4ec7e8841e26', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:d2:40', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '093b6879-26f9-4912-a2fc-dab73a0df7cb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 395, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.187', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:24:03Z', 'updated_at': '2021-05-20T04:24:12Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi'}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:24:12.874343 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-637c0c8a-d0dc-4c9b-bfa2-f4a8616a0048 None None] The sync data for ids ['093b6879-26f9-4912-a2fc-dab73a0df7cb'] in dv-cinder-790910-4-iscsi is: [{'id': '093b6879-26f9-4912-a2fc-dab73a0df7cb', 'name': 'tempest-TestShelveInstance-1799598596-router', 'tenant_id': 'a1319e4a0fc74f98ba4bb88d8a04086b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.187'}], 'enable_snat': True}, 'gw_port_id': '283f3ebf-83f3-4e30-ae78-4ec7e8841e26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:24:02Z', 'updated_at': '2021-05-20T04:24:05Z', 'revision_number': 3, 'project_id': 'a1319e4a0fc74f98ba4bb88d8a04086b', 'gw_port': {'id': '283f3ebf-83f3-4e30-ae78-4ec7e8841e26', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:d2:40', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '093b6879-26f9-4912-a2fc-dab73a0df7cb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 395, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.187', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:24:03Z', 'updated_at': '2021-05-20T04:24:12Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi'}] {{(pid=91689) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 04:24:13.064391 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [req-54c6676c-3a54-4623-8445-e8e2e81ad07f req-bbb87fa9-abda-41ee-b10f-11af74e03867 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Synchronizing usage tracker for tenant:e6fe6bea38b946a5a97ea42bf787f1b3 on resource:port {{(pid=91686) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:24:13.102504 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-03e7c26f-7d2e-4047-815e-dd4016e30f08 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1781412', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1716318'] for router_interface, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:13.113220 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [req-54c6676c-3a54-4623-8445-e8e2e81ad07f req-bbb87fa9-abda-41ee-b10f-11af74e03867 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Unset dirty status for tenant:e6fe6bea38b946a5a97ea42bf787f1b3 on resource:port {{(pid=91686) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:24:13.122061 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-54c6676c-3a54-4623-8445-e8e2e81ad07f req-bbb87fa9-abda-41ee-b10f-11af74e03867 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 210 time: 0.2919476
May 20 04:24:13.127712 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03e7c26f-7d2e-4047-815e-dd4016e30f08 admin admin] Pushing event updated for resources: {'Port': ['ID=a97d355e-c698-41a6-8ed6-aaec93b83e2a,revision_number=2']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:24:13.133310 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-03e7c26f-7d2e-4047-815e-dd4016e30f08 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.302s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:24:13.327329 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-03e7c26f-7d2e-4047-815e-dd4016e30f08 admin admin] Network e31171ff-f097-446e-b691-bef7aad2fb3b is already hosted by enough agents. {{(pid=91686) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:24:13.329185 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.base_scheduler [None req-03e7c26f-7d2e-4047-815e-dd4016e30f08 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91686) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:24:13.580639 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc8f7c3d-d4fb-4b97-98c5-9b31f9bdd33e req-edf0f349-27fc-4478-b19b-e8ae19d9679d tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:13.582981 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-bc8f7c3d-d4fb-4b97-98c5-9b31f9bdd33e req-edf0f349-27fc-4478-b19b-e8ae19d9679d tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.1484351
May 20 04:24:13.601821 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-03e7c26f-7d2e-4047-815e-dd4016e30f08 admin admin] Router 093b6879-26f9-4912-a2fc-dab73a0df7cb has already been hosted by L3 agent 02733fc0-fc9c-4e29-bc03-c27a792d539d {{(pid=91686) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 04:24:13.722863 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-bc8f7c3d-d4fb-4b97-98c5-9b31f9bdd33e req-6975650c-d9e8-417f-af99-1622a8f968bd tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1330726
May 20 04:24:13.774353 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-917b6708-6a05-4acb-80aa-aab4cd7cc891 None None] Provisioning complete for port a97d355e-c698-41a6-8ed6-aaec93b83e2a triggered by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:24:13.774959 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-917b6708-6a05-4acb-80aa-aab4cd7cc891 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:13.855138 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-917b6708-6a05-4acb-80aa-aab4cd7cc891 None None] Port a97d355e-c698-41a6-8ed6-aaec93b83e2a cannot update to ACTIVE because it is not bound. {{(pid=91688) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 20 04:24:13.890429 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-03e7c26f-7d2e-4047-815e-dd4016e30f08 admin admin] Notify agent at l3_agent.dv-cinder-790910-4-iscsi the message routers_updated {{(pid=91686) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 04:24:13.905065 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-03e7c26f-7d2e-4047-815e-dd4016e30f08 admin admin] 10.222.0.71 "PUT /v2.0/routers/093b6879-26f9-4912-a2fc-dab73a0df7cb/add_router_interface HTTP/1.1" status: 200  len: 503 time: 4.6070807
May 20 04:24:14.355730 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-00bb2ca0-233d-4a99-9a9f-b29748c9cb67 req-ebe1418b-11d9-4b9b-9874-8f17af4b8021 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 210 time: 0.0580671
May 20 04:24:14.447396 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8731d2b6-6443-4004-9381-96016b96d47c req-a3fea5d1-9019-443c-99d5-53a0f58daf30 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:14.447396 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-8731d2b6-6443-4004-9381-96016b96d47c req-a3fea5d1-9019-443c-99d5-53a0f58daf30 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.82 "GET /v2.0/networks?id=fdf92998-25fa-4179-ab1b-131af0ce059a HTTP/1.1" status: 200  len: 815 time: 0.2020159
May 20 04:24:14.463264 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [req-8731d2b6-6443-4004-9381-96016b96d47c req-b70d3868-2c68-40d2-a9f3-d266ac24b6f3 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Request body: {'port': {'device_id': 'badc13d9-1d9b-4a5d-a461-b96945f2edc9', 'network_id': 'fdf92998-25fa-4179-ab1b-131af0ce059a', 'admin_state_up': True, 'tenant_id': 'e6fe6bea38b946a5a97ea42bf787f1b3'}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:24:14.659066 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [req-8731d2b6-6443-4004-9381-96016b96d47c req-b70d3868-2c68-40d2-a9f3-d266ac24b6f3 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:24:14.669930 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [req-8731d2b6-6443-4004-9381-96016b96d47c req-b70d3868-2c68-40d2-a9f3-d266ac24b6f3 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:24:14.685839 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-8731d2b6-6443-4004-9381-96016b96d47c req-b70d3868-2c68-40d2-a9f3-d266ac24b6f3 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Made reservation on behalf of e6fe6bea38b946a5a97ea42bf787f1b3 for: {'port': 1} {{(pid=91687) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 04:24:14.692808 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-8731d2b6-6443-4004-9381-96016b96d47c req-b70d3868-2c68-40d2-a9f3-d266ac24b6f3 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:14.814414 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 39922) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:24:14.825353 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.v2.base [None req-28af7a2f-52bd-44c4-802b-e11cddc29fa4 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-292307318-network', 'tenant_id': '4bcdcc410bb7407eb15e956f1cf3816f'}} {{(pid=91686) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:24:14.850966 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-28af7a2f-52bd-44c4-802b-e11cddc29fa4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:24:14.857577 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-28af7a2f-52bd-44c4-802b-e11cddc29fa4 admin admin] Usage tracker for resource:network and tenant:4bcdcc410bb7407eb15e956f1cf3816f is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:24:14.861222 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-28af7a2f-52bd-44c4-802b-e11cddc29fa4 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:24:14.872799 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-28af7a2f-52bd-44c4-802b-e11cddc29fa4 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:24:14.913741 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 283f3ebf-83f3-4e30-ae78-4ec7e8841e26 up at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:24:14.914927 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-28af7a2f-52bd-44c4-802b-e11cddc29fa4 admin admin] Made reservation on behalf of 4bcdcc410bb7407eb15e956f1cf3816f for: {'network': 1} {{(pid=91686) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 04:24:14.920684 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-28af7a2f-52bd-44c4-802b-e11cddc29fa4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-578118'] for network, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:15.072034 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning for port 283f3ebf-83f3-4e30-ae78-4ec7e8841e26 completed by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:24:15.080653 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-28af7a2f-52bd-44c4-802b-e11cddc29fa4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:15.084125 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning complete for port 283f3ebf-83f3-4e30-ae78-4ec7e8841e26 triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:24:15.084932 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:15.121730 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-28af7a2f-52bd-44c4-802b-e11cddc29fa4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:24:15.130311 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-28af7a2f-52bd-44c4-802b-e11cddc29fa4 admin admin] Usage tracker for resource:security_group_rule and tenant:4bcdcc410bb7407eb15e956f1cf3816f is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:24:15.135884 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-28af7a2f-52bd-44c4-802b-e11cddc29fa4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:24:15.146859 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-28af7a2f-52bd-44c4-802b-e11cddc29fa4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:24:15.178230 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.db_base_plugin_common [req-8731d2b6-6443-4004-9381-96016b96d47c req-b70d3868-2c68-40d2-a9f3-d266ac24b6f3 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Allocated IP 172.20.0.5 (fdf92998-25fa-4179-ab1b-131af0ce059a/e905ed23-00d1-4991-b3bb-e1a1e32b4c86/11028190-b228-415d-b5ee-2da1d6800073) {{(pid=91687) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 04:24:15.200258 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2264d30e-638c-4b96-a583-6236d73d96d1 req-d287ad00-91b3-423d-b733-9373b66f024c tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:15.207694 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-2264d30e-638c-4b96-a583-6236d73d96d1 req-d287ad00-91b3-423d-b733-9373b66f024c tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.2196462
May 20 04:24:15.248250 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:15.256418 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f3ad71ea-83a8-4cb9-a1be-e9375318f01b None None] Sync routers for ids ['093b6879-26f9-4912-a2fc-dab73a0df7cb'] in dv-cinder-790910-4-iscsi {{(pid=91688) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 04:24:15.275320 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f3ad71ea-83a8-4cb9-a1be-e9375318f01b None None] Routers {'093b6879-26f9-4912-a2fc-dab73a0df7cb'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91688) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:24:15.276057 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-f3ad71ea-83a8-4cb9-a1be-e9375318f01b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced1553760>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:24:03Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['093b6879-26f9-4912-a2fc-dab73a0df7cb'], 'active': True} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:24:15.325159 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-2264d30e-638c-4b96-a583-6236d73d96d1 req-75f3bce2-bc6f-41ce-9bb8-584f0a8546d1 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1164172
May 20 04:24:15.356462 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] For port 283f3ebf-83f3-4e30-ae78-4ec7e8841e26, host dv-cinder-790910-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=283f3ebf-83f3-4e30-ae78-4ec7e8841e26,segment=NetworkSegment(8df49ec5-3fb9-4715-bc9a-f4019a6b55f9),segment_id=8df49ec5-3fb9-4715-bc9a-f4019a6b55f9)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:24:15.367347 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:15.372016 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:24:15.397341 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-28af7a2f-52bd-44c4-802b-e11cddc29fa4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:15.406238 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-28af7a2f-52bd-44c4-802b-e11cddc29fa4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:15.422466 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-28af7a2f-52bd-44c4-802b-e11cddc29fa4 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 863}  {{(pid=91686) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 20 04:24:15.433705 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-28af7a2f-52bd-44c4-802b-e11cddc29fa4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1501910'] for segment, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:15.434366 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.db.segments_db [None req-28af7a2f-52bd-44c4-802b-e11cddc29fa4 admin admin] Added segment 7409db9e-5fb3-453d-b7d4-3cbc720cb9d4 of type vlan for network 4bb43617-e5b5-4e08-aa62-fcff79192e08
May 20 04:24:15.447627 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Pushing event updated for resources: {'Port': ['ID=283f3ebf-83f3-4e30-ae78-4ec7e8841e26,revision_number=4']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:24:15.458825 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:24:15.461798 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:24:15.462702 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:24:15.463203 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:24:15.463857 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:24:15.464501 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:24:15.465030 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:24:15.466610 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:24:15.466610 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:24:15.466610 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:24:15.466610 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:24:15.467419 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:24:15.475064 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:24:15.479513 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-28af7a2f-52bd-44c4-802b-e11cddc29fa4 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8782892092784'] for network, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:15.482796 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-8731d2b6-6443-4004-9381-96016b96d47c req-b70d3868-2c68-40d2-a9f3-d266ac24b6f3 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Notify callbacks [] for port, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:15.488037 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-ec00d13b-0ba0-426b-92ee-17355c844128 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:24:15.508730 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.provisioning_blocks [req-8731d2b6-6443-4004-9381-96016b96d47c req-b70d3868-2c68-40d2-a9f3-d266ac24b6f3 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Transition to ACTIVE for port object 11028190-b228-415d-b5ee-2da1d6800073 will not be triggered until provisioned by entity DHCP. {{(pid=91687) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:24:15.536629 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-8731d2b6-6443-4004-9381-96016b96d47c req-b70d3868-2c68-40d2-a9f3-d266ac24b6f3 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8782892106231', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4162192'] for port, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:15.545346 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-e21289de-30fc-4017-9bee-726c32938eae tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:24:15.560452 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28af7a2f-52bd-44c4-802b-e11cddc29fa4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8be8071a-a46b-40d0-a979-8a6411da4342,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:24:15.587587 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28af7a2f-52bd-44c4-802b-e11cddc29fa4 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:24:15.590524 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28af7a2f-52bd-44c4-802b-e11cddc29fa4 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:24:15.591085 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28af7a2f-52bd-44c4-802b-e11cddc29fa4 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:24:15.591656 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28af7a2f-52bd-44c4-802b-e11cddc29fa4 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:24:15.592153 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28af7a2f-52bd-44c4-802b-e11cddc29fa4 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:24:15.592683 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28af7a2f-52bd-44c4-802b-e11cddc29fa4 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:24:15.593355 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28af7a2f-52bd-44c4-802b-e11cddc29fa4 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:24:15.593907 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28af7a2f-52bd-44c4-802b-e11cddc29fa4 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:24:15.594424 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28af7a2f-52bd-44c4-802b-e11cddc29fa4 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:24:15.594921 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28af7a2f-52bd-44c4-802b-e11cddc29fa4 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:24:15.595436 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28af7a2f-52bd-44c4-802b-e11cddc29fa4 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:24:15.595939 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28af7a2f-52bd-44c4-802b-e11cddc29fa4 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:24:15.600867 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-28af7a2f-52bd-44c4-802b-e11cddc29fa4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:24:15.604400 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvr_db [None req-f3ad71ea-83a8-4cb9-a1be-e9375318f01b None None] Set router 093b6879-26f9-4912-a2fc-dab73a0df7cb gateway port host: dv-cinder-790910-4-iscsi {{(pid=91688) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:24:15.607914 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-28af7a2f-52bd-44c4-802b-e11cddc29fa4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1590664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1781430'] for network, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:15.610351 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-28af7a2f-52bd-44c4-802b-e11cddc29fa4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:15.611377 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-28af7a2f-52bd-44c4-802b-e11cddc29fa4 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for network, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:15.619791 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:24:15.783929 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-8731d2b6-6443-4004-9381-96016b96d47c req-b70d3868-2c68-40d2-a9f3-d266ac24b6f3 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Network fdf92998-25fa-4179-ab1b-131af0ce059a is already hosted by enough agents. {{(pid=91687) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:24:15.802287 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.base_scheduler [req-8731d2b6-6443-4004-9381-96016b96d47c req-b70d3868-2c68-40d2-a9f3-d266ac24b6f3 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Resources bound (agent type, host, resource id):  {{(pid=91687) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:24:15.816020 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b70d3868-2c68-40d2-a9f3-d266ac24b6f3 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Pushing event updated for resources: {'Port': ['ID=11028190-b228-415d-b5ee-2da1d6800073,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:24:15.820211 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.l3_dvrscheduler_db [req-8731d2b6-6443-4004-9381-96016b96d47c req-b70d3868-2c68-40d2-a9f3-d266ac24b6f3 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Received port after_create {{(pid=91687) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 04:24:15.844197 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28af7a2f-52bd-44c4-802b-e11cddc29fa4 admin admin] Pushing event updated for resources: {'Network': ['ID=4bb43617-e5b5-4e08-aa62-fcff79192e08,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:24:15.852387 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-28af7a2f-52bd-44c4-802b-e11cddc29fa4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.233s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:24:15.863226 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b70d3868-2c68-40d2-a9f3-d266ac24b6f3 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:24:15.864075 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b70d3868-2c68-40d2-a9f3-d266ac24b6f3 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:24:15.864543 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b70d3868-2c68-40d2-a9f3-d266ac24b6f3 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:24:15.865234 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b70d3868-2c68-40d2-a9f3-d266ac24b6f3 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:24:15.865767 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b70d3868-2c68-40d2-a9f3-d266ac24b6f3 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:24:15.866240 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b70d3868-2c68-40d2-a9f3-d266ac24b6f3 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:24:15.866909 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b70d3868-2c68-40d2-a9f3-d266ac24b6f3 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:24:15.867252 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b70d3868-2c68-40d2-a9f3-d266ac24b6f3 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:24:15.867624 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b70d3868-2c68-40d2-a9f3-d266ac24b6f3 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:24:15.868027 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b70d3868-2c68-40d2-a9f3-d266ac24b6f3 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:24:15.869037 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b70d3868-2c68-40d2-a9f3-d266ac24b6f3 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:24:15.869037 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b70d3868-2c68-40d2-a9f3-d266ac24b6f3 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:24:15.874173 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-b70d3868-2c68-40d2-a9f3-d266ac24b6f3 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.329s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:24:15.878828 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 39950) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:24:15.892263 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-28af7a2f-52bd-44c4-802b-e11cddc29fa4 admin admin] 10.222.0.71 "POST /v2.0/networks HTTP/1.1" status: 201  len: 881 time: 1.0756238
May 20 04:24:15.894201 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [None req-11dffdf8-10ce-46f5-b839-13ea66ff8dd1 admin admin] Request body: {'subnet': {'network_id': '4bb43617-e5b5-4e08-aa62-fcff79192e08', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-292307318-subnet', 'tenant_id': '4bcdcc410bb7407eb15e956f1cf3816f', 'ip_version': 4}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:24:15.899204 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Network 4bb43617-e5b5-4e08-aa62-fcff79192e08 details requested by agent ovs-agent-dv-cinder-790910-4-iscsi with host dv-cinder-790910-4-iscsi {{(pid=91688) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 20 04:24:15.924031 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-11dffdf8-10ce-46f5-b839-13ea66ff8dd1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:24:15.936712 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-11dffdf8-10ce-46f5-b839-13ea66ff8dd1 admin admin] Usage tracker for resource:subnet and tenant:4bcdcc410bb7407eb15e956f1cf3816f is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:24:15.943291 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-11dffdf8-10ce-46f5-b839-13ea66ff8dd1 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:24:15.959825 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-11dffdf8-10ce-46f5-b839-13ea66ff8dd1 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:24:15.989783 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8731d2b6-6443-4004-9381-96016b96d47c req-b70d3868-2c68-40d2-a9f3-d266ac24b6f3 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:15.990604 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-8731d2b6-6443-4004-9381-96016b96d47c req-b70d3868-2c68-40d2-a9f3-d266ac24b6f3 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for port, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:16.013932 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-922dd1f7-692d-4dfb-a9d8-95cf88ec1165 req-1efd6abe-dee9-4477-bfdf-245d3a81b32c tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:16.022325 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-922dd1f7-692d-4dfb-a9d8-95cf88ec1165 req-1efd6abe-dee9-4477-bfdf-245d3a81b32c tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 931 time: 0.3109725
May 20 04:24:16.082317 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-11dffdf8-10ce-46f5-b839-13ea66ff8dd1 admin admin] Made reservation on behalf of 4bcdcc410bb7407eb15e956f1cf3816f for: {'subnet': 1} {{(pid=91687) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 04:24:16.085705 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-11dffdf8-10ce-46f5-b839-13ea66ff8dd1 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-692271'] for subnet, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:16.126788 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-f3ad71ea-83a8-4cb9-a1be-e9375318f01b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced1553760>, [{'id': '093b6879-26f9-4912-a2fc-dab73a0df7cb', 'name': 'tempest-TestShelveInstance-1799598596-router', 'tenant_id': 'a1319e4a0fc74f98ba4bb88d8a04086b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.187'}], 'enable_snat': True}, 'gw_port_id': '283f3ebf-83f3-4e30-ae78-4ec7e8841e26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:24:02Z', 'updated_at': '2021-05-20T04:24:12Z', 'revision_number': 4, 'project_id': 'a1319e4a0fc74f98ba4bb88d8a04086b', 'gw_port': {'id': '283f3ebf-83f3-4e30-ae78-4ec7e8841e26', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:d2:40', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '093b6879-26f9-4912-a2fc-dab73a0df7cb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 395, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.187', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:24:03Z', 'updated_at': '2021-05-20T04:24:12Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_interfaces': [{'id': 'a97d355e-c698-41a6-8ed6-aaec93b83e2a', 'name': '', 'network_id': 'e31171ff-f097-446e-b691-bef7aad2fb3b', 'tenant_id': 'a1319e4a0fc74f98ba4bb88d8a04086b', 'mac_address': 'fa:16:3e:8e:5a:42', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '093b6879-26f9-4912-a2fc-dab73a0df7cb', 'device_owner': 'network:router_interface', 'standard_attr_id': 401, 'fixed_ips': [{'subnet_id': '410f59de-055d-4298-96bf-5d9a7712368d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:24:11Z', 'updated_at': '2021-05-20T04:24:12Z', 'revision_number': 2, 'project_id': 'a1319e4a0fc74f98ba4bb88d8a04086b', 'subnets': [{'id': '410f59de-055d-4298-96bf-5d9a7712368d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:24:16.131697 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f3ad71ea-83a8-4cb9-a1be-e9375318f01b None None] Checking router: 093b6879-26f9-4912-a2fc-dab73a0df7cb for host: dv-cinder-790910-4-iscsi {{(pid=91688) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 04:24:16.132143 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f3ad71ea-83a8-4cb9-a1be-e9375318f01b None None] Updating router 093b6879-26f9-4912-a2fc-dab73a0df7cb port a97d355e-c698-41a6-8ed6-aaec93b83e2a binding host dv-cinder-790910-4-iscsi {{(pid=91688) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 20 04:24:16.143402 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-922dd1f7-692d-4dfb-a9d8-95cf88ec1165 req-840ff4fb-d05a-4160-8466-e35fec876be5 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1195288
May 20 04:24:16.194184 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-8731d2b6-6443-4004-9381-96016b96d47c req-b70d3868-2c68-40d2-a9f3-d266ac24b6f3 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.7376876
May 20 04:24:16.210828 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-27cd3175-eda2-4776-88c1-e8df35961a36 None None] Provisioning for port 11028190-b228-415d-b5ee-2da1d6800073 completed by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:24:16.213870 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f3ad71ea-83a8-4cb9-a1be-e9375318f01b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:16.227435 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-27cd3175-eda2-4776-88c1-e8df35961a36 None None] Provisioning complete for port 11028190-b228-415d-b5ee-2da1d6800073 triggered by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:24:16.227841 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-27cd3175-eda2-4776-88c1-e8df35961a36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:16.329714 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-27cd3175-eda2-4776-88c1-e8df35961a36 None None] Port 11028190-b228-415d-b5ee-2da1d6800073 cannot update to ACTIVE because it is not bound. {{(pid=91688) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 20 04:24:16.564221 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ceb6a79-a9ee-4455-87ff-db886b79a270 req-3b2ed539-37e5-4a62-b55e-b4ac460e5081 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:16.565705 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-1ceb6a79-a9ee-4455-87ff-db886b79a270 req-3b2ed539-37e5-4a62-b55e-b4ac460e5081 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.1121402
May 20 04:24:16.656101 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-1ceb6a79-a9ee-4455-87ff-db886b79a270 req-264d8d2c-50c9-4926-96e4-848dd842e566 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0835974
May 20 04:24:16.658498 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f3ad71ea-83a8-4cb9-a1be-e9375318f01b None None] Notify callbacks [] for port, precommit_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:16.661364 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-11dffdf8-10ce-46f5-b839-13ea66ff8dd1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-255887', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-4160768', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-692253'] for subnet, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:16.666762 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-8b132c02-8fa5-4fa4-8caf-965e8f1b4386 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:24:16.676671 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-f3ad71ea-83a8-4cb9-a1be-e9375318f01b None None] Transition to ACTIVE for port object a97d355e-c698-41a6-8ed6-aaec93b83e2a will not be triggered until provisioned by entity L2. {{(pid=91688) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:24:16.691247 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f3ad71ea-83a8-4cb9-a1be-e9375318f01b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:16.698915 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:24:16.748853 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11dffdf8-10ce-46f5-b839-13ea66ff8dd1 admin admin] Pushing event updated for resources: {'Subnet': ['ID=7ed199e2-8424-415a-b375-501cfccc5d60,revision_number=0']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:24:16.754706 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-11dffdf8-10ce-46f5-b839-13ea66ff8dd1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:24:16.762238 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-11dffdf8-10ce-46f5-b839-13ea66ff8dd1 admin admin] Checking segment: {'id': '7409db9e-5fb3-453d-b7d4-3cbc720cb9d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 863, 'network_id': '4bb43617-e5b5-4e08-aa62-fcff79192e08'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91687) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:24:16.762598 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-11dffdf8-10ce-46f5-b839-13ea66ff8dd1 admin admin] Network hostable DHCP agents. Network: 4bb43617-e5b5-4e08-aa62-fcff79192e08, hostable agents: ['36d27813-c368-4fd7-ae26-0f662e0a96fd'], hosted agents: [] {{(pid=91687) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 20 04:24:16.791559 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-11dffdf8-10ce-46f5-b839-13ea66ff8dd1 admin admin] Network 4bb43617-e5b5-4e08-aa62-fcff79192e08 is scheduled to be hosted by DHCP agent 36d27813-c368-4fd7-ae26-0f662e0a96fd with binding_index 1 {{(pid=91687) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 20 04:24:16.807053 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.base_scheduler [None req-11dffdf8-10ce-46f5-b839-13ea66ff8dd1 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-790910-4-iscsi, 4bb43617-e5b5-4e08-aa62-fcff79192e08) {{(pid=91687) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:24:16.816702 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-11dffdf8-10ce-46f5-b839-13ea66ff8dd1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:16.817438 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-11dffdf8-10ce-46f5-b839-13ea66ff8dd1 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for subnet, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:16.843951 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-064c3d03-a2cc-435b-a91a-ea2af3124da2 None None] Network 4bb43617-e5b5-4e08-aa62-fcff79192e08 requested from dv-cinder-790910-4-iscsi {{(pid=91688) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 04:24:16.862166 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-11dffdf8-10ce-46f5-b839-13ea66ff8dd1 admin admin] 10.222.0.71 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 844 time: 0.9797163
May 20 04:24:16.862740 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 39964) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:24:16.868906 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [None req-5829cef5-8cdd-4e4d-a533-c1c6f2d38399 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-292307318-router', 'tenant_id': '4bcdcc410bb7407eb15e956f1cf3816f', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90'}}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:24:16.875006 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-5829cef5-8cdd-4e4d-a533-c1c6f2d38399 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:24:16.879930 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-5829cef5-8cdd-4e4d-a533-c1c6f2d38399 admin admin] Usage tracker for resource:router and tenant:4bcdcc410bb7407eb15e956f1cf3816f is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:24:16.883884 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-5829cef5-8cdd-4e4d-a533-c1c6f2d38399 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:24:16.891697 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-5829cef5-8cdd-4e4d-a533-c1c6f2d38399 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:24:16.895152 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 283f3ebf-83f3-4e30-ae78-4ec7e8841e26 up at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:24:16.904937 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-5829cef5-8cdd-4e4d-a533-c1c6f2d38399 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1796465', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-6255'] for router, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:16.906156 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-5829cef5-8cdd-4e4d-a533-c1c6f2d38399 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1713009', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1713968', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1590966', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-6244'] for router, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:16.926908 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-5829cef5-8cdd-4e4d-a533-c1c6f2d38399 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:16.996090 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0be21ee8-33df-4171-a4b0-f09b552bb024 None None] Pushing event updated for resources: {'Port': ['ID=a97d355e-c698-41a6-8ed6-aaec93b83e2a,revision_number=3']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:24:17.046871 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-0be21ee8-33df-4171-a4b0-f09b552bb024 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.348s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:24:17.196039 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning complete for port 283f3ebf-83f3-4e30-ae78-4ec7e8841e26 triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:24:17.197137 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:17.242686 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-5829cef5-8cdd-4e4d-a533-c1c6f2d38399 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1713977', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1796355', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-6218'] for router, precommit_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:17.279203 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.managers [None req-f3ad71ea-83a8-4cb9-a1be-e9375318f01b None None] Attempting to bind port a97d355e-c698-41a6-8ed6-aaec93b83e2a on host dv-cinder-790910-4-iscsi for vnic_type normal with profile  {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 04:24:17.279804 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.managers [None req-f3ad71ea-83a8-4cb9-a1be-e9375318f01b None None] Attempting to bind port a97d355e-c698-41a6-8ed6-aaec93b83e2a by drivers openvswitch,hyperv on host dv-cinder-790910-4-iscsi at level 0 using segments [{'id': 'e5874c72-d111-4955-a5aa-fbad5f078a34', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': 'e31171ff-f097-446e-b691-bef7aad2fb3b'}] {{(pid=91688) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 04:24:17.280399 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f3ad71ea-83a8-4cb9-a1be-e9375318f01b None None] Attempting to bind port a97d355e-c698-41a6-8ed6-aaec93b83e2a on network e31171ff-f097-446e-b691-bef7aad2fb3b {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:24:17.328935 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f3ad71ea-83a8-4cb9-a1be-e9375318f01b None None] Checking agent: {'id': '333121d4-1023-4a33-a54c-f4dd052e1612', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-790910-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 4, 13, 33), 'started_at': datetime.datetime(2021, 5, 20, 4, 14, 3), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 4, 24, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-790910-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 04:24:17.330457 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f3ad71ea-83a8-4cb9-a1be-e9375318f01b None None] Checking segment: {'id': 'e5874c72-d111-4955-a5aa-fbad5f078a34', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': 'e31171ff-f097-446e-b691-bef7aad2fb3b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91688) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:24:17.331373 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f3ad71ea-83a8-4cb9-a1be-e9375318f01b None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:17.332288 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f3ad71ea-83a8-4cb9-a1be-e9375318f01b None None] Bound using segment: {'id': 'e5874c72-d111-4955-a5aa-fbad5f078a34', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': 'e31171ff-f097-446e-b691-bef7aad2fb3b'} {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 04:24:17.333383 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.managers [None req-f3ad71ea-83a8-4cb9-a1be-e9375318f01b None None] Bound port: a97d355e-c698-41a6-8ed6-aaec93b83e2a, host: dv-cinder-790910-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e5874c72-d111-4955-a5aa-fbad5f078a34', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': 'e31171ff-f097-446e-b691-bef7aad2fb3b'}}] {{(pid=91688) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 04:24:17.334278 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f3ad71ea-83a8-4cb9-a1be-e9375318f01b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:17.503779 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7125e757-4ce2-4df8-af6e-717cc391e6d9 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpfbdc8e9b-5136-5478-8aa8-b0b6b9be0f90-4bb43617-e5b5-4e08-aa62-fcff79192e08', 'network_id': '4bb43617-e5b5-4e08-aa62-fcff79192e08', 'tenant_id': '4bcdcc410bb7407eb15e956f1cf3816f', 'fixed_ips': [{'subnet_id': '7ed199e2-8424-415a-b375-501cfccc5d60'}]}} from dv-cinder-790910-4-iscsi. {{(pid=91688) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 20 04:24:17.504595 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-7125e757-4ce2-4df8-af6e-717cc391e6d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_create {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:17.625670 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c5c930a-8a50-4771-9c7c-6989d8f1311d req-3487b2ef-d90b-4106-9585-659416c3fc8c tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:17.626395 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-5c5c930a-8a50-4771-9c7c-6989d8f1311d req-3487b2ef-d90b-4106-9585-659416c3fc8c tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Synchronizing usage tracker for tenant:e6fe6bea38b946a5a97ea42bf787f1b3 on resource:port {{(pid=91687) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:24:17.640991 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-f3ad71ea-83a8-4cb9-a1be-e9375318f01b None None] For port a97d355e-c698-41a6-8ed6-aaec93b83e2a, host dv-cinder-790910-4-iscsi, cleared binding levels {{(pid=91688) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 04:24:17.695377 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-f3ad71ea-83a8-4cb9-a1be-e9375318f01b None None] For port a97d355e-c698-41a6-8ed6-aaec93b83e2a, host dv-cinder-790910-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=a97d355e-c698-41a6-8ed6-aaec93b83e2a,segment=NetworkSegment(e5874c72-d111-4955-a5aa-fbad5f078a34),segment_id=e5874c72-d111-4955-a5aa-fbad5f078a34)] {{(pid=91688) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 04:24:17.708566 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f3ad71ea-83a8-4cb9-a1be-e9375318f01b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:17.714948 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:24:17.791565 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-5c5c930a-8a50-4771-9c7c-6989d8f1311d req-3487b2ef-d90b-4106-9585-659416c3fc8c tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Unset dirty status for tenant:e6fe6bea38b946a5a97ea42bf787f1b3 on resource:port {{(pid=91687) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:24:17.792717 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-5c5c930a-8a50-4771-9c7c-6989d8f1311d req-3487b2ef-d90b-4106-9585-659416c3fc8c tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 931 time: 0.3927319
May 20 04:24:17.799683 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-5829cef5-8cdd-4e4d-a533-c1c6f2d38399 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:17.834397 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-5829cef5-8cdd-4e4d-a533-c1c6f2d38399 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:17.854828 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f3ad71ea-83a8-4cb9-a1be-e9375318f01b None None] Routers {'093b6879-26f9-4912-a2fc-dab73a0df7cb'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91688) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:24:17.855464 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-f3ad71ea-83a8-4cb9-a1be-e9375318f01b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced1553760>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:24:03Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['093b6879-26f9-4912-a2fc-dab73a0df7cb'], 'active': True} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:24:17.911234 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0be21ee8-33df-4171-a4b0-f09b552bb024 None None] Pushing event updated for resources: {'Port': ['ID=a97d355e-c698-41a6-8ed6-aaec93b83e2a,revision_number=4']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:24:17.914943 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.db_base_plugin_common [None req-7125e757-4ce2-4df8-af6e-717cc391e6d9 None None] Allocated IP 172.20.0.2 (4bb43617-e5b5-4e08-aa62-fcff79192e08/7ed199e2-8424-415a-b375-501cfccc5d60/65fa81fb-51bd-4b50-b2a8-68d472455252) {{(pid=91688) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 04:24:17.922832 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-0be21ee8-33df-4171-a4b0-f09b552bb024 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.207s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:24:17.942798 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-5c5c930a-8a50-4771-9c7c-6989d8f1311d req-8aa9287a-7ee5-4e70-8824-1369fbb8c277 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1098733
May 20 04:24:18.029369 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.db_base_plugin_common [None req-5829cef5-8cdd-4e4d-a533-c1c6f2d38399 admin admin] Allocated IP 172.27.1.238 (aec557db-0c02-4008-8c9f-2efcd7462f90/217f4b55-4415-4d57-8b43-2ff4c8ac8e81/18fb2347-22cb-4478-9bc6-8008249183c5) {{(pid=91687) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 04:24:18.153990 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvr_db [None req-f3ad71ea-83a8-4cb9-a1be-e9375318f01b None None] Set router 093b6879-26f9-4912-a2fc-dab73a0df7cb gateway port host: dv-cinder-790910-4-iscsi {{(pid=91688) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:24:18.245052 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-5829cef5-8cdd-4e4d-a533-c1c6f2d38399 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:18.256833 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d70e36fe-84de-4aa4-931d-3b875819fb28 req-cf241128-e5fe-44d3-a509-b620bf9c8866 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:18.261521 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-d70e36fe-84de-4aa4-931d-3b875819fb28 req-cf241128-e5fe-44d3-a509-b620bf9c8866 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.1842015
May 20 04:24:18.313501 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-d70e36fe-84de-4aa4-931d-3b875819fb28 req-e2d4386c-66d0-4fe6-9029-1cdb592a6312 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0478032
May 20 04:24:18.340239 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-5829cef5-8cdd-4e4d-a533-c1c6f2d38399 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8782892106231', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4162192'] for port, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:18.346823 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:24:18.411188 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5829cef5-8cdd-4e4d-a533-c1c6f2d38399 admin admin] Network aec557db-0c02-4008-8c9f-2efcd7462f90 is already hosted by enough agents. {{(pid=91687) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:24:18.414738 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.base_scheduler [None req-5829cef5-8cdd-4e4d-a533-c1c6f2d38399 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91687) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:24:18.418752 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5829cef5-8cdd-4e4d-a533-c1c6f2d38399 admin admin] Received port after_create {{(pid=91687) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 04:24:18.475976 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5829cef5-8cdd-4e4d-a533-c1c6f2d38399 admin admin] Pushing event updated for resources: {'Port': ['ID=18fb2347-22cb-4478-9bc6-8008249183c5,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:24:18.483756 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-5829cef5-8cdd-4e4d-a533-c1c6f2d38399 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.137s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:24:18.536301 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-7125e757-4ce2-4df8-af6e-717cc391e6d9 None None] Notify callbacks [] for port, precommit_create {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:18.554619 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-7125e757-4ce2-4df8-af6e-717cc391e6d9 None None] Transition to ACTIVE for port object 65fa81fb-51bd-4b50-b2a8-68d472455252 will not be triggered until provisioned by entity L2. {{(pid=91688) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:24:18.615332 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-7125e757-4ce2-4df8-af6e-717cc391e6d9 None None] Transition to ACTIVE for port object 65fa81fb-51bd-4b50-b2a8-68d472455252 will not be triggered until provisioned by entity DHCP. {{(pid=91688) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:24:18.627882 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-7125e757-4ce2-4df8-af6e-717cc391e6d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8782892106231'] for port, after_create {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:18.633014 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-68b48814-8bc9-4aba-93fd-f82daf481a5e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:24:18.713692 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7125e757-4ce2-4df8-af6e-717cc391e6d9 None None] Network 4bb43617-e5b5-4e08-aa62-fcff79192e08 is already hosted by enough agents. {{(pid=91688) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:24:18.719326 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.scheduler.base_scheduler [None req-7125e757-4ce2-4df8-af6e-717cc391e6d9 None None] Resources bound (agent type, host, resource id):  {{(pid=91688) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:24:18.722504 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7125e757-4ce2-4df8-af6e-717cc391e6d9 None None] Received port after_create {{(pid=91688) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 04:24:18.728809 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7125e757-4ce2-4df8-af6e-717cc391e6d9 None None] Pushing event updated for resources: {'Port': ['ID=65fa81fb-51bd-4b50-b2a8-68d472455252,revision_number=1']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:24:18.734269 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-7125e757-4ce2-4df8-af6e-717cc391e6d9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.101s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:24:18.832316 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-f3ad71ea-83a8-4cb9-a1be-e9375318f01b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced1553760>, [{'id': '093b6879-26f9-4912-a2fc-dab73a0df7cb', 'name': 'tempest-TestShelveInstance-1799598596-router', 'tenant_id': 'a1319e4a0fc74f98ba4bb88d8a04086b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.187'}], 'enable_snat': True}, 'gw_port_id': '283f3ebf-83f3-4e30-ae78-4ec7e8841e26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:24:02Z', 'updated_at': '2021-05-20T04:24:12Z', 'revision_number': 4, 'project_id': 'a1319e4a0fc74f98ba4bb88d8a04086b', 'gw_port': {'id': '283f3ebf-83f3-4e30-ae78-4ec7e8841e26', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:d2:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '093b6879-26f9-4912-a2fc-dab73a0df7cb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 395, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.187', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:24:03Z', 'updated_at': '2021-05-20T04:24:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_interfaces': [{'id': 'a97d355e-c698-41a6-8ed6-aaec93b83e2a', 'name': '', 'network_id': 'e31171ff-f097-446e-b691-bef7aad2fb3b', 'tenant_id': 'a1319e4a0fc74f98ba4bb88d8a04086b', 'mac_address': 'fa:16:3e:8e:5a:42', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '093b6879-26f9-4912-a2fc-dab73a0df7cb', 'device_owner': 'network:router_interface', 'standard_attr_id': 401, 'fixed_ips': [{'subnet_id': '410f59de-055d-4298-96bf-5d9a7712368d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:24:11Z', 'updated_at': '2021-05-20T04:24:17Z', 'revision_number': 4, 'project_id': 'a1319e4a0fc74f98ba4bb88d8a04086b', 'subnets': [{'id': '410f59de-055d-4298-96bf-5d9a7712368d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:24:18.837248 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.managers [None req-7125e757-4ce2-4df8-af6e-717cc391e6d9 None None] Attempting to bind port 65fa81fb-51bd-4b50-b2a8-68d472455252 on host dv-cinder-790910-4-iscsi for vnic_type normal with profile  {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 04:24:18.837763 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.managers [None req-7125e757-4ce2-4df8-af6e-717cc391e6d9 None None] Attempting to bind port 65fa81fb-51bd-4b50-b2a8-68d472455252 by drivers openvswitch,hyperv on host dv-cinder-790910-4-iscsi at level 0 using segments [{'id': '7409db9e-5fb3-453d-b7d4-3cbc720cb9d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 863, 'network_id': '4bb43617-e5b5-4e08-aa62-fcff79192e08'}] {{(pid=91688) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 04:24:18.838141 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7125e757-4ce2-4df8-af6e-717cc391e6d9 None None] Attempting to bind port 65fa81fb-51bd-4b50-b2a8-68d472455252 on network 4bb43617-e5b5-4e08-aa62-fcff79192e08 {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:24:18.842652 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f3ad71ea-83a8-4cb9-a1be-e9375318f01b None None] The sync data for ids ['093b6879-26f9-4912-a2fc-dab73a0df7cb'] in dv-cinder-790910-4-iscsi is: [{'id': '093b6879-26f9-4912-a2fc-dab73a0df7cb', 'name': 'tempest-TestShelveInstance-1799598596-router', 'tenant_id': 'a1319e4a0fc74f98ba4bb88d8a04086b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.187'}], 'enable_snat': True}, 'gw_port_id': '283f3ebf-83f3-4e30-ae78-4ec7e8841e26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:24:02Z', 'updated_at': '2021-05-20T04:24:12Z', 'revision_number': 4, 'project_id': 'a1319e4a0fc74f98ba4bb88d8a04086b', 'gw_port': {'id': '283f3ebf-83f3-4e30-ae78-4ec7e8841e26', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:d2:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '093b6879-26f9-4912-a2fc-dab73a0df7cb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 395, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.187', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:24:03Z', 'updated_at': '2021-05-20T04:24:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_interfaces': [{'id': 'a97d355e-c698-41a6-8ed6-aaec93b83e2a', 'name': '', 'network_id': 'e31171ff-f097-446e-b691-bef7aad2fb3b', 'tenant_id': 'a1319e4a0fc74f98ba4bb88d8a04086b', 'mac_address': 'fa:16:3e:8e:5a:42', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '093b6879-26f9-4912-a2fc-dab73a0df7cb', 'device_owner': 'network:router_interface', 'standard_attr_id': 401, 'fixed_ips': [{'subnet_id': '410f59de-055d-4298-96bf-5d9a7712368d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:24:11Z', 'updated_at': '2021-05-20T04:24:17Z', 'revision_number': 4, 'project_id': 'a1319e4a0fc74f98ba4bb88d8a04086b', 'subnets': [{'id': '410f59de-055d-4298-96bf-5d9a7712368d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91688) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 04:24:18.847608 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7125e757-4ce2-4df8-af6e-717cc391e6d9 None None] Checking agent: {'id': '333121d4-1023-4a33-a54c-f4dd052e1612', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-790910-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 4, 13, 33), 'started_at': datetime.datetime(2021, 5, 20, 4, 14, 3), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 4, 24, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-790910-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 04:24:18.847997 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7125e757-4ce2-4df8-af6e-717cc391e6d9 None None] Checking segment: {'id': '7409db9e-5fb3-453d-b7d4-3cbc720cb9d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 863, 'network_id': '4bb43617-e5b5-4e08-aa62-fcff79192e08'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91688) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:24:18.848419 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-7125e757-4ce2-4df8-af6e-717cc391e6d9 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:18.848916 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7125e757-4ce2-4df8-af6e-717cc391e6d9 None None] Bound using segment: {'id': '7409db9e-5fb3-453d-b7d4-3cbc720cb9d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 863, 'network_id': '4bb43617-e5b5-4e08-aa62-fcff79192e08'} {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 04:24:18.849474 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.managers [None req-7125e757-4ce2-4df8-af6e-717cc391e6d9 None None] Bound port: 65fa81fb-51bd-4b50-b2a8-68d472455252, host: dv-cinder-790910-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7409db9e-5fb3-453d-b7d4-3cbc720cb9d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 863, 'network_id': '4bb43617-e5b5-4e08-aa62-fcff79192e08'}}] {{(pid=91688) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 04:24:18.849884 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-7125e757-4ce2-4df8-af6e-717cc391e6d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:18.941409 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-5829cef5-8cdd-4e4d-a533-c1c6f2d38399 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:18.980834 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-7125e757-4ce2-4df8-af6e-717cc391e6d9 None None] For port 65fa81fb-51bd-4b50-b2a8-68d472455252, host dv-cinder-790910-4-iscsi, cleared binding levels {{(pid=91688) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 04:24:18.991963 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-7125e757-4ce2-4df8-af6e-717cc391e6d9 None None] For port 65fa81fb-51bd-4b50-b2a8-68d472455252, host dv-cinder-790910-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=65fa81fb-51bd-4b50-b2a8-68d472455252,segment=NetworkSegment(7409db9e-5fb3-453d-b7d4-3cbc720cb9d4),segment_id=7409db9e-5fb3-453d-b7d4-3cbc720cb9d4)] {{(pid=91688) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 04:24:18.998373 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-7125e757-4ce2-4df8-af6e-717cc391e6d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:19.003255 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:24:19.086261 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7125e757-4ce2-4df8-af6e-717cc391e6d9 None None] Pushing event updated for resources: {'Port': ['ID=65fa81fb-51bd-4b50-b2a8-68d472455252,revision_number=2']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:24:19.089858 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-7125e757-4ce2-4df8-af6e-717cc391e6d9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:24:19.560668 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9eb68125-172f-4361-8087-05ca2c40def4 req-cc19f23f-3111-40ac-b6c1-245da5c3cad4 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:19.562657 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9eb68125-172f-4361-8087-05ca2c40def4 req-cc19f23f-3111-40ac-b6c1-245da5c3cad4 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 931 time: 0.4283164
May 20 04:24:19.611869 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-5829cef5-8cdd-4e4d-a533-c1c6f2d38399 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1796474', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1714058'] for router, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:19.697384 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9eb68125-172f-4361-8087-05ca2c40def4 req-6ac20878-d8eb-4ec1-af63-ef68607fe15d tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1249459
May 20 04:24:19.999072 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba95fb77-ae7b-4ed5-905b-28f8fbffe895 req-c35b450c-5e68-48c1-9042-34698021b2ca tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:20.001005 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-ba95fb77-ae7b-4ed5-905b-28f8fbffe895 req-c35b450c-5e68-48c1-9042-34698021b2ca tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.1708708
May 20 04:24:20.012333 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5829cef5-8cdd-4e4d-a533-c1c6f2d38399 admin admin] Router 5de71c93-6369-4531-861a-910439b7d267 is scheduled to L3 agent 02733fc0-fc9c-4e29-bc03-c27a792d539d with binding_index 1 {{(pid=91687) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 20 04:24:20.174915 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-ba95fb77-ae7b-4ed5-905b-28f8fbffe895 req-c197e6fc-14ea-471c-953b-ae701d06ce68 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1577687
May 20 04:24:20.229817 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d18052c4-1106-4bdb-8cfb-e1fc587efc95 None None] Network 4bb43617-e5b5-4e08-aa62-fcff79192e08 requested from dv-cinder-790910-4-iscsi {{(pid=91688) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 04:24:20.335193 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5829cef5-8cdd-4e4d-a533-c1c6f2d38399 admin admin] Notify agent at l3_agent.dv-cinder-790910-4-iscsi the message routers_updated {{(pid=91687) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 04:24:20.347691 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2490efea-fe9b-4627-b8cf-2dc445a76450 None None] Sync routers for ids ['5de71c93-6369-4531-861a-910439b7d267'] in dv-cinder-790910-4-iscsi {{(pid=91689) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 04:24:20.361140 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-750aaf03-d3e6-40fa-88c2-ddf7a500f61e None None] Provisioning for port 65fa81fb-51bd-4b50-b2a8-68d472455252 completed by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:24:20.361487 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2490efea-fe9b-4627-b8cf-2dc445a76450 None None] Routers {'5de71c93-6369-4531-861a-910439b7d267'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91689) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:24:20.361986 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-2490efea-fe9b-4627-b8cf-2dc445a76450 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced2515fd0>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:24:03Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['5de71c93-6369-4531-861a-910439b7d267'], 'active': True} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:24:20.377665 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-5829cef5-8cdd-4e4d-a533-c1c6f2d38399 admin admin] Notify callbacks [] for router, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:20.379939 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-5829cef5-8cdd-4e4d-a533-c1c6f2d38399 admin admin] 10.222.0.71 "POST /v2.0/routers HTTP/1.1" status: 201  len: 920 time: 3.5153694
May 20 04:24:20.382808 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 40000) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:24:20.896601 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvr_db [None req-2490efea-fe9b-4627-b8cf-2dc445a76450 None None] Set router 5de71c93-6369-4531-861a-910439b7d267 gateway port host: dv-cinder-790910-4-iscsi {{(pid=91689) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:24:20.918897 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device a97d355e-c698-41a6-8ed6-aaec93b83e2a up at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:24:21.064099 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning for port a97d355e-c698-41a6-8ed6-aaec93b83e2a completed by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:24:21.084798 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning complete for port a97d355e-c698-41a6-8ed6-aaec93b83e2a triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:24:21.085617 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:21.216051 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50781bf4-cbda-4a44-98cb-db551704c2bf req-5e9ba089-df6a-4f80-810b-5d4033660fa1 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:21.224135 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-50781bf4-cbda-4a44-98cb-db551704c2bf req-5e9ba089-df6a-4f80-810b-5d4033660fa1 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 931 time: 0.2262805
May 20 04:24:21.321777 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-50781bf4-cbda-4a44-98cb-db551704c2bf req-9770c66a-9b84-4f51-81ce-fd26f86d5361 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0943623
May 20 04:24:21.396046 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:21.460259 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] For port a97d355e-c698-41a6-8ed6-aaec93b83e2a, host dv-cinder-790910-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=a97d355e-c698-41a6-8ed6-aaec93b83e2a,segment=NetworkSegment(e5874c72-d111-4955-a5aa-fbad5f078a34),segment_id=e5874c72-d111-4955-a5aa-fbad5f078a34)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:24:21.473198 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:21.474442 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 65fa81fb-51bd-4b50-b2a8-68d472455252 up at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:24:21.519459 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-7125e757-4ce2-4df8-af6e-717cc391e6d9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:24:21.632758 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-2490efea-fe9b-4627-b8cf-2dc445a76450 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced2515fd0>, [{'id': '5de71c93-6369-4531-861a-910439b7d267', 'name': 'tempest-TestShelveInstance-292307318-router', 'tenant_id': '4bcdcc410bb7407eb15e956f1cf3816f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.238'}], 'enable_snat': True}, 'gw_port_id': '18fb2347-22cb-4478-9bc6-8008249183c5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:24:16Z', 'updated_at': '2021-05-20T04:24:18Z', 'revision_number': 3, 'project_id': '4bcdcc410bb7407eb15e956f1cf3816f', 'gw_port': {'id': '18fb2347-22cb-4478-9bc6-8008249183c5', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:fb:ff:11', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5de71c93-6369-4531-861a-910439b7d267', 'device_owner': 'network:router_gateway', 'standard_attr_id': 413, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.238', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:24:17Z', 'updated_at': '2021-05-20T04:24:18Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi'}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:24:21.644197 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2490efea-fe9b-4627-b8cf-2dc445a76450 None None] Checking router: 5de71c93-6369-4531-861a-910439b7d267 for host: dv-cinder-790910-4-iscsi {{(pid=91689) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 04:24:21.644941 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2490efea-fe9b-4627-b8cf-2dc445a76450 None None] Updating router 5de71c93-6369-4531-861a-910439b7d267 port 18fb2347-22cb-4478-9bc6-8008249183c5 binding host dv-cinder-790910-4-iscsi {{(pid=91689) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 20 04:24:21.680679 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Pushing event updated for resources: {'Port': ['ID=a97d355e-c698-41a6-8ed6-aaec93b83e2a,revision_number=5']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:24:21.684655 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.165s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:24:21.690299 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning for port 65fa81fb-51bd-4b50-b2a8-68d472455252 completed by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:24:21.718645 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning complete for port 65fa81fb-51bd-4b50-b2a8-68d472455252 triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:24:21.719068 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:21.727524 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c39af239-e4aa-4db9-981a-86fe19fb0c0e req-08eecbf3-a650-400d-8c7d-a4df25caa85a tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:21.742171 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-c39af239-e4aa-4db9-981a-86fe19fb0c0e req-08eecbf3-a650-400d-8c7d-a4df25caa85a tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.1923566
May 20 04:24:21.866747 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron_lib.callbacks.manager [None req-2490efea-fe9b-4627-b8cf-2dc445a76450 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:21.905914 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-c39af239-e4aa-4db9-981a-86fe19fb0c0e req-1d469484-6772-42fa-a9e5-78ada10add7c tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1515398
May 20 04:24:21.965346 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-0be043de-d532-41b2-935d-7b5c73f44b64 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:22.007412 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:22.066061 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] For port 65fa81fb-51bd-4b50-b2a8-68d472455252, host dv-cinder-790910-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=65fa81fb-51bd-4b50-b2a8-68d472455252,segment=NetworkSegment(7409db9e-5fb3-453d-b7d4-3cbc720cb9d4),segment_id=7409db9e-5fb3-453d-b7d4-3cbc720cb9d4)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:24:22.079535 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:22.082764 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-32e43669-0933-43a9-94fa-9395e9758bc6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:24:22.257886 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Pushing event updated for resources: {'Port': ['ID=65fa81fb-51bd-4b50-b2a8-68d472455252,revision_number=3']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:24:22.261042 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.178s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:24:22.345253 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron_lib.callbacks.manager [None req-2490efea-fe9b-4627-b8cf-2dc445a76450 None None] Notify callbacks [] for port, precommit_update {{(pid=91689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:22.362075 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.provisioning_blocks [None req-2490efea-fe9b-4627-b8cf-2dc445a76450 None None] Transition to ACTIVE for port object 18fb2347-22cb-4478-9bc6-8008249183c5 will not be triggered until provisioned by entity L2. {{(pid=91689) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:24:22.372869 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron_lib.callbacks.manager [None req-2490efea-fe9b-4627-b8cf-2dc445a76450 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:22.381540 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:24:22.398122 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.db_base_plugin_common [None req-0be043de-d532-41b2-935d-7b5c73f44b64 admin admin] Allocated IP 172.20.0.1 (4bb43617-e5b5-4e08-aa62-fcff79192e08/7ed199e2-8424-415a-b375-501cfccc5d60/f3bb6458-7b30-451b-a7f3-5288f527e9cf) {{(pid=91686) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 04:24:22.456886 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.managers [None req-2490efea-fe9b-4627-b8cf-2dc445a76450 None None] Attempting to bind port 18fb2347-22cb-4478-9bc6-8008249183c5 on host dv-cinder-790910-4-iscsi for vnic_type normal with profile  {{(pid=91689) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 04:24:22.457359 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.managers [None req-2490efea-fe9b-4627-b8cf-2dc445a76450 None None] Attempting to bind port 18fb2347-22cb-4478-9bc6-8008249183c5 by drivers openvswitch,hyperv on host dv-cinder-790910-4-iscsi at level 0 using segments [{'id': '8df49ec5-3fb9-4715-bc9a-f4019a6b55f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90'}] {{(pid=91689) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 04:24:22.457658 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2490efea-fe9b-4627-b8cf-2dc445a76450 None None] Attempting to bind port 18fb2347-22cb-4478-9bc6-8008249183c5 on network aec557db-0c02-4008-8c9f-2efcd7462f90 {{(pid=91689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:24:22.469379 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2490efea-fe9b-4627-b8cf-2dc445a76450 None None] Checking agent: {'id': '333121d4-1023-4a33-a54c-f4dd052e1612', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-790910-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 4, 13, 33), 'started_at': datetime.datetime(2021, 5, 20, 4, 14, 3), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 4, 24, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-790910-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 04:24:22.469954 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2490efea-fe9b-4627-b8cf-2dc445a76450 None None] Checking segment: {'id': '8df49ec5-3fb9-4715-bc9a-f4019a6b55f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91689) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:24:22.470143 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron_lib.callbacks.manager [None req-2490efea-fe9b-4627-b8cf-2dc445a76450 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:22.470544 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2490efea-fe9b-4627-b8cf-2dc445a76450 None None] Bound using segment: {'id': '8df49ec5-3fb9-4715-bc9a-f4019a6b55f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90'} {{(pid=91689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 04:24:22.471021 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.managers [None req-2490efea-fe9b-4627-b8cf-2dc445a76450 None None] Bound port: 18fb2347-22cb-4478-9bc6-8008249183c5, host: dv-cinder-790910-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8df49ec5-3fb9-4715-bc9a-f4019a6b55f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90'}}] {{(pid=91689) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 04:24:22.471394 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron_lib.callbacks.manager [None req-2490efea-fe9b-4627-b8cf-2dc445a76450 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:22.498015 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39553bc0-9062-43f9-a440-5d053a1af2ed None None] Pushing event updated for resources: {'Port': ['ID=18fb2347-22cb-4478-9bc6-8008249183c5,revision_number=2']} {{(pid=91689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:24:22.523665 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39553bc0-9062-43f9-a440-5d053a1af2ed None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:24:22.523992 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39553bc0-9062-43f9-a440-5d053a1af2ed None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:24:22.524365 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39553bc0-9062-43f9-a440-5d053a1af2ed None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:24:22.524657 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39553bc0-9062-43f9-a440-5d053a1af2ed None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:24:22.524993 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39553bc0-9062-43f9-a440-5d053a1af2ed None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:24:22.525324 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39553bc0-9062-43f9-a440-5d053a1af2ed None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:24:22.525639 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39553bc0-9062-43f9-a440-5d053a1af2ed None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:24:22.525966 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39553bc0-9062-43f9-a440-5d053a1af2ed None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:24:22.526502 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39553bc0-9062-43f9-a440-5d053a1af2ed None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:24:22.526821 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39553bc0-9062-43f9-a440-5d053a1af2ed None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:24:22.527136 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39553bc0-9062-43f9-a440-5d053a1af2ed None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:24:22.527448 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39553bc0-9062-43f9-a440-5d053a1af2ed None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:24:22.534008 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG oslo_concurrency.lockutils [None req-39553bc0-9062-43f9-a440-5d053a1af2ed None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.152s {{(pid=91689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:24:22.569396 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.db [None req-2490efea-fe9b-4627-b8cf-2dc445a76450 None None] For port 18fb2347-22cb-4478-9bc6-8008249183c5, host dv-cinder-790910-4-iscsi, cleared binding levels {{(pid=91689) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 04:24:22.573438 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.db [None req-2490efea-fe9b-4627-b8cf-2dc445a76450 None None] For port 18fb2347-22cb-4478-9bc6-8008249183c5, host dv-cinder-790910-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=18fb2347-22cb-4478-9bc6-8008249183c5,segment=NetworkSegment(8df49ec5-3fb9-4715-bc9a-f4019a6b55f9),segment_id=8df49ec5-3fb9-4715-bc9a-f4019a6b55f9)] {{(pid=91689) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 04:24:22.590383 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron_lib.callbacks.manager [None req-2490efea-fe9b-4627-b8cf-2dc445a76450 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:22.597163 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG oslo_concurrency.lockutils [None req-d959e1a6-bb4b-4c54-b542-bf60e2ca2268 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:24:22.600816 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-0be043de-d532-41b2-935d-7b5c73f44b64 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:22.620787 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.provisioning_blocks [None req-0be043de-d532-41b2-935d-7b5c73f44b64 admin admin] Transition to ACTIVE for port object f3bb6458-7b30-451b-a7f3-5288f527e9cf will not be triggered until provisioned by entity DHCP. {{(pid=91686) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:24:22.651675 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e478156b-38f5-4a6d-844d-341c4627700c req-96368605-cf4d-428f-8285-e22ab565b09f tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:22.667364 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-e478156b-38f5-4a6d-844d-341c4627700c req-96368605-cf4d-428f-8285-e22ab565b09f tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 931 time: 0.1621850
May 20 04:24:22.667730 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-0be043de-d532-41b2-935d-7b5c73f44b64 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8782892106231', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2145052'] for port, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:22.676394 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:24:22.685403 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2490efea-fe9b-4627-b8cf-2dc445a76450 None None] Routers {'5de71c93-6369-4531-861a-910439b7d267'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91689) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:24:22.686041 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-2490efea-fe9b-4627-b8cf-2dc445a76450 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced2515fd0>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:24:03Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['5de71c93-6369-4531-861a-910439b7d267'], 'active': True} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:24:22.745328 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39553bc0-9062-43f9-a440-5d053a1af2ed None None] Pushing event updated for resources: {'Port': ['ID=18fb2347-22cb-4478-9bc6-8008249183c5,revision_number=3']} {{(pid=91689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:24:22.750740 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-e478156b-38f5-4a6d-844d-341c4627700c req-025621a4-780b-40a7-a34b-b6ec8c83cee8 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0820291
May 20 04:24:22.756373 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG oslo_concurrency.lockutils [None req-39553bc0-9062-43f9-a440-5d053a1af2ed None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.159s {{(pid=91689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:24:22.795939 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0be043de-d532-41b2-935d-7b5c73f44b64 admin admin] Network 4bb43617-e5b5-4e08-aa62-fcff79192e08 is already hosted by enough agents. {{(pid=91686) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:24:22.802453 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.base_scheduler [None req-0be043de-d532-41b2-935d-7b5c73f44b64 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91686) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:24:22.809914 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0be043de-d532-41b2-935d-7b5c73f44b64 admin admin] Received port after_create {{(pid=91686) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 04:24:22.900500 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0be043de-d532-41b2-935d-7b5c73f44b64 admin admin] Pushing event updated for resources: {'Port': ['ID=f3bb6458-7b30-451b-a7f3-5288f527e9cf,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:24:22.909092 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device a97d355e-c698-41a6-8ed6-aaec93b83e2a up at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:24:22.919897 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-0be043de-d532-41b2-935d-7b5c73f44b64 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.243s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:24:22.967351 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-0be043de-d532-41b2-935d-7b5c73f44b64 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1716281'] for router_interface, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:22.978422 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvr_db [None req-2490efea-fe9b-4627-b8cf-2dc445a76450 None None] Set router 5de71c93-6369-4531-861a-910439b7d267 gateway port host: dv-cinder-790910-4-iscsi {{(pid=91689) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:24:23.169714 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning complete for port a97d355e-c698-41a6-8ed6-aaec93b83e2a triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:24:23.170782 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:23.320531 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-0be043de-d532-41b2-935d-7b5c73f44b64 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:23.375079 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-1bc31033-6248-471b-b582-2837640cf4eb None None] Provisioning for port f3bb6458-7b30-451b-a7f3-5288f527e9cf completed by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:24:23.393493 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-1bc31033-6248-471b-b582-2837640cf4eb None None] Provisioning complete for port f3bb6458-7b30-451b-a7f3-5288f527e9cf triggered by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:24:23.393874 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1bc31033-6248-471b-b582-2837640cf4eb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:23.403155 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d931ae50-3484-45a5-9790-ccae37856c22 req-3747b615-743a-4c9a-a1a9-10240bd59533 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:23.411078 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-d931ae50-3484-45a5-9790-ccae37856c22 req-3747b615-743a-4c9a-a1a9-10240bd59533 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.2100601
May 20 04:24:23.559726 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-d931ae50-3484-45a5-9790-ccae37856c22 req-4d9e7462-8d81-4b44-bef1-5b6b4e1ab27c tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1475458
May 20 04:24:23.656631 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-1bc31033-6248-471b-b582-2837640cf4eb None None] Port f3bb6458-7b30-451b-a7f3-5288f527e9cf cannot update to ACTIVE because it is not bound. {{(pid=91688) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 20 04:24:23.680667 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 65fa81fb-51bd-4b50-b2a8-68d472455252 up at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:24:23.788631 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-2490efea-fe9b-4627-b8cf-2dc445a76450 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced2515fd0>, [{'id': '5de71c93-6369-4531-861a-910439b7d267', 'name': 'tempest-TestShelveInstance-292307318-router', 'tenant_id': '4bcdcc410bb7407eb15e956f1cf3816f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.238'}], 'enable_snat': True}, 'gw_port_id': '18fb2347-22cb-4478-9bc6-8008249183c5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:24:16Z', 'updated_at': '2021-05-20T04:24:18Z', 'revision_number': 3, 'project_id': '4bcdcc410bb7407eb15e956f1cf3816f', 'gw_port': {'id': '18fb2347-22cb-4478-9bc6-8008249183c5', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:fb:ff:11', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5de71c93-6369-4531-861a-910439b7d267', 'device_owner': 'network:router_gateway', 'standard_attr_id': 413, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.238', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:24:17Z', 'updated_at': '2021-05-20T04:24:22Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi'}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:24:23.793709 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2490efea-fe9b-4627-b8cf-2dc445a76450 None None] The sync data for ids ['5de71c93-6369-4531-861a-910439b7d267'] in dv-cinder-790910-4-iscsi is: [{'id': '5de71c93-6369-4531-861a-910439b7d267', 'name': 'tempest-TestShelveInstance-292307318-router', 'tenant_id': '4bcdcc410bb7407eb15e956f1cf3816f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.238'}], 'enable_snat': True}, 'gw_port_id': '18fb2347-22cb-4478-9bc6-8008249183c5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:24:16Z', 'updated_at': '2021-05-20T04:24:18Z', 'revision_number': 3, 'project_id': '4bcdcc410bb7407eb15e956f1cf3816f', 'gw_port': {'id': '18fb2347-22cb-4478-9bc6-8008249183c5', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:fb:ff:11', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5de71c93-6369-4531-861a-910439b7d267', 'device_owner': 'network:router_gateway', 'standard_attr_id': 413, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.238', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:24:17Z', 'updated_at': '2021-05-20T04:24:22Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi'}] {{(pid=91689) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 04:24:23.889148 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning complete for port 65fa81fb-51bd-4b50-b2a8-68d472455252 triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:24:23.889335 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:24.058316 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aad582ee-4a31-4c35-ace5-eafcffd35f3a req-a08284ab-fc95-4cd4-b4c8-1fc994cce5ec tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:24.061105 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-aad582ee-4a31-4c35-ace5-eafcffd35f3a req-a08284ab-fc95-4cd4-b4c8-1fc994cce5ec tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 931 time: 0.1331694
May 20 04:24:24.077848 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-0be043de-d532-41b2-935d-7b5c73f44b64 admin admin] Notify callbacks [] for port, precommit_update {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:24.094514 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-0be043de-d532-41b2-935d-7b5c73f44b64 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2145029'] for port, after_update {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:24.128501 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:24:24.135539 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-aad582ee-4a31-4c35-ace5-eafcffd35f3a req-2020989a-f077-4889-acb1-3638ecce0805 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0638914
May 20 04:24:24.256060 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0be043de-d532-41b2-935d-7b5c73f44b64 admin admin] Pushing event updated for resources: {'Port': ['ID=f3bb6458-7b30-451b-a7f3-5288f527e9cf,revision_number=2']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:24:24.261786 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-0be043de-d532-41b2-935d-7b5c73f44b64 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1781412', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1716318'] for router_interface, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:24.287364 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-0be043de-d532-41b2-935d-7b5c73f44b64 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.159s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:24:24.516115 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0be043de-d532-41b2-935d-7b5c73f44b64 admin admin] Network 4bb43617-e5b5-4e08-aa62-fcff79192e08 is already hosted by enough agents. {{(pid=91686) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:24:24.517367 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.base_scheduler [None req-0be043de-d532-41b2-935d-7b5c73f44b64 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91686) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:24:24.904352 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 18fb2347-22cb-4478-9bc6-8008249183c5 up at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:24:25.112842 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0be043de-d532-41b2-935d-7b5c73f44b64 admin admin] Router 5de71c93-6369-4531-861a-910439b7d267 has already been hosted by L3 agent 02733fc0-fc9c-4e29-bc03-c27a792d539d {{(pid=91686) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 04:24:25.137388 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-5c9c9a6f-3df8-4209-9f1d-00a254322840 None None] Provisioning complete for port f3bb6458-7b30-451b-a7f3-5288f527e9cf triggered by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:24:25.137779 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-5c9c9a6f-3df8-4209-9f1d-00a254322840 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:25.238187 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e5560ff-7433-4fb7-a0e3-1669b5c9c030 req-d5d0be81-f685-4f1b-ac4e-25b778853717 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:25.241537 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-3e5560ff-7433-4fb7-a0e3-1669b5c9c030 req-d5d0be81-f685-4f1b-ac4e-25b778853717 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.2294180
May 20 04:24:25.243862 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning for port 18fb2347-22cb-4478-9bc6-8008249183c5 completed by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:24:25.251646 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning complete for port 18fb2347-22cb-4478-9bc6-8008249183c5 triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:24:25.252456 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:25.355669 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-5c9c9a6f-3df8-4209-9f1d-00a254322840 None None] Port f3bb6458-7b30-451b-a7f3-5288f527e9cf cannot update to ACTIVE because it is not bound. {{(pid=91688) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 20 04:24:25.429918 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-3e5560ff-7433-4fb7-a0e3-1669b5c9c030 req-306c5bf5-627c-4c63-b346-765f84fb03ec tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1767414
May 20 04:24:25.527286 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:25.565600 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] For port 18fb2347-22cb-4478-9bc6-8008249183c5, host dv-cinder-790910-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=18fb2347-22cb-4478-9bc6-8008249183c5,segment=NetworkSegment(8df49ec5-3fb9-4715-bc9a-f4019a6b55f9),segment_id=8df49ec5-3fb9-4715-bc9a-f4019a6b55f9)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:24:25.577737 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:25.583331 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-7125e757-4ce2-4df8-af6e-717cc391e6d9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:24:25.783668 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Pushing event updated for resources: {'Port': ['ID=18fb2347-22cb-4478-9bc6-8008249183c5,revision_number=4']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:24:25.792034 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.212s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:24:25.805988 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0be043de-d532-41b2-935d-7b5c73f44b64 admin admin] Notify agent at l3_agent.dv-cinder-790910-4-iscsi the message routers_updated {{(pid=91686) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 04:24:25.818796 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-0be043de-d532-41b2-935d-7b5c73f44b64 admin admin] 10.222.0.71 "PUT /v2.0/routers/5de71c93-6369-4531-861a-910439b7d267/add_router_interface HTTP/1.1" status: 200  len: 503 time: 5.4347730
May 20 04:24:25.847856 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-521759ac-c0d4-459e-9470-55f4eb0eb293 req-ab9cb88e-3db0-432c-8a54-62a9b841f993 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:25.850486 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-521759ac-c0d4-459e-9470-55f4eb0eb293 req-ab9cb88e-3db0-432c-8a54-62a9b841f993 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 931 time: 0.1824474
May 20 04:24:25.921750 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-521759ac-c0d4-459e-9470-55f4eb0eb293 req-69cc0a07-8aaa-4be4-865d-a54a1b7f429c tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0606272
May 20 04:24:26.339524 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1399ebf1-38c1-46a1-b69f-990d9ee250fa None None] Sync routers for ids ['5de71c93-6369-4531-861a-910439b7d267'] in dv-cinder-790910-4-iscsi {{(pid=91688) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 04:24:26.349394 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1399ebf1-38c1-46a1-b69f-990d9ee250fa None None] Routers {'5de71c93-6369-4531-861a-910439b7d267'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91688) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:24:26.349991 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-1399ebf1-38c1-46a1-b69f-990d9ee250fa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced1b6c670>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:24:03Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['5de71c93-6369-4531-861a-910439b7d267'], 'active': True} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:24:26.641726 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvr_db [None req-1399ebf1-38c1-46a1-b69f-990d9ee250fa None None] Set router 5de71c93-6369-4531-861a-910439b7d267 gateway port host: dv-cinder-790910-4-iscsi {{(pid=91688) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:24:26.724362 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 40076) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:24:26.730563 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [None req-84150793-6a5a-4e05-a139-1f6db11742fd tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1162085151', 'description': 'tempest-secgroup-smoke-1162085151 description', 'project_id': 'a1319e4a0fc74f98ba4bb88d8a04086b'}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:24:26.736781 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-84150793-6a5a-4e05-a139-1f6db11742fd tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:24:26.741130 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-84150793-6a5a-4e05-a139-1f6db11742fd tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Usage tracker for resource:security_group and tenant:a1319e4a0fc74f98ba4bb88d8a04086b is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:24:26.744444 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-84150793-6a5a-4e05-a139-1f6db11742fd tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:24:26.769661 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-84150793-6a5a-4e05-a139-1f6db11742fd tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:24:26.796109 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 18fb2347-22cb-4478-9bc6-8008249183c5 up at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:24:26.809983 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-84150793-6a5a-4e05-a139-1f6db11742fd tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Notify callbacks [] for security_group, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:26.839127 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-84150793-6a5a-4e05-a139-1f6db11742fd tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:24:26.845632 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-84150793-6a5a-4e05-a139-1f6db11742fd tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Usage tracker for resource:security_group_rule and tenant:a1319e4a0fc74f98ba4bb88d8a04086b is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:24:26.851437 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-84150793-6a5a-4e05-a139-1f6db11742fd tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:24:26.892742 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-84150793-6a5a-4e05-a139-1f6db11742fd tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:24:26.969577 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d34b55c-42fe-40ee-8c26-f74cb739fafe req-fb16f3f9-d86b-4dca-adc9-8ec3784c3997 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:26.971036 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-1d34b55c-42fe-40ee-8c26-f74cb739fafe req-fb16f3f9-d86b-4dca-adc9-8ec3784c3997 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.1215041
May 20 04:24:27.019321 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning complete for port 18fb2347-22cb-4478-9bc6-8008249183c5 triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:24:27.019980 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:27.069307 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-1d34b55c-42fe-40ee-8c26-f74cb739fafe req-b0e278f6-eb72-44d1-bd14-1e7f0bfbcd24 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0806756
May 20 04:24:27.072019 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-84150793-6a5a-4e05-a139-1f6db11742fd tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Notify callbacks [] for security_group, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:27.080309 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-84150793-6a5a-4e05-a139-1f6db11742fd tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:27.089558 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-cf582247-4fee-4469-93ea-4dbb87178c40 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:24:27.127929 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84150793-6a5a-4e05-a139-1f6db11742fd tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Pushing event updated for resources: {'SecurityGroup': ['ID=34e473fa-df05-422b-9abc-99aed131bade,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:24:27.133620 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-84150793-6a5a-4e05-a139-1f6db11742fd tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:24:27.147658 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-84150793-6a5a-4e05-a139-1f6db11742fd tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Notify callbacks [] for security_group, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:27.151787 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-84150793-6a5a-4e05-a139-1f6db11742fd tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1794 time: 0.4236453
May 20 04:24:27.152141 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 40088) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:24:27.158276 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [None req-dcf78548-ff8c-4dcc-b517-bef34bbbc0d3 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Request body: {'security_group_rule': {'security_group_id': '34e473fa-df05-422b-9abc-99aed131bade', 'project_id': 'a1319e4a0fc74f98ba4bb88d8a04086b', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:24:27.165721 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-dcf78548-ff8c-4dcc-b517-bef34bbbc0d3 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:24:27.171026 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-dcf78548-ff8c-4dcc-b517-bef34bbbc0d3 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Usage tracker for resource:security_group_rule and tenant:a1319e4a0fc74f98ba4bb88d8a04086b is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:24:27.175226 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-dcf78548-ff8c-4dcc-b517-bef34bbbc0d3 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:24:27.190036 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-dcf78548-ff8c-4dcc-b517-bef34bbbc0d3 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:24:27.215627 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-dcf78548-ff8c-4dcc-b517-bef34bbbc0d3 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:27.274456 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-1399ebf1-38c1-46a1-b69f-990d9ee250fa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced1b6c670>, [{'id': '5de71c93-6369-4531-861a-910439b7d267', 'name': 'tempest-TestShelveInstance-292307318-router', 'tenant_id': '4bcdcc410bb7407eb15e956f1cf3816f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.238'}], 'enable_snat': True}, 'gw_port_id': '18fb2347-22cb-4478-9bc6-8008249183c5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:24:16Z', 'updated_at': '2021-05-20T04:24:23Z', 'revision_number': 4, 'project_id': '4bcdcc410bb7407eb15e956f1cf3816f', 'gw_port': {'id': '18fb2347-22cb-4478-9bc6-8008249183c5', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:fb:ff:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5de71c93-6369-4531-861a-910439b7d267', 'device_owner': 'network:router_gateway', 'standard_attr_id': 413, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.238', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:24:17Z', 'updated_at': '2021-05-20T04:24:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_interfaces': [{'id': 'f3bb6458-7b30-451b-a7f3-5288f527e9cf', 'name': '', 'network_id': '4bb43617-e5b5-4e08-aa62-fcff79192e08', 'tenant_id': '4bcdcc410bb7407eb15e956f1cf3816f', 'mac_address': 'fa:16:3e:60:72:a3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5de71c93-6369-4531-861a-910439b7d267', 'device_owner': 'network:router_interface', 'standard_attr_id': 414, 'fixed_ips': [{'subnet_id': '7ed199e2-8424-415a-b375-501cfccc5d60', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:24:22Z', 'updated_at': '2021-05-20T04:24:23Z', 'revision_number': 2, 'project_id': '4bcdcc410bb7407eb15e956f1cf3816f', 'subnets': [{'id': '7ed199e2-8424-415a-b375-501cfccc5d60', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:24:27.285083 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1399ebf1-38c1-46a1-b69f-990d9ee250fa None None] Checking router: 5de71c93-6369-4531-861a-910439b7d267 for host: dv-cinder-790910-4-iscsi {{(pid=91688) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 04:24:27.285718 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1399ebf1-38c1-46a1-b69f-990d9ee250fa None None] Updating router 5de71c93-6369-4531-861a-910439b7d267 port f3bb6458-7b30-451b-a7f3-5288f527e9cf binding host dv-cinder-790910-4-iscsi {{(pid=91688) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 20 04:24:27.347513 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1399ebf1-38c1-46a1-b69f-990d9ee250fa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:27.379314 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-dcf78548-ff8c-4dcc-b517-bef34bbbc0d3 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:27.387143 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-dcf78548-ff8c-4dcc-b517-bef34bbbc0d3 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1597377'] for security_group_rule, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:27.395355 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:24:27.506860 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dcf78548-ff8c-4dcc-b517-bef34bbbc0d3 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2f79394b-86d6-49ef-9d91-d017eee08e25,revision_number=0']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:24:27.514025 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-dcf78548-ff8c-4dcc-b517-bef34bbbc0d3 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:24:27.516447 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-dcf78548-ff8c-4dcc-b517-bef34bbbc0d3 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:27.517750 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-dcf78548-ff8c-4dcc-b517-bef34bbbc0d3 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.3645074
May 20 04:24:27.522628 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 40092) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:24:27.529129 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.v2.base [None req-f2e161ae-757e-455a-a688-0119c0188923 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Request body: {'security_group_rule': {'security_group_id': '34e473fa-df05-422b-9abc-99aed131bade', 'project_id': 'a1319e4a0fc74f98ba4bb88d8a04086b', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=91686) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:24:27.535153 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbded645-7abb-42f1-88b1-3eed2b285238 req-8a9e2fb9-21f5-4aea-94d6-b785ac8c7807 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:27.536121 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-f2e161ae-757e-455a-a688-0119c0188923 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:24:27.536725 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-bbded645-7abb-42f1-88b1-3eed2b285238 req-8a9e2fb9-21f5-4aea-94d6-b785ac8c7807 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 931 time: 0.2489612
May 20 04:24:27.540750 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-f2e161ae-757e-455a-a688-0119c0188923 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Usage tracker for resource:security_group_rule and tenant:a1319e4a0fc74f98ba4bb88d8a04086b is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:24:27.560382 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-f2e161ae-757e-455a-a688-0119c0188923 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:24:27.569923 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-f2e161ae-757e-455a-a688-0119c0188923 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:24:27.605168 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-bbded645-7abb-42f1-88b1-3eed2b285238 req-e22925ec-1304-4f2b-824f-5a3da87a9688 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0512700
May 20 04:24:27.610017 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-f2e161ae-757e-455a-a688-0119c0188923 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:27.689561 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-f2e161ae-757e-455a-a688-0119c0188923 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:27.698348 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-f2e161ae-757e-455a-a688-0119c0188923 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1597377'] for security_group_rule, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:27.706875 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-429e9f6c-de23-41bc-9802-fd61d223990c tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:24:27.735045 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2e161ae-757e-455a-a688-0119c0188923 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=796a6e8b-426f-4067-99c8-b24337cb055d,revision_number=0']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:24:27.739143 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-f2e161ae-757e-455a-a688-0119c0188923 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:24:27.749395 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-f2e161ae-757e-455a-a688-0119c0188923 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:27.751081 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-f2e161ae-757e-455a-a688-0119c0188923 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 763 time: 0.2265663
May 20 04:24:27.754041 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 40098) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:24:27.759761 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.v2.base [None req-36ad2167-23ea-4043-8bdf-c48d69e43e0f tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Request body: {'security_group_rule': {'security_group_id': '34e473fa-df05-422b-9abc-99aed131bade', 'project_id': 'a1319e4a0fc74f98ba4bb88d8a04086b', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=91686) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:24:27.765764 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-36ad2167-23ea-4043-8bdf-c48d69e43e0f tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:24:27.769594 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-36ad2167-23ea-4043-8bdf-c48d69e43e0f tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Usage tracker for resource:security_group_rule and tenant:a1319e4a0fc74f98ba4bb88d8a04086b is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:24:27.772710 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-36ad2167-23ea-4043-8bdf-c48d69e43e0f tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:24:27.778648 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-36ad2167-23ea-4043-8bdf-c48d69e43e0f tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:24:27.812030 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-36ad2167-23ea-4043-8bdf-c48d69e43e0f tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:27.848779 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1399ebf1-38c1-46a1-b69f-990d9ee250fa None None] Notify callbacks [] for port, precommit_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:27.879422 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-1399ebf1-38c1-46a1-b69f-990d9ee250fa None None] Transition to ACTIVE for port object f3bb6458-7b30-451b-a7f3-5288f527e9cf will not be triggered until provisioned by entity L2. {{(pid=91688) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:24:27.893709 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1399ebf1-38c1-46a1-b69f-990d9ee250fa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:27.904673 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:24:27.951971 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-36ad2167-23ea-4043-8bdf-c48d69e43e0f tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:27.958723 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-36ad2167-23ea-4043-8bdf-c48d69e43e0f tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1597377'] for security_group_rule, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:27.961850 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:24:28.017158 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36ad2167-23ea-4043-8bdf-c48d69e43e0f tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=17fd9290-74c9-4256-a45b-b656c8f86333,revision_number=0']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:24:28.027616 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-36ad2167-23ea-4043-8bdf-c48d69e43e0f tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:28.029684 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-36ad2167-23ea-4043-8bdf-c48d69e43e0f tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.2743428
May 20 04:24:28.031069 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-36ad2167-23ea-4043-8bdf-c48d69e43e0f tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:24:28.034375 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 40102) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:24:28.041315 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.v2.base [None req-cb32a7e1-35bf-4208-aee3-474378517bbd tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Request body: {'security_group_rule': {'security_group_id': '34e473fa-df05-422b-9abc-99aed131bade', 'project_id': 'a1319e4a0fc74f98ba4bb88d8a04086b', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=91686) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:24:28.048315 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-cb32a7e1-35bf-4208-aee3-474378517bbd tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:24:28.054562 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-cb32a7e1-35bf-4208-aee3-474378517bbd tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Usage tracker for resource:security_group_rule and tenant:a1319e4a0fc74f98ba4bb88d8a04086b is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:24:28.061059 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-cb32a7e1-35bf-4208-aee3-474378517bbd tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:24:28.075563 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-cb32a7e1-35bf-4208-aee3-474378517bbd tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:24:28.101532 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-cb32a7e1-35bf-4208-aee3-474378517bbd tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:28.144007 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-730b0543-e5fa-4e66-85a9-3a5c52a36f8f None None] Pushing event updated for resources: {'Port': ['ID=f3bb6458-7b30-451b-a7f3-5288f527e9cf,revision_number=3']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:24:28.174915 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-730b0543-e5fa-4e66-85a9-3a5c52a36f8f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.270s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:24:28.224782 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.managers [None req-1399ebf1-38c1-46a1-b69f-990d9ee250fa None None] Attempting to bind port f3bb6458-7b30-451b-a7f3-5288f527e9cf on host dv-cinder-790910-4-iscsi for vnic_type normal with profile  {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 04:24:28.225097 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.managers [None req-1399ebf1-38c1-46a1-b69f-990d9ee250fa None None] Attempting to bind port f3bb6458-7b30-451b-a7f3-5288f527e9cf by drivers openvswitch,hyperv on host dv-cinder-790910-4-iscsi at level 0 using segments [{'id': '7409db9e-5fb3-453d-b7d4-3cbc720cb9d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 863, 'network_id': '4bb43617-e5b5-4e08-aa62-fcff79192e08'}] {{(pid=91688) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 04:24:28.225620 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1399ebf1-38c1-46a1-b69f-990d9ee250fa None None] Attempting to bind port f3bb6458-7b30-451b-a7f3-5288f527e9cf on network 4bb43617-e5b5-4e08-aa62-fcff79192e08 {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:24:28.245300 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1399ebf1-38c1-46a1-b69f-990d9ee250fa None None] Checking agent: {'id': '333121d4-1023-4a33-a54c-f4dd052e1612', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-790910-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 4, 13, 33), 'started_at': datetime.datetime(2021, 5, 20, 4, 14, 3), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 4, 24, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-790910-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 04:24:28.245731 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1399ebf1-38c1-46a1-b69f-990d9ee250fa None None] Checking segment: {'id': '7409db9e-5fb3-453d-b7d4-3cbc720cb9d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 863, 'network_id': '4bb43617-e5b5-4e08-aa62-fcff79192e08'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91688) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:24:28.246109 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1399ebf1-38c1-46a1-b69f-990d9ee250fa None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:28.246523 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1399ebf1-38c1-46a1-b69f-990d9ee250fa None None] Bound using segment: {'id': '7409db9e-5fb3-453d-b7d4-3cbc720cb9d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 863, 'network_id': '4bb43617-e5b5-4e08-aa62-fcff79192e08'} {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 04:24:28.247019 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.managers [None req-1399ebf1-38c1-46a1-b69f-990d9ee250fa None None] Bound port: f3bb6458-7b30-451b-a7f3-5288f527e9cf, host: dv-cinder-790910-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7409db9e-5fb3-453d-b7d4-3cbc720cb9d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 863, 'network_id': '4bb43617-e5b5-4e08-aa62-fcff79192e08'}}] {{(pid=91688) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 04:24:28.247406 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1399ebf1-38c1-46a1-b69f-990d9ee250fa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:28.327312 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-cb32a7e1-35bf-4208-aee3-474378517bbd tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:28.335994 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-cb32a7e1-35bf-4208-aee3-474378517bbd tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1597377'] for security_group_rule, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:28.340739 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-36ad2167-23ea-4043-8bdf-c48d69e43e0f tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:24:28.441188 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb32a7e1-35bf-4208-aee3-474378517bbd tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f874b3d2-8d51-46c7-a977-5266ee990de9,revision_number=0']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:24:28.447097 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ff64f13-677b-400a-a00b-3b41d8d4e446 req-a2ad6377-2d39-4468-a1f3-3777d29fb13d tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:28.454714 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-cb32a7e1-35bf-4208-aee3-474378517bbd tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:24:28.458559 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-cb32a7e1-35bf-4208-aee3-474378517bbd tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:28.460367 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-cb32a7e1-35bf-4208-aee3-474378517bbd tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 768 time: 0.4248259
May 20 04:24:28.465029 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-2ff64f13-677b-400a-a00b-3b41d8d4e446 req-a2ad6377-2d39-4468-a1f3-3777d29fb13d tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.1634099
May 20 04:24:28.465245 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 40114) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:24:28.472244 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.v2.base [None req-eeea5085-8f3d-4f2a-8d03-bfe7ce50b5dc tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Request body: {'security_group_rule': {'security_group_id': '34e473fa-df05-422b-9abc-99aed131bade', 'project_id': 'a1319e4a0fc74f98ba4bb88d8a04086b', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=91686) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:24:28.479132 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-eeea5085-8f3d-4f2a-8d03-bfe7ce50b5dc tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:24:28.484695 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-eeea5085-8f3d-4f2a-8d03-bfe7ce50b5dc tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Usage tracker for resource:security_group_rule and tenant:a1319e4a0fc74f98ba4bb88d8a04086b is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:24:28.488437 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-eeea5085-8f3d-4f2a-8d03-bfe7ce50b5dc tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:24:28.498981 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-eeea5085-8f3d-4f2a-8d03-bfe7ce50b5dc tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:24:28.514081 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.db.securitygroups_db [None req-eeea5085-8f3d-4f2a-8d03-bfe7ce50b5dc tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Project a1319e4a0fc74f98ba4bb88d8a04086b added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
May 20 04:24:28.521831 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-2ff64f13-677b-400a-a00b-3b41d8d4e446 req-96851411-4b79-447e-89b2-af473b4a431d tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0555809
May 20 04:24:28.522366 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-eeea5085-8f3d-4f2a-8d03-bfe7ce50b5dc tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:28.529209 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1399ebf1-38c1-46a1-b69f-990d9ee250fa None None] For port f3bb6458-7b30-451b-a7f3-5288f527e9cf, host dv-cinder-790910-4-iscsi, cleared binding levels {{(pid=91688) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 04:24:28.534379 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1399ebf1-38c1-46a1-b69f-990d9ee250fa None None] For port f3bb6458-7b30-451b-a7f3-5288f527e9cf, host dv-cinder-790910-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=f3bb6458-7b30-451b-a7f3-5288f527e9cf,segment=NetworkSegment(7409db9e-5fb3-453d-b7d4-3cbc720cb9d4),segment_id=7409db9e-5fb3-453d-b7d4-3cbc720cb9d4)] {{(pid=91688) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 04:24:28.542667 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1399ebf1-38c1-46a1-b69f-990d9ee250fa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:28.548324 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-32e43669-0933-43a9-94fa-9395e9758bc6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:24:28.643640 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1399ebf1-38c1-46a1-b69f-990d9ee250fa None None] Routers {'5de71c93-6369-4531-861a-910439b7d267'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91688) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:24:28.644094 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-1399ebf1-38c1-46a1-b69f-990d9ee250fa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced1b6c670>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:24:03Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['5de71c93-6369-4531-861a-910439b7d267'], 'active': True} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:24:28.656693 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-eeea5085-8f3d-4f2a-8d03-bfe7ce50b5dc tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:28.663903 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-eeea5085-8f3d-4f2a-8d03-bfe7ce50b5dc tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1597377'] for security_group_rule, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:28.668140 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:24:28.722170 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eeea5085-8f3d-4f2a-8d03-bfe7ce50b5dc tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=802e737d-c412-4147-913b-ac9380fec67b,revision_number=0']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:24:28.729338 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-eeea5085-8f3d-4f2a-8d03-bfe7ce50b5dc tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:24:28.767829 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-eeea5085-8f3d-4f2a-8d03-bfe7ce50b5dc tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:28.789877 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-eeea5085-8f3d-4f2a-8d03-bfe7ce50b5dc tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 774 time: 0.3226860
May 20 04:24:28.790438 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 40124) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:24:28.806208 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.v2.base [None req-efe1d76d-8b9a-4697-8056-aa3a51861427 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Request body: {'security_group_rule': {'security_group_id': '34e473fa-df05-422b-9abc-99aed131bade', 'project_id': 'a1319e4a0fc74f98ba4bb88d8a04086b', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=91686) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:24:28.821855 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-efe1d76d-8b9a-4697-8056-aa3a51861427 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:24:28.838076 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-efe1d76d-8b9a-4697-8056-aa3a51861427 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Usage tracker for resource:security_group_rule and tenant:a1319e4a0fc74f98ba4bb88d8a04086b is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:24:28.842133 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-efe1d76d-8b9a-4697-8056-aa3a51861427 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:24:28.865345 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-efe1d76d-8b9a-4697-8056-aa3a51861427 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:24:28.879230 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-730b0543-e5fa-4e66-85a9-3a5c52a36f8f None None] Pushing event updated for resources: {'Port': ['ID=f3bb6458-7b30-451b-a7f3-5288f527e9cf,revision_number=4']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:24:28.882019 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.db.securitygroups_db [None req-efe1d76d-8b9a-4697-8056-aa3a51861427 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Project a1319e4a0fc74f98ba4bb88d8a04086b added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
May 20 04:24:28.889402 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-efe1d76d-8b9a-4697-8056-aa3a51861427 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:28.913904 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-730b0543-e5fa-4e66-85a9-3a5c52a36f8f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.365s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:24:28.947927 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a7db6b0-a6a3-4131-abd7-e684e3c45edd req-32748294-c655-4775-acf9-d0e6ddf21780 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:28.971455 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-2a7db6b0-a6a3-4131-abd7-e684e3c45edd req-32748294-c655-4775-acf9-d0e6ddf21780 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 931 time: 0.1814380
May 20 04:24:29.075178 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-efe1d76d-8b9a-4697-8056-aa3a51861427 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:29.080983 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-efe1d76d-8b9a-4697-8056-aa3a51861427 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1597377'] for security_group_rule, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:29.088759 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:24:29.102828 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-2a7db6b0-a6a3-4131-abd7-e684e3c45edd req-6a3eb9f3-f505-4a21-aef4-ef853f13d79f tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1278851
May 20 04:24:29.175782 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-efe1d76d-8b9a-4697-8056-aa3a51861427 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a3b77240-e212-4b3b-8966-03a1f1f1ff94,revision_number=0']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:24:29.179677 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-efe1d76d-8b9a-4697-8056-aa3a51861427 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:24:29.222074 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-efe1d76d-8b9a-4697-8056-aa3a51861427 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:29.232844 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-efe1d76d-8b9a-4697-8056-aa3a51861427 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 773 time: 0.4384167
May 20 04:24:29.272995 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvr_db [None req-1399ebf1-38c1-46a1-b69f-990d9ee250fa None None] Set router 5de71c93-6369-4531-861a-910439b7d267 gateway port host: dv-cinder-790910-4-iscsi {{(pid=91688) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:24:29.914596 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8602e503-a410-4aca-b61d-ea6fd5c58e8c req-69d53776-af01-4298-b6d8-898c96e654fa tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:29.916772 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-8602e503-a410-4aca-b61d-ea6fd5c58e8c req-69d53776-af01-4298-b6d8-898c96e654fa tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.1674259
May 20 04:24:29.927691 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-d4b863cb-eb88-4c02-83ef-13609fa568d1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:29.969029 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-1399ebf1-38c1-46a1-b69f-990d9ee250fa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced1b6c670>, [{'id': '5de71c93-6369-4531-861a-910439b7d267', 'name': 'tempest-TestShelveInstance-292307318-router', 'tenant_id': '4bcdcc410bb7407eb15e956f1cf3816f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.238'}], 'enable_snat': True}, 'gw_port_id': '18fb2347-22cb-4478-9bc6-8008249183c5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:24:16Z', 'updated_at': '2021-05-20T04:24:23Z', 'revision_number': 4, 'project_id': '4bcdcc410bb7407eb15e956f1cf3816f', 'gw_port': {'id': '18fb2347-22cb-4478-9bc6-8008249183c5', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:fb:ff:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5de71c93-6369-4531-861a-910439b7d267', 'device_owner': 'network:router_gateway', 'standard_attr_id': 413, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.238', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:24:17Z', 'updated_at': '2021-05-20T04:24:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_interfaces': [{'id': 'f3bb6458-7b30-451b-a7f3-5288f527e9cf', 'name': '', 'network_id': '4bb43617-e5b5-4e08-aa62-fcff79192e08', 'tenant_id': '4bcdcc410bb7407eb15e956f1cf3816f', 'mac_address': 'fa:16:3e:60:72:a3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5de71c93-6369-4531-861a-910439b7d267', 'device_owner': 'network:router_interface', 'standard_attr_id': 414, 'fixed_ips': [{'subnet_id': '7ed199e2-8424-415a-b375-501cfccc5d60', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:24:22Z', 'updated_at': '2021-05-20T04:24:28Z', 'revision_number': 4, 'project_id': '4bcdcc410bb7407eb15e956f1cf3816f', 'subnets': [{'id': '7ed199e2-8424-415a-b375-501cfccc5d60', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:24:29.973500 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1399ebf1-38c1-46a1-b69f-990d9ee250fa None None] The sync data for ids ['5de71c93-6369-4531-861a-910439b7d267'] in dv-cinder-790910-4-iscsi is: [{'id': '5de71c93-6369-4531-861a-910439b7d267', 'name': 'tempest-TestShelveInstance-292307318-router', 'tenant_id': '4bcdcc410bb7407eb15e956f1cf3816f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.238'}], 'enable_snat': True}, 'gw_port_id': '18fb2347-22cb-4478-9bc6-8008249183c5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:24:16Z', 'updated_at': '2021-05-20T04:24:23Z', 'revision_number': 4, 'project_id': '4bcdcc410bb7407eb15e956f1cf3816f', 'gw_port': {'id': '18fb2347-22cb-4478-9bc6-8008249183c5', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:fb:ff:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5de71c93-6369-4531-861a-910439b7d267', 'device_owner': 'network:router_gateway', 'standard_attr_id': 413, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.238', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:24:17Z', 'updated_at': '2021-05-20T04:24:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_interfaces': [{'id': 'f3bb6458-7b30-451b-a7f3-5288f527e9cf', 'name': '', 'network_id': '4bb43617-e5b5-4e08-aa62-fcff79192e08', 'tenant_id': '4bcdcc410bb7407eb15e956f1cf3816f', 'mac_address': 'fa:16:3e:60:72:a3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5de71c93-6369-4531-861a-910439b7d267', 'device_owner': 'network:router_interface', 'standard_attr_id': 414, 'fixed_ips': [{'subnet_id': '7ed199e2-8424-415a-b375-501cfccc5d60', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:24:22Z', 'updated_at': '2021-05-20T04:24:28Z', 'revision_number': 4, 'project_id': '4bcdcc410bb7407eb15e956f1cf3816f', 'subnets': [{'id': '7ed199e2-8424-415a-b375-501cfccc5d60', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91688) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 04:24:30.068500 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-8602e503-a410-4aca-b61d-ea6fd5c58e8c req-a253733f-3ff2-4965-9bd4-999646dc48cf tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1326644
May 20 04:24:30.662349 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb7e5f83-fde2-4cc8-bbb2-7c53f2cd08b5 req-e4ef20ec-0d02-470f-b6d2-005fafc2b17f tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:30.684481 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-eb7e5f83-fde2-4cc8-bbb2-7c53f2cd08b5 req-e4ef20ec-0d02-470f-b6d2-005fafc2b17f tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 931 time: 0.3677216
May 20 04:24:30.819502 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-eb7e5f83-fde2-4cc8-bbb2-7c53f2cd08b5 req-3bec98b6-babe-4918-bf96-4d8c1e269766 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1324275
May 20 04:24:30.953101 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device f3bb6458-7b30-451b-a7f3-5288f527e9cf up at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:24:31.053975 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning for port f3bb6458-7b30-451b-a7f3-5288f527e9cf completed by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:24:31.060625 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning complete for port f3bb6458-7b30-451b-a7f3-5288f527e9cf triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:24:31.061301 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:31.305006 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:31.353726 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] For port f3bb6458-7b30-451b-a7f3-5288f527e9cf, host dv-cinder-790910-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=f3bb6458-7b30-451b-a7f3-5288f527e9cf,segment=NetworkSegment(7409db9e-5fb3-453d-b7d4-3cbc720cb9d4),segment_id=7409db9e-5fb3-453d-b7d4-3cbc720cb9d4)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:24:31.365944 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:31.368514 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:24:31.445103 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Pushing event updated for resources: {'Port': ['ID=f3bb6458-7b30-451b-a7f3-5288f527e9cf,revision_number=5']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:24:31.448521 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:24:31.583752 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9078c235-f570-47e6-ae44-f8b3b80d2715 req-f375bc08-fbdc-41fc-89bc-a3aeceab8a4f tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:31.585484 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9078c235-f570-47e6-ae44-f8b3b80d2715 req-f375bc08-fbdc-41fc-89bc-a3aeceab8a4f tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.1027963
May 20 04:24:31.646885 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9078c235-f570-47e6-ae44-f8b3b80d2715 req-5d02dd9a-a1bc-4803-b671-ad87bf3ba0c5 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0497656
May 20 04:24:32.045422 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3361dcb8-8e11-4054-a87e-bdcff133ee57 req-15ab003f-e4d5-4a1a-bf80-36b167003e35 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:32.046962 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-3361dcb8-8e11-4054-a87e-bdcff133ee57 req-15ab003f-e4d5-4a1a-bf80-36b167003e35 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 931 time: 0.0908175
May 20 04:24:32.097187 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-3361dcb8-8e11-4054-a87e-bdcff133ee57 req-41703506-e8d1-414c-b8a3-5c8770aefb47 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0438933
May 20 04:24:32.539822 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:32.705472 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-8ffdef80-0917-48bc-8567-00aa7f8f36b7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:32.802396 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device f3bb6458-7b30-451b-a7f3-5288f527e9cf up at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:24:32.956456 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning complete for port f3bb6458-7b30-451b-a7f3-5288f527e9cf triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:24:32.957127 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:33.007183 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6224916-29bd-4360-8f0b-75c3d78ba7f5 req-3b8b2c68-aafe-4974-813e-dfbf91f66b01 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:33.023017 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-c6224916-29bd-4360-8f0b-75c3d78ba7f5 req-3b8b2c68-aafe-4974-813e-dfbf91f66b01 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.1923330
May 20 04:24:33.092265 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-c6224916-29bd-4360-8f0b-75c3d78ba7f5 req-dbcd8584-4456-44cc-a153-e6cf8c474c27 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0671499
May 20 04:24:33.318044 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ea4803bd-878f-47d5-9084-1ec41953c9db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:33.331970 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f4e27fb-9466-4b5a-b9a0-deeb81784c7e req-4d38c0de-f331-4d2d-a06d-a27607ba87ab tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:33.334113 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-8f4e27fb-9466-4b5a-b9a0-deeb81784c7e req-4d38c0de-f331-4d2d-a06d-a27607ba87ab tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 931 time: 0.0938501
May 20 04:24:33.438210 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-8f4e27fb-9466-4b5a-b9a0-deeb81784c7e req-e9877421-9006-4d54-84af-eb54161b30d6 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0802677
May 20 04:24:33.653618 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:33.944560 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.agents_db [None req-92d61f12-17bc-4bf9-9eab-8a69b8c6da2f None None] Agent healthcheck: found 6 active agents {{(pid=91689) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 04:24:34.335337 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d32e8480-652d-4c14-9e43-658644157984 req-0187dd9b-07d2-44db-a718-0bde4af8fbf0 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:34.336869 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-d32e8480-652d-4c14-9e43-658644157984 req-0187dd9b-07d2-44db-a718-0bde4af8fbf0 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.1212897
May 20 04:24:34.384402 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-d32e8480-652d-4c14-9e43-658644157984 req-ddc05c53-d299-42ea-b64d-a3b67ff97d0a tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0414617
May 20 04:24:34.643180 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2afad58-da6b-4cc9-a15d-8a4339c8e7d2 req-d3a9dd8b-8357-48de-b7b2-09babcdec461 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:34.644744 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-d2afad58-da6b-4cc9-a15d-8a4339c8e7d2 req-d3a9dd8b-8357-48de-b7b2-09babcdec461 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 931 time: 0.0946317
May 20 04:24:34.692926 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-d2afad58-da6b-4cc9-a15d-8a4339c8e7d2 req-6d0b58e2-56f2-48c1-b187-5dbfe10a397a tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0420961
May 20 04:24:35.181915 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f21320cc-6a25-4ec1-8a32-8b119b35fd55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:35.620012 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04189ee2-8e40-4732-a397-0397d4186693 req-e5cb2016-1539-4c1a-ad8d-7515658308fa tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:35.621611 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-04189ee2-8e40-4732-a397-0397d4186693 req-e5cb2016-1539-4c1a-ad8d-7515658308fa tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.1030266
May 20 04:24:35.681336 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-04189ee2-8e40-4732-a397-0397d4186693 req-5173b7be-cb59-415b-8f19-3791a012dd3e tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0526464
May 20 04:24:35.919962 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07c80fb8-3da9-422d-9ee6-d3713df72ffe req-eebc81ad-3947-481d-be64-67f0bf6d5404 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:35.922591 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-07c80fb8-3da9-422d-9ee6-d3713df72ffe req-eebc81ad-3947-481d-be64-67f0bf6d5404 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 931 time: 0.0978148
May 20 04:24:35.991584 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-07c80fb8-3da9-422d-9ee6-d3713df72ffe req-798727aa-ca98-4de9-ab81-2bd360e82ea7 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0607820
May 20 04:24:36.894116 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07ebd0a9-93dc-4901-a8bf-c658e1497137 req-e9dc2898-42c5-4aa1-91cc-a7349c477338 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:36.895652 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-07ebd0a9-93dc-4901-a8bf-c658e1497137 req-e9dc2898-42c5-4aa1-91cc-a7349c477338 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.0892684
May 20 04:24:36.945130 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-07ebd0a9-93dc-4901-a8bf-c658e1497137 req-8f6840ac-6cad-470b-b1aa-53bce4b15c1a tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0427814
May 20 04:24:37.181829 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e448d1d7-c7b7-4428-a0cc-269279a5eb22 req-3fbd132f-1772-4bd1-90a3-137dbbfae4a9 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:37.183378 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-e448d1d7-c7b7-4428-a0cc-269279a5eb22 req-3fbd132f-1772-4bd1-90a3-137dbbfae4a9 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 931 time: 0.0842454
May 20 04:24:37.255776 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-e448d1d7-c7b7-4428-a0cc-269279a5eb22 req-1214653d-5a8a-4034-95fd-c9da27882eb4 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0641534
May 20 04:24:38.144640 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a0c07c9-4efd-4d1f-a047-e846ccffa5e3 req-e91c2c0c-1042-45b8-83ea-3b826d4073b6 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:38.146032 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-1a0c07c9-4efd-4d1f-a047-e846ccffa5e3 req-e91c2c0c-1042-45b8-83ea-3b826d4073b6 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.0876069
May 20 04:24:38.198309 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-1a0c07c9-4efd-4d1f-a047-e846ccffa5e3 req-64c74139-0746-45e4-b19b-4fb8e581840b tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0461826
May 20 04:24:38.514963 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f848a01-3742-4ba8-82ae-96982dfc9194 req-f2dc2bd1-33ea-4c27-9b2d-dda80fde065d tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:38.516637 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-6f848a01-3742-4ba8-82ae-96982dfc9194 req-f2dc2bd1-33ea-4c27-9b2d-dda80fde065d tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 931 time: 0.1250193
May 20 04:24:38.570242 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-6f848a01-3742-4ba8-82ae-96982dfc9194 req-a271c12a-2974-4725-abd2-bd5ce03cb0dc tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0471218
May 20 04:24:39.391085 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f7b186a-dce5-4326-9775-ee107578f73a req-561c63de-c0c3-4ff0-93f9-d192c7734fb6 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:39.392485 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-1f7b186a-dce5-4326-9775-ee107578f73a req-561c63de-c0c3-4ff0-93f9-d192c7734fb6 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.0818632
May 20 04:24:39.442257 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-1f7b186a-dce5-4326-9775-ee107578f73a req-57e93bd4-1e38-4399-a954-49e02b7a07cb tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0428319
May 20 04:24:39.850851 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fa36339-9822-4911-9cf2-3ab7117e6aa8 req-717f80a2-913e-4970-b35d-32b84c93529f tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:39.851771 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-0fa36339-9822-4911-9cf2-3ab7117e6aa8 req-717f80a2-913e-4970-b35d-32b84c93529f tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 931 time: 0.1529582
May 20 04:24:39.906692 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-0fa36339-9822-4911-9cf2-3ab7117e6aa8 req-eb16e62c-d893-486b-81d3-bd5d7fbc4ac4 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0424824
May 20 04:24:40.636303 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c97c1418-4852-4c28-b445-b551a9313b25 req-bceb7f59-e513-47c8-9cf3-d8bec9c857ff tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:40.637813 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-c97c1418-4852-4c28-b445-b551a9313b25 req-bceb7f59-e513-47c8-9cf3-d8bec9c857ff tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.0825984
May 20 04:24:40.687893 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-c97c1418-4852-4c28-b445-b551a9313b25 req-f38b69b2-9c12-4270-85f9-34f3d231e0d9 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0429311
May 20 04:24:41.111892 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1372ee3-7e67-4db8-8cc8-4020219ce61f req-d0771fb4-bb58-4557-85c8-2fc6c7e71709 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:41.113632 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-c1372ee3-7e67-4db8-8cc8-4020219ce61f req-d0771fb4-bb58-4557-85c8-2fc6c7e71709 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 931 time: 0.0922754
May 20 04:24:41.159048 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-c1372ee3-7e67-4db8-8cc8-4020219ce61f req-131f3681-d1b7-408a-be53-fa2e8aaabf5a tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0397174
May 20 04:24:41.888593 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00ea0eb6-d97e-4214-ae7f-782a18ec86a9 req-5766751a-144f-4019-aadb-4b1e8a190f23 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:41.890137 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-00ea0eb6-d97e-4214-ae7f-782a18ec86a9 req-5766751a-144f-4019-aadb-4b1e8a190f23 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.0902674
May 20 04:24:41.938711 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-00ea0eb6-d97e-4214-ae7f-782a18ec86a9 req-aae20531-d5fa-424c-bc8e-f54170a5b2ec tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0425737
May 20 04:24:42.354432 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d95e3ca6-bbce-429e-8cd8-b2f87942854b req-d7afb885-43f6-4d63-b178-0cfcfb47fb38 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:42.355952 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-d95e3ca6-bbce-429e-8cd8-b2f87942854b req-d7afb885-43f6-4d63-b178-0cfcfb47fb38 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 931 time: 0.0850627
May 20 04:24:42.403438 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-d95e3ca6-bbce-429e-8cd8-b2f87942854b req-33568155-2397-4262-bdf5-9211228aacaa tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0413895
May 20 04:24:43.154182 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d775cfa-b585-43f9-8075-503ce85b7e53 req-1c9fd456-43f6-47fd-8dae-ae1fa3d9bc55 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:43.155683 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9d775cfa-b585-43f9-8075-503ce85b7e53 req-1c9fd456-43f6-47fd-8dae-ae1fa3d9bc55 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.0983930
May 20 04:24:43.208983 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9d775cfa-b585-43f9-8075-503ce85b7e53 req-fc1c4354-4772-4308-bb32-3583dd831995 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0468788
May 20 04:24:43.612583 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-556001e5-1392-421e-aee9-97b8ee1cd1fd req-9eddb598-28a4-4b52-b8ac-708a47ef5d42 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:43.614184 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-556001e5-1392-421e-aee9-97b8ee1cd1fd req-9eddb598-28a4-4b52-b8ac-708a47ef5d42 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 931 time: 0.0831201
May 20 04:24:43.664526 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-556001e5-1392-421e-aee9-97b8ee1cd1fd req-317a21fa-68d2-406e-8415-68a1061febf7 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0439973
May 20 04:24:44.417213 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ead6ae4d-e8d8-4073-b41b-d9628ab269f0 req-b0448068-a57f-4478-bdea-84a927826747 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:44.417823 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-ead6ae4d-e8d8-4073-b41b-d9628ab269f0 req-b0448068-a57f-4478-bdea-84a927826747 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.0936966
May 20 04:24:44.464852 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-ead6ae4d-e8d8-4073-b41b-d9628ab269f0 req-bcef4c04-321a-4942-9c57-f8905c646440 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0400963
May 20 04:24:44.869820 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c99e46cc-574f-4707-bc0c-dc27e9b65c9b req-206c9d6f-fd10-4e04-9943-1698e2ffa6de tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:44.871429 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-c99e46cc-574f-4707-bc0c-dc27e9b65c9b req-206c9d6f-fd10-4e04-9943-1698e2ffa6de tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 931 time: 0.0860214
May 20 04:24:44.933830 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-c99e46cc-574f-4707-bc0c-dc27e9b65c9b req-ae1b8d53-46ec-4b04-a4e6-e31cafaa9dd7 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0531218
May 20 04:24:45.660788 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac61a0cd-16e8-4492-93fe-68df3e995658 req-11f254c8-13e7-4268-b176-f85350cbc5d5 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:45.662511 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-ac61a0cd-16e8-4492-93fe-68df3e995658 req-11f254c8-13e7-4268-b176-f85350cbc5d5 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.0852067
May 20 04:24:45.717224 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-ac61a0cd-16e8-4492-93fe-68df3e995658 req-9f00c424-845c-47b9-9c0d-22572c99a3ee tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0438271
May 20 04:24:46.143568 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7f81aae-2e8f-4e18-b3a2-0025967657d9 req-b2c44915-5960-4bc3-ae26-961d77d64623 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:46.145029 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-c7f81aae-2e8f-4e18-b3a2-0025967657d9 req-b2c44915-5960-4bc3-ae26-961d77d64623 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 931 time: 0.0940073
May 20 04:24:46.191339 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-c7f81aae-2e8f-4e18-b3a2-0025967657d9 req-29ab1787-6e0e-4359-a4dd-1c7fab74085b tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0403805
May 20 04:24:46.372162 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [req-8731d2b6-6443-4004-9381-96016b96d47c req-d3ec6aea-5da8-4b00-b67d-6b2b5becaf98 service neutron] Request body: {'port': {'device_id': 'badc13d9-1d9b-4a5d-a461-b96945f2edc9', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79091'}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:24:46.540211 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-8731d2b6-6443-4004-9381-96016b96d47c req-d3ec6aea-5da8-4b00-b67d-6b2b5becaf98 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:46.616654 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-87933070-d89b-482a-8424-58318db16a05 req-ac7badc0-8ffd-44c8-a50f-32f8b0ed11a3 service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.1551461
May 20 04:24:47.013561 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87933070-d89b-482a-8424-58318db16a05 req-8454b7dc-867f-407c-8bae-6e773134c2c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:47.015060 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-87933070-d89b-482a-8424-58318db16a05 req-8454b7dc-867f-407c-8bae-6e773134c2c4 service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=ef3bec4745b14484ac8e21cd16cbd11d&device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 1099 time: 0.3522110
May 20 04:24:47.194816 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72fe5a87-afb1-4fce-8e07-44432e51fddf req-c73ec353-2742-43ca-9c17-ea4f8d0c92bd tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:47.196243 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-72fe5a87-afb1-4fce-8e07-44432e51fddf req-c73ec353-2742-43ca-9c17-ea4f8d0c92bd tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.3653584
May 20 04:24:47.240659 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.notifiers.nova [req-8731d2b6-6443-4004-9381-96016b96d47c req-d3ec6aea-5da8-4b00-b67d-6b2b5becaf98 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 11028190-b228-415d-b5ee-2da1d6800073 {{(pid=91687) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 04:24:47.256552 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-8731d2b6-6443-4004-9381-96016b96d47c req-d3ec6aea-5da8-4b00-b67d-6b2b5becaf98 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:47.289617 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87933070-d89b-482a-8424-58318db16a05 req-d44f5de3-62ce-4259-b815-6d294d7315e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:47.290979 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-87933070-d89b-482a-8424-58318db16a05 req-d44f5de3-62ce-4259-b815-6d294d7315e9 service neutron] 10.222.0.82 "GET /v2.0/networks?id=21794e86-fda7-40a6-a5a8-db117c7eeb9d HTTP/1.1" status: 200  len: 918 time: 0.2547228
May 20 04:24:47.355241 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.provisioning_blocks [req-8731d2b6-6443-4004-9381-96016b96d47c req-d3ec6aea-5da8-4b00-b67d-6b2b5becaf98 service neutron] Transition to ACTIVE for port object 11028190-b228-415d-b5ee-2da1d6800073 will not be triggered until provisioned by entity L2. {{(pid=91687) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:24:47.365217 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-72fe5a87-afb1-4fce-8e07-44432e51fddf req-1ac5b53f-58d6-4e9a-9b9c-fdbceb649b27 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1590564
May 20 04:24:47.384368 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-8731d2b6-6443-4004-9381-96016b96d47c req-d3ec6aea-5da8-4b00-b67d-6b2b5becaf98 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4162185'] for port, after_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:47.389241 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-5829cef5-8cdd-4e4d-a533-c1c6f2d38399 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:24:47.431591 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b76ee5c-b867-43b8-8bae-67794d402faf req-a70058e8-e1e7-4b42-930b-b14649f8eccf tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:47.434276 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-8b76ee5c-b867-43b8-8bae-67794d402faf req-a70058e8-e1e7-4b42-930b-b14649f8eccf tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 931 time: 0.1234198
May 20 04:24:47.501616 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [req-8b76ee5c-b867-43b8-8bae-67794d402faf req-a15e61fc-f422-4413-ac20-d433a3ff0329 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Synchronizing usage tracker for tenant:e6fe6bea38b946a5a97ea42bf787f1b3 on resource:security_group {{(pid=91686) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:24:47.523942 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [req-8b76ee5c-b867-43b8-8bae-67794d402faf req-a15e61fc-f422-4413-ac20-d433a3ff0329 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Unset dirty status for tenant:e6fe6bea38b946a5a97ea42bf787f1b3 on resource:security_group {{(pid=91686) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:24:47.525490 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-8b76ee5c-b867-43b8-8bae-67794d402faf req-a15e61fc-f422-4413-ac20-d433a3ff0329 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0851257
May 20 04:24:47.580876 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3ec6aea-5da8-4b00-b67d-6b2b5becaf98 service neutron] Pushing event updated for resources: {'Port': ['ID=11028190-b228-415d-b5ee-2da1d6800073,revision_number=2']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:24:47.584296 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-d3ec6aea-5da8-4b00-b67d-6b2b5becaf98 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.195s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:24:47.587912 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-87933070-d89b-482a-8424-58318db16a05 req-f80c038a-4994-4a40-8de2-f01e28c31311 service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=115e1bac-cc4d-40b5-b860-798c85c78924 HTTP/1.1" status: 200  len: 1002 time: 0.2876015
May 20 04:24:47.750766 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87933070-d89b-482a-8424-58318db16a05 req-3a1b424f-1c65-4f1a-9c7c-bacf99072273 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:47.754334 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-87933070-d89b-482a-8424-58318db16a05 req-3a1b424f-1c65-4f1a-9c7c-bacf99072273 service neutron] 10.222.0.82 "GET /v2.0/subnets?id=06f38702-3d3c-4e25-8f84-85483d1ddf28 HTTP/1.1" status: 200  len: 856 time: 0.1585381
May 20 04:24:47.824722 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.managers [req-8731d2b6-6443-4004-9381-96016b96d47c req-d3ec6aea-5da8-4b00-b67d-6b2b5becaf98 service neutron] Attempting to bind port 11028190-b228-415d-b5ee-2da1d6800073 on host hv-cinder-79091 for vnic_type normal with profile  {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 04:24:47.825082 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.managers [req-8731d2b6-6443-4004-9381-96016b96d47c req-d3ec6aea-5da8-4b00-b67d-6b2b5becaf98 service neutron] Attempting to bind port 11028190-b228-415d-b5ee-2da1d6800073 by drivers openvswitch,hyperv on host hv-cinder-79091 at level 0 using segments [{'id': 'b84e1e85-c58b-4982-b59b-cb9584098e15', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 893, 'network_id': 'fdf92998-25fa-4179-ab1b-131af0ce059a'}] {{(pid=91687) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 04:24:47.825410 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8731d2b6-6443-4004-9381-96016b96d47c req-d3ec6aea-5da8-4b00-b67d-6b2b5becaf98 service neutron] Attempting to bind port 11028190-b228-415d-b5ee-2da1d6800073 on network fdf92998-25fa-4179-ab1b-131af0ce059a {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:24:47.839575 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8731d2b6-6443-4004-9381-96016b96d47c req-d3ec6aea-5da8-4b00-b67d-6b2b5becaf98 service neutron] Port 11028190-b228-415d-b5ee-2da1d6800073 on network fdf92998-25fa-4179-ab1b-131af0ce059a not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79091 {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 20 04:24:47.839896 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8731d2b6-6443-4004-9381-96016b96d47c req-d3ec6aea-5da8-4b00-b67d-6b2b5becaf98 service neutron] Attempting to bind port 11028190-b228-415d-b5ee-2da1d6800073 on network fdf92998-25fa-4179-ab1b-131af0ce059a {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:24:47.848409 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8731d2b6-6443-4004-9381-96016b96d47c req-d3ec6aea-5da8-4b00-b67d-6b2b5becaf98 service neutron] Checking agent: {'id': '7cc947fd-92eb-4d43-ad6b-ea002afff217', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79091', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 4, 19, 34), 'started_at': datetime.datetime(2021, 5, 20, 4, 19, 34), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 4, 24, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 04:24:47.848742 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8731d2b6-6443-4004-9381-96016b96d47c req-d3ec6aea-5da8-4b00-b67d-6b2b5becaf98 service neutron] Checking segment: {'id': 'b84e1e85-c58b-4982-b59b-cb9584098e15', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 893, 'network_id': 'fdf92998-25fa-4179-ab1b-131af0ce059a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91687) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:24:47.849187 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8731d2b6-6443-4004-9381-96016b96d47c req-d3ec6aea-5da8-4b00-b67d-6b2b5becaf98 service neutron] Bound using segment: {'id': 'b84e1e85-c58b-4982-b59b-cb9584098e15', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 893, 'network_id': 'fdf92998-25fa-4179-ab1b-131af0ce059a'} {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 04:24:47.849623 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.managers [req-8731d2b6-6443-4004-9381-96016b96d47c req-d3ec6aea-5da8-4b00-b67d-6b2b5becaf98 service neutron] Bound port: 11028190-b228-415d-b5ee-2da1d6800073, host: hv-cinder-79091, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b84e1e85-c58b-4982-b59b-cb9584098e15', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 893, 'network_id': 'fdf92998-25fa-4179-ab1b-131af0ce059a'}}] {{(pid=91687) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 04:24:47.849968 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-8731d2b6-6443-4004-9381-96016b96d47c req-d3ec6aea-5da8-4b00-b67d-6b2b5becaf98 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:47.931128 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87933070-d89b-482a-8424-58318db16a05 req-9ed91330-c706-4101-9865-f30e0a82150b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:47.932600 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-87933070-d89b-482a-8424-58318db16a05 req-9ed91330-c706-4101-9865-f30e0a82150b service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=21794e86-fda7-40a6-a5a8-db117c7eeb9d&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1559455
May 20 04:24:47.989804 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [req-8731d2b6-6443-4004-9381-96016b96d47c req-d3ec6aea-5da8-4b00-b67d-6b2b5becaf98 service neutron] For port 11028190-b228-415d-b5ee-2da1d6800073, host hv-cinder-79091, cleared binding levels {{(pid=91687) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 04:24:48.057088 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [req-8731d2b6-6443-4004-9381-96016b96d47c req-d3ec6aea-5da8-4b00-b67d-6b2b5becaf98 service neutron] For port 11028190-b228-415d-b5ee-2da1d6800073, host hv-cinder-79091, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=11028190-b228-415d-b5ee-2da1d6800073,segment=NetworkSegment(b84e1e85-c58b-4982-b59b-cb9584098e15),segment_id=b84e1e85-c58b-4982-b59b-cb9584098e15)] {{(pid=91687) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 04:24:48.066315 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-8731d2b6-6443-4004-9381-96016b96d47c req-d3ec6aea-5da8-4b00-b67d-6b2b5becaf98 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4162185'] for port, after_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:48.073516 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-b0e22059-8581-460a-836d-a318ac70481c service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:24:48.143127 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8731d2b6-6443-4004-9381-96016b96d47c req-d3ec6aea-5da8-4b00-b67d-6b2b5becaf98 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:48.144178 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-8731d2b6-6443-4004-9381-96016b96d47c req-d3ec6aea-5da8-4b00-b67d-6b2b5becaf98 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for port, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:48.146549 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-8731d2b6-6443-4004-9381-96016b96d47c req-d3ec6aea-5da8-4b00-b67d-6b2b5becaf98 service neutron] 10.222.0.82 "PUT /v2.0/ports/11028190-b228-415d-b5ee-2da1d6800073 HTTP/1.1" status: 200  len: 1093 time: 1.7797120
May 20 04:24:48.147368 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'badc13d9-1d9b-4a5d-a461-b96945f2edc9', 'tag': '11028190-b228-415d-b5ee-2da1d6800073'}] {{(pid=91687) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:24:48.189927 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-87933070-d89b-482a-8424-58318db16a05 req-bb4eee85-a23e-4f0f-8c2a-15e159a3073f service neutron] 10.222.0.82 "GET /v2.0/networks/21794e86-fda7-40a6-a5a8-db117c7eeb9d?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2479110
May 20 04:24:48.207975 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3ec6aea-5da8-4b00-b67d-6b2b5becaf98 service neutron] Pushing event updated for resources: {'Port': ['ID=11028190-b228-415d-b5ee-2da1d6800073,revision_number=3']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:24:48.217947 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-d3ec6aea-5da8-4b00-b67d-6b2b5becaf98 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.144s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:24:48.226442 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'badc13d9-1d9b-4a5d-a461-b96945f2edc9', 'tag': '11028190-b228-415d-b5ee-2da1d6800073', 'status': 'completed', 'code': 200}
May 20 04:24:48.611048 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-87933070-d89b-482a-8424-58318db16a05 req-0be7e0b2-3483-4efb-b4e0-96c867b906f3 service neutron] 10.222.0.82 "GET /v2.0/networks/21794e86-fda7-40a6-a5a8-db117c7eeb9d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2444818
May 20 04:24:48.628651 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77d77b35-d2fd-4e5a-a243-209d4e42433d req-13ac5639-c555-4f26-b868-248488a2bb08 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:48.630135 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-77d77b35-d2fd-4e5a-a243-209d4e42433d req-13ac5639-c555-4f26-b868-248488a2bb08 service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=e6fe6bea38b946a5a97ea42bf787f1b3&device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 1096 time: 0.2294278
May 20 04:24:48.647408 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-947a3e5c-f715-43aa-9cef-9bb91a95125b req-494c544b-4197-48ee-b5cf-05d1dfd0216a tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:48.648942 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-947a3e5c-f715-43aa-9cef-9bb91a95125b req-494c544b-4197-48ee-b5cf-05d1dfd0216a tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.1539719
May 20 04:24:48.707839 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-947a3e5c-f715-43aa-9cef-9bb91a95125b req-7a1d2fe2-f7dd-422e-a116-da68da451144 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0509660
May 20 04:24:48.764018 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c54fbba9-e0d0-4bfb-bcd4-8a53ae1c2c9d req-ff124584-a7ff-4bfd-885a-457e5e9104dc tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:48.766494 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-c54fbba9-e0d0-4bfb-bcd4-8a53ae1c2c9d req-ff124584-a7ff-4bfd-885a-457e5e9104dc tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 943 time: 0.0914254
May 20 04:24:48.822333 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-c54fbba9-e0d0-4bfb-bcd4-8a53ae1c2c9d req-957d6d3d-92d2-43f6-bf60-f9af5cd8cb0a tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0508237
May 20 04:24:49.958694 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf66d257-14ff-4004-bba8-3de92773631f req-c2163877-9a88-4691-b8c2-bf6da1a5995e tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:49.961361 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-cf66d257-14ff-4004-bba8-3de92773631f req-c2163877-9a88-4691-b8c2-bf6da1a5995e tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.1320310
May 20 04:24:50.037837 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-cf66d257-14ff-4004-bba8-3de92773631f req-47fd2a27-b441-41f1-807e-e38d8bbe09f2 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0695050
May 20 04:24:50.234337 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-356dcf81-72aa-4ab5-a64b-561f51b9cb34 req-7971b2ea-9269-41f0-8c5d-13a4b0807122 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:50.235994 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-356dcf81-72aa-4ab5-a64b-561f51b9cb34 req-7971b2ea-9269-41f0-8c5d-13a4b0807122 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 943 time: 0.0926943
May 20 04:24:50.288666 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-356dcf81-72aa-4ab5-a64b-561f51b9cb34 req-5c78758e-dc3b-4369-879e-497939ab38c0 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0441096
May 20 04:24:51.334220 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ca1c240-9552-41e9-8d57-62faf4be97a6 req-ca6fce04-daa3-4a16-af10-5046a3d94683 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:51.338290 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-9ca1c240-9552-41e9-8d57-62faf4be97a6 req-ca6fce04-daa3-4a16-af10-5046a3d94683 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.1031039
May 20 04:24:51.351309 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77d77b35-d2fd-4e5a-a243-209d4e42433d req-b31f33c4-cd81-44e2-bf3b-cbd7e1063791 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:51.352797 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-77d77b35-d2fd-4e5a-a243-209d4e42433d req-b31f33c4-cd81-44e2-bf3b-cbd7e1063791 service neutron] 10.222.0.82 "GET /v2.0/networks?tenant_id=e6fe6bea38b946a5a97ea42bf787f1b3&shared=False HTTP/1.1" status: 200  len: 916 time: 0.1854444
May 20 04:24:51.413031 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-9ca1c240-9552-41e9-8d57-62faf4be97a6 req-984ef3db-8956-4530-ac79-96fc8369b085 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0676377
May 20 04:24:51.631025 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d516213e-06a3-453f-a404-b19a83d889ee req-42215492-7b06-4544-9785-cce594b87af5 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:51.641004 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-d516213e-06a3-453f-a404-b19a83d889ee req-42215492-7b06-4544-9785-cce594b87af5 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 943 time: 0.1201303
May 20 04:24:51.719842 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-d516213e-06a3-453f-a404-b19a83d889ee req-fd365eb7-2695-42a9-8aba-5a6738ec7d76 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0743687
May 20 04:24:52.616511 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28aab66c-5b3c-4c4d-9fbb-865277876d6c req-bf7ee575-9c6b-40d0-bf3d-a4c8cd0f5249 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:52.618029 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-28aab66c-5b3c-4c4d-9fbb-865277876d6c req-bf7ee575-9c6b-40d0-bf3d-a4c8cd0f5249 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.0890234
May 20 04:24:52.678130 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-28aab66c-5b3c-4c4d-9fbb-865277876d6c req-f1fffd2b-c4c3-46be-a0d7-049ee002c414 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0530138
May 20 04:24:52.971668 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-004aad5e-3ed8-4d7e-9d45-61f7251d63f1 req-5d010eec-abf6-4ad0-b272-bee8f8721d47 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:52.974426 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-004aad5e-3ed8-4d7e-9d45-61f7251d63f1 req-5d010eec-abf6-4ad0-b272-bee8f8721d47 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 943 time: 0.1291375
May 20 04:24:53.026432 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-004aad5e-3ed8-4d7e-9d45-61f7251d63f1 req-e4b89f1c-6289-46a9-bbb0-758de94d870c tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0462708
May 20 04:24:53.256519 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77d77b35-d2fd-4e5a-a243-209d4e42433d req-76a95972-6b0a-4196-8139-ae03aba65741 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:53.258209 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-77d77b35-d2fd-4e5a-a243-209d4e42433d req-76a95972-6b0a-4196-8139-ae03aba65741 service neutron] 10.222.0.82 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.2533097
May 20 04:24:53.421018 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8731d2b6-6443-4004-9381-96016b96d47c req-23f39ded-972f-400b-96e8-50fb20fa7965 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:53.423132 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-8731d2b6-6443-4004-9381-96016b96d47c req-23f39ded-972f-400b-96e8-50fb20fa7965 service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=e6fe6bea38b946a5a97ea42bf787f1b3&device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 1096 time: 0.1120245
May 20 04:24:53.536213 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-8731d2b6-6443-4004-9381-96016b96d47c req-a60c7c90-ebae-4378-9cd2-cc56e15ccfed service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=11028190-b228-415d-b5ee-2da1d6800073 HTTP/1.1" status: 200  len: 217 time: 0.1005666
May 20 04:24:53.626124 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8731d2b6-6443-4004-9381-96016b96d47c req-8e712e91-6371-4226-a6cd-46ce24744839 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:53.627802 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-8731d2b6-6443-4004-9381-96016b96d47c req-8e712e91-6371-4226-a6cd-46ce24744839 service neutron] 10.222.0.82 "GET /v2.0/subnets?id=e905ed23-00d1-4991-b3bb-e1a1e32b4c86 HTTP/1.1" status: 200  len: 854 time: 0.0832171
May 20 04:24:53.750868 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8731d2b6-6443-4004-9381-96016b96d47c req-b4099674-18a8-4882-9a24-134d30d8ce92 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:53.752705 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-8731d2b6-6443-4004-9381-96016b96d47c req-b4099674-18a8-4882-9a24-134d30d8ce92 service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=fdf92998-25fa-4179-ab1b-131af0ce059a&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1177537
May 20 04:24:54.035810 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-8731d2b6-6443-4004-9381-96016b96d47c req-a218bd4b-9f8b-49d0-b047-5176cf7260b9 service neutron] 10.222.0.82 "GET /v2.0/networks/fdf92998-25fa-4179-ab1b-131af0ce059a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1690369
May 20 04:24:54.048362 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73d14f48-68b1-43f8-8deb-6c5082c14404 req-d58b40d4-944d-406a-90f5-952078476367 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:54.055964 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-73d14f48-68b1-43f8-8deb-6c5082c14404 req-d58b40d4-944d-406a-90f5-952078476367 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.2375357
May 20 04:24:54.204888 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-73d14f48-68b1-43f8-8deb-6c5082c14404 req-d6aef4fa-b7ac-4a8d-9195-fd96968ad878 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1477818
May 20 04:24:54.250114 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-8731d2b6-6443-4004-9381-96016b96d47c req-6281b6d3-8133-475d-8042-79cef9a23133 service neutron] 10.222.0.82 "GET /v2.0/networks/fdf92998-25fa-4179-ab1b-131af0ce059a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1770623
May 20 04:24:54.440704 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b245b1d9-053c-4400-ad37-3c974e9ecd0a req-5ec28725-88c0-4ef7-a7fb-bec11fbba31b tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:54.443372 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-b245b1d9-053c-4400-ad37-3c974e9ecd0a req-5ec28725-88c0-4ef7-a7fb-bec11fbba31b tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 943 time: 0.1157029
May 20 04:24:54.498812 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-b245b1d9-053c-4400-ad37-3c974e9ecd0a req-1c8e994c-cbc6-48d6-b21d-e576c7c1bd18 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0489829
May 20 04:24:55.570948 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8911523-2ada-40be-a68b-304ec7a8295c req-5e2b3f82-2a41-4161-ad71-6d68984eb37c tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:55.574553 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-e8911523-2ada-40be-a68b-304ec7a8295c req-5e2b3f82-2a41-4161-ad71-6d68984eb37c tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.1709960
May 20 04:24:55.678619 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-e8911523-2ada-40be-a68b-304ec7a8295c req-48552783-1009-4d71-9fc3-6dc08b58b907 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0966198
May 20 04:24:56.006902 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a494229-ebd6-4347-851b-05a2131f405b req-dae2e57a-2632-40b7-8b74-c76a7d088d89 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:56.009694 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-7a494229-ebd6-4347-851b-05a2131f405b req-dae2e57a-2632-40b7-8b74-c76a7d088d89 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 943 time: 0.1944282
May 20 04:24:56.102270 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-7a494229-ebd6-4347-851b-05a2131f405b req-1ce7dc72-59a0-480c-a5a9-ff3b587b1b57 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0815485
May 20 04:24:56.316576 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e1675ae-fba7-4da9-9cd2-22fe13072f5c req-44dfd270-a034-4c02-a709-4843e0f76e6e tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:56.319108 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-8e1675ae-fba7-4da9-9cd2-22fe13072f5c req-44dfd270-a034-4c02-a709-4843e0f76e6e tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/networks?id=20ab5e30-591a-443a-9e34-f3a1b7563f5d HTTP/1.1" status: 200  len: 815 time: 0.2414925
May 20 04:24:56.342706 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-8e1675ae-fba7-4da9-9cd2-22fe13072f5c req-995cb47b-9820-4e63-b8dd-a0e2ad632c1e tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/quotas/6484c55ce8204dc3802efc929a51c4a5 HTTP/1.1" status: 200  len: 375 time: 0.0169466
May 20 04:24:56.518874 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-8e1675ae-fba7-4da9-9cd2-22fe13072f5c req-34fe5f26-b510-4748-95a4-bd667399193b tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?tenant_id=6484c55ce8204dc3802efc929a51c4a5&fields=id HTTP/1.1" status: 200  len: 302 time: 0.1675463
May 20 04:24:56.802231 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-8e1675ae-fba7-4da9-9cd2-22fe13072f5c req-5f02d6e7-1f62-4751-afaf-5fbb8dc4352b service neutron] 10.222.0.71 "GET /v2.0/networks/20ab5e30-591a-443a-9e34-f3a1b7563f5d?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2760832
May 20 04:24:56.982018 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-8e1675ae-fba7-4da9-9cd2-22fe13072f5c req-fae89ef5-74e3-416c-9b01-312c276c7352 service neutron] 10.222.0.71 "GET /v2.0/networks/20ab5e30-591a-443a-9e34-f3a1b7563f5d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1732817
May 20 04:24:57.031747 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f6a72d2-5976-40b0-bbca-675f9a8eb59f req-052f3c93-b9a4-42b2-ac55-03db6615dee3 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:57.033533 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-8f6a72d2-5976-40b0-bbca-675f9a8eb59f req-052f3c93-b9a4-42b2-ac55-03db6615dee3 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.1017461
May 20 04:24:57.110587 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-8f6a72d2-5976-40b0-bbca-675f9a8eb59f req-4546db4c-3ce4-4a93-866f-8fee9cc23fa3 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0698657
May 20 04:24:57.228052 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-cda1edf7-8153-439f-9383-781bf2b2abbf req-4693fb18-6b4b-445a-8d77-1df1f07e0fba tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=69d5fa5c-ad33-4afb-bf39-39cd00f6030c HTTP/1.1" status: 200  len: 210 time: 0.0824945
May 20 04:24:57.448879 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-906c8281-56c4-465f-9cbe-f66c629516a4 req-78793b44-087a-4ebc-968e-49a2e6773b35 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:57.451715 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-906c8281-56c4-465f-9cbe-f66c629516a4 req-78793b44-087a-4ebc-968e-49a2e6773b35 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 943 time: 0.1249089
May 20 04:24:57.554909 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-906c8281-56c4-465f-9cbe-f66c629516a4 req-387ada9c-3d0f-437e-ac58-ad257977afc1 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0932610
May 20 04:24:58.340506 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec14a162-c9ec-40e6-a939-c1cbb94c7d84 req-aaaaadc4-606a-4e6e-8280-8b6f8d9cd262 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:58.342105 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-ec14a162-c9ec-40e6-a939-c1cbb94c7d84 req-aaaaadc4-606a-4e6e-8280-8b6f8d9cd262 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.0829036
May 20 04:24:58.394647 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-ec14a162-c9ec-40e6-a939-c1cbb94c7d84 req-e27ea695-0163-4850-9390-deb90d842fbc tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0461745
May 20 04:24:58.545044 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9898fa8b-1611-4c35-a666-4113af421227 req-e9294e88-524d-472d-84b1-76bc2faddefb tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=69d5fa5c-ad33-4afb-bf39-39cd00f6030c HTTP/1.1" status: 200  len: 210 time: 0.0480092
May 20 04:24:58.785523 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed222083-4b07-43b1-b21e-34971421d984 req-153cfbc7-0fc6-410f-9d81-68767159bb38 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:58.786970 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-ed222083-4b07-43b1-b21e-34971421d984 req-153cfbc7-0fc6-410f-9d81-68767159bb38 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 943 time: 0.0903871
May 20 04:24:58.832801 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-ed222083-4b07-43b1-b21e-34971421d984 req-8ab948d0-310b-48f5-a9ee-ed631ead645d tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0392332
May 20 04:24:59.599535 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15b81cb1-0d29-404c-8a91-098a891ed04c req-770e1f78-76a4-43ba-a123-468b67981f99 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:24:59.601208 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-15b81cb1-0d29-404c-8a91-098a891ed04c req-770e1f78-76a4-43ba-a123-468b67981f99 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.0889385
May 20 04:24:59.656306 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 11028190-b228-415d-b5ee-2da1d6800073 details requested by agent hyperv_hv-cinder-79091 with host hv-cinder-79091 {{(pid=91688) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 20 04:24:59.657290 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-15b81cb1-0d29-404c-8a91-098a891ed04c req-74624042-4caa-4b6f-aec5-f84ba234269e tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0479136
May 20 04:24:59.878290 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port 11028190-b228-415d-b5ee-2da1d6800073, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=11028190-b228-415d-b5ee-2da1d6800073,segment=NetworkSegment(b84e1e85-c58b-4982-b59b-cb9584098e15),segment_id=b84e1e85-c58b-4982-b59b-cb9584098e15)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:24:59.899806 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Returning: {'device': '11028190-b228-415d-b5ee-2da1d6800073', 'network_id': 'fdf92998-25fa-4179-ab1b-131af0ce059a', 'port_id': '11028190-b228-415d-b5ee-2da1d6800073', 'mac_address': 'fa:16:3e:ed:24:0e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 893, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'e905ed23-00d1-4991-b3bb-e1a1e32b4c86', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91688) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 20 04:24:59.934044 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-4e8f2ac5-3b9a-49e5-8148-cf52d34a71c9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:24:59.940760 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-853f308e-f93f-42eb-978d-6921c85105bc req-4ffddc7e-3022-4f61-ae60-06c1fec9c2e5 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=69d5fa5c-ad33-4afb-bf39-39cd00f6030c HTTP/1.1" status: 200  len: 210 time: 0.0897410
May 20 04:24:59.980581 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:00.010466 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.notifiers.nova [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 11028190-b228-415d-b5ee-2da1d6800073 {{(pid=91688) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 04:25:00.038129 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port 11028190-b228-415d-b5ee-2da1d6800073, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=11028190-b228-415d-b5ee-2da1d6800073,segment=NetworkSegment(b84e1e85-c58b-4982-b59b-cb9584098e15),segment_id=b84e1e85-c58b-4982-b59b-cb9584098e15)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:25:00.068255 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:00.076072 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-a7f08e44-265b-4e1a-82e1-5cc49fc7642b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:25:00.173539 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Pushing event updated for resources: {'Port': ['ID=11028190-b228-415d-b5ee-2da1d6800073,revision_number=4']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:25:00.177197 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:25:00.283316 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37151ec9-c31e-4b6e-affa-0c53a8ebcbcf req-9f32993a-cbcd-4719-a4c4-720f65b704c3 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:00.284891 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-37151ec9-c31e-4b6e-affa-0c53a8ebcbcf req-9f32993a-cbcd-4719-a4c4-720f65b704c3 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 944 time: 0.1687565
May 20 04:25:00.337465 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-37151ec9-c31e-4b6e-affa-0c53a8ebcbcf req-91ee528f-5287-453e-85fe-4226cbef4bc2 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0418522
May 20 04:25:00.859043 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67fb1852-2ba0-4e47-9326-c25fe6e89624 req-648e39ee-31ee-4b64-89ff-4aaf097a3508 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:00.860505 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-67fb1852-2ba0-4e47-9326-c25fe6e89624 req-648e39ee-31ee-4b64-89ff-4aaf097a3508 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.0790246
May 20 04:25:00.907508 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-67fb1852-2ba0-4e47-9326-c25fe6e89624 req-eb7b47de-0083-45e2-a0dd-6d8503592754 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0407352
May 20 04:25:01.111643 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-fea23885-86b2-4a1d-b066-25ea7a3ec92d req-56dd4cb6-e800-4166-8432-e8c8ff4d57de tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=69d5fa5c-ad33-4afb-bf39-39cd00f6030c HTTP/1.1" status: 200  len: 210 time: 0.0444233
May 20 04:25:01.527745 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d33bf3f6-1983-4071-b0e3-bd558942606f req-0eaa97a6-fecf-4890-b75a-3d9518af66d2 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:01.529409 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-d33bf3f6-1983-4071-b0e3-bd558942606f req-0eaa97a6-fecf-4890-b75a-3d9518af66d2 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 944 time: 0.0825140
May 20 04:25:01.578754 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-d33bf3f6-1983-4071-b0e3-bd558942606f req-21290a97-415f-4190-8304-c46478bc5dac tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0430565
May 20 04:25:02.105146 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-642b0638-256f-4448-8a99-a6c8d728f54b req-49474ef8-0336-41ab-a4e0-fa29127c8def tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:02.106688 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-642b0638-256f-4448-8a99-a6c8d728f54b req-49474ef8-0336-41ab-a4e0-fa29127c8def tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.0862436
May 20 04:25:02.153830 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-642b0638-256f-4448-8a99-a6c8d728f54b req-f7bfcec3-3599-42fd-ab76-c316b52b3079 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0407300
May 20 04:25:02.297886 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-e22c20b2-dae2-4f95-a4e6-8bb8e743a054 req-2af05fed-0d3f-4606-a685-a8e8adafba90 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=69d5fa5c-ad33-4afb-bf39-39cd00f6030c HTTP/1.1" status: 200  len: 210 time: 0.0437756
May 20 04:25:02.544581 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:02.701716 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-15feef37-c634-406b-ab30-8182918010a3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:02.781415 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-526c0cd2-4a73-4c60-94c4-f55c050cf9cf req-72a602b5-a117-4548-a024-aa0531097017 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:02.782560 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-526c0cd2-4a73-4c60-94c4-f55c050cf9cf req-72a602b5-a117-4548-a024-aa0531097017 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 944 time: 0.0868335
May 20 04:25:02.836266 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-526c0cd2-4a73-4c60-94c4-f55c050cf9cf req-2cdafa32-a2f8-41d4-862f-24c635413450 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0472684
May 20 04:25:03.322559 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ea4803bd-878f-47d5-9084-1ec41953c9db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:03.353170 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c958c9f5-2b0d-4f52-9965-f36646922f04 req-40754d21-b41c-4de9-9b7a-f95dcece8abc tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:03.354710 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-c958c9f5-2b0d-4f52-9965-f36646922f04 req-40754d21-b41c-4de9-9b7a-f95dcece8abc tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.0886009
May 20 04:25:03.417478 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-c958c9f5-2b0d-4f52-9965-f36646922f04 req-5df3273d-30b2-4bda-a818-7f26d4ca52a3 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0568180
May 20 04:25:03.450646 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-7d483a00-dd9f-4973-9688-50ebceba0f29 req-78ad35b9-16e1-4e84-ac6d-a1f6c19de759 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=69d5fa5c-ad33-4afb-bf39-39cd00f6030c HTTP/1.1" status: 200  len: 210 time: 0.0427654
May 20 04:25:03.673397 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:03.748463 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e1675ae-fba7-4da9-9cd2-22fe13072f5c req-edc93062-eb8e-464c-a15a-3480f126d40c tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:03.750142 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-8e1675ae-fba7-4da9-9cd2-22fe13072f5c req-edc93062-eb8e-464c-a15a-3480f126d40c tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.82 "GET /v2.0/networks?id=20ab5e30-591a-443a-9e34-f3a1b7563f5d HTTP/1.1" status: 200  len: 815 time: 0.1623287
May 20 04:25:03.765213 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [req-8e1675ae-fba7-4da9-9cd2-22fe13072f5c req-e62c3a91-bce1-4504-b173-2c2616255104 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Request body: {'port': {'device_id': '69d5fa5c-ad33-4afb-bf39-39cd00f6030c', 'network_id': '20ab5e30-591a-443a-9e34-f3a1b7563f5d', 'admin_state_up': True, 'tenant_id': '6484c55ce8204dc3802efc929a51c4a5'}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:25:03.782602 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] get_ports_and_sgs() called for port_ids ['11028190-b228-415d-b5ee-2da1d6800073'] {{(pid=91688) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 04:25:03.920242 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [req-8e1675ae-fba7-4da9-9cd2-22fe13072f5c req-e62c3a91-bce1-4504-b173-2c2616255104 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:25:03.931635 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [req-8e1675ae-fba7-4da9-9cd2-22fe13072f5c req-e62c3a91-bce1-4504-b173-2c2616255104 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:25:03.942572 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-8e1675ae-fba7-4da9-9cd2-22fe13072f5c req-e62c3a91-bce1-4504-b173-2c2616255104 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Made reservation on behalf of 6484c55ce8204dc3802efc929a51c4a5 for: {'port': 1} {{(pid=91687) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 04:25:03.946190 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-8e1675ae-fba7-4da9-9cd2-22fe13072f5c req-e62c3a91-bce1-4504-b173-2c2616255104 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:04.282286 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7343cb46-ba20-4e05-b666-070b13860567 req-db5a0474-ab1c-45b0-9e02-d66e70c2cef6 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:04.285067 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-7343cb46-ba20-4e05-b666-070b13860567 req-db5a0474-ab1c-45b0-9e02-d66e70c2cef6 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 944 time: 0.3182087
May 20 04:25:04.324455 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.db_base_plugin_common [req-8e1675ae-fba7-4da9-9cd2-22fe13072f5c req-e62c3a91-bce1-4504-b173-2c2616255104 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Allocated IP 172.20.0.2 (20ab5e30-591a-443a-9e34-f3a1b7563f5d/2a9c681d-a9be-4897-91bb-31aeb6432254/367f8cc3-bd5c-4497-8fc5-2b73175a0939) {{(pid=91687) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 04:25:04.353857 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-7343cb46-ba20-4e05-b666-070b13860567 req-45faa347-959b-4576-8f77-ffac0430bbfc tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0627060
May 20 04:25:04.573764 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-8e1675ae-fba7-4da9-9cd2-22fe13072f5c req-e62c3a91-bce1-4504-b173-2c2616255104 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Notify callbacks [] for port, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:04.614697 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-8e1675ae-fba7-4da9-9cd2-22fe13072f5c req-e62c3a91-bce1-4504-b173-2c2616255104 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8782892106231', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4162192'] for port, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:04.621906 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-1fbdcfa0-acc0-43fd-a4f6-2b2dfaae1471 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:25:04.711661 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-514b9336-a038-47a5-8106-d10738713323 req-e226196e-7a8e-4633-a2b9-a2949e3176f9 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:04.716319 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-514b9336-a038-47a5-8106-d10738713323 req-e226196e-7a8e-4633-a2b9-a2949e3176f9 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.1258934
May 20 04:25:04.753518 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-8e1675ae-fba7-4da9-9cd2-22fe13072f5c req-e62c3a91-bce1-4504-b173-2c2616255104 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Network 20ab5e30-591a-443a-9e34-f3a1b7563f5d is already hosted by enough agents. {{(pid=91687) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:25:04.760587 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-514b9336-a038-47a5-8106-d10738713323 req-c3003c92-81c7-4c2d-8ecf-d6126d6ea161 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0433731
May 20 04:25:04.772187 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.base_scheduler [req-8e1675ae-fba7-4da9-9cd2-22fe13072f5c req-e62c3a91-bce1-4504-b173-2c2616255104 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Resources bound (agent type, host, resource id):  {{(pid=91687) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:25:04.790129 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.l3_dvrscheduler_db [req-8e1675ae-fba7-4da9-9cd2-22fe13072f5c req-e62c3a91-bce1-4504-b173-2c2616255104 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Received port after_create {{(pid=91687) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 04:25:04.814765 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e62c3a91-bce1-4504-b173-2c2616255104 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Pushing event updated for resources: {'Port': ['ID=367f8cc3-bd5c-4497-8fc5-2b73175a0939,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:25:04.834220 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-e62c3a91-bce1-4504-b173-2c2616255104 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.212s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:25:04.871407 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e1675ae-fba7-4da9-9cd2-22fe13072f5c req-e62c3a91-bce1-4504-b173-2c2616255104 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:04.872049 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-8e1675ae-fba7-4da9-9cd2-22fe13072f5c req-e62c3a91-bce1-4504-b173-2c2616255104 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for port, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:04.884554 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] get_ports_and_sgs() called for port_ids ['9a903ca5-2762-405a-81bb-5c3dce3d256a', 'c84df5e2-cd07-4d01-87c9-ec3a35e2ad93'] {{(pid=91688) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 04:25:04.894725 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-979f6ac4-ab7f-4087-988d-0b1fc3ce2a4e req-90d523ec-07ee-4b7c-80a0-08ef58b453ba tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:04.896299 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-979f6ac4-ab7f-4087-988d-0b1fc3ce2a4e req-90d523ec-07ee-4b7c-80a0-08ef58b453ba tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=69d5fa5c-ad33-4afb-bf39-39cd00f6030c HTTP/1.1" status: 200  len: 931 time: 0.2298961
May 20 04:25:05.001297 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-979f6ac4-ab7f-4087-988d-0b1fc3ce2a4e req-271ee43f-c381-41aa-8f79-520c53021e43 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0972352
May 20 04:25:05.002927 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-8e1675ae-fba7-4da9-9cd2-22fe13072f5c req-e62c3a91-bce1-4504-b173-2c2616255104 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.2425840
May 20 04:25:05.018308 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [req-8e1675ae-fba7-4da9-9cd2-22fe13072f5c req-6daecb28-79ec-4470-93f6-87fc0cad101d service neutron] Request body: {'port': {'device_id': '69d5fa5c-ad33-4afb-bf39-39cd00f6030c', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79091'}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:25:05.239707 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f21320cc-6a25-4ec1-8a32-8b119b35fd55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:05.283310 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-8e1675ae-fba7-4da9-9cd2-22fe13072f5c req-6daecb28-79ec-4470-93f6-87fc0cad101d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:05.707794 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 11028190-b228-415d-b5ee-2da1d6800073 up at agent hyperv_hv-cinder-79091 {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:25:05.732611 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8635d113-da8e-435d-8222-4a6d6eb412c3 req-ec1b879a-f1f4-4c76-a067-30a51aa97308 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:05.734972 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-8635d113-da8e-435d-8222-4a6d6eb412c3 req-ec1b879a-f1f4-4c76-a067-30a51aa97308 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 944 time: 0.0993419
May 20 04:25:05.795137 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.notifiers.nova [req-8e1675ae-fba7-4da9-9cd2-22fe13072f5c req-6daecb28-79ec-4470-93f6-87fc0cad101d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 367f8cc3-bd5c-4497-8fc5-2b73175a0939 {{(pid=91687) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 04:25:05.797900 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Provisioning for port 11028190-b228-415d-b5ee-2da1d6800073 completed by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:25:05.801559 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fbbf361-d1d5-4ad2-a1d5-f0fc4fe03df4 req-1baf8a89-44f4-4ced-b47c-8cd4d83eacef service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:05.803584 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-3fbbf361-d1d5-4ad2-a1d5-f0fc4fe03df4 req-1baf8a89-44f4-4ced-b47c-8cd4d83eacef service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 1098 time: 0.1583745
May 20 04:25:05.808332 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-8e1675ae-fba7-4da9-9cd2-22fe13072f5c req-6daecb28-79ec-4470-93f6-87fc0cad101d service neutron] Notify callbacks [] for port, precommit_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:05.809376 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Provisioning complete for port 11028190-b228-415d-b5ee-2da1d6800073 triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:25:05.811467 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:05.836435 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-8635d113-da8e-435d-8222-4a6d6eb412c3 req-78829185-65eb-4fc4-a42f-df9edcfc142b tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0892658
May 20 04:25:05.843368 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.provisioning_blocks [req-8e1675ae-fba7-4da9-9cd2-22fe13072f5c req-6daecb28-79ec-4470-93f6-87fc0cad101d service neutron] Transition to ACTIVE for port object 367f8cc3-bd5c-4497-8fc5-2b73175a0939 will not be triggered until provisioned by entity L2. {{(pid=91687) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:25:05.871921 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-8e1675ae-fba7-4da9-9cd2-22fe13072f5c req-6daecb28-79ec-4470-93f6-87fc0cad101d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4162185'] for port, after_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:05.884942 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-16df77b6-9316-41df-a571-139cc955c831 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:25:05.951417 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:05.970845 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-3fbbf361-d1d5-4ad2-a1d5-f0fc4fe03df4 req-71bede02-c515-46aa-bec9-cab2e6856280 service neutron] 10.222.0.82 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1570148
May 20 04:25:05.979875 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'badc13d9-1d9b-4a5d-a461-b96945f2edc9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '11028190-b228-415d-b5ee-2da1d6800073'}] {{(pid=91688) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:25:05.992126 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port 11028190-b228-415d-b5ee-2da1d6800073, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=11028190-b228-415d-b5ee-2da1d6800073,segment=NetworkSegment(b84e1e85-c58b-4982-b59b-cb9584098e15),segment_id=b84e1e85-c58b-4982-b59b-cb9584098e15)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:25:05.997334 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:05.999703 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-730b0543-e5fa-4e66-85a9-3a5c52a36f8f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:25:06.075229 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Pushing event updated for resources: {'Port': ['ID=11028190-b228-415d-b5ee-2da1d6800073,revision_number=5']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:25:06.078498 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:25:06.126842 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6daecb28-79ec-4470-93f6-87fc0cad101d service neutron] Pushing event updated for resources: {'Port': ['ID=367f8cc3-bd5c-4497-8fc5-2b73175a0939,revision_number=2']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:25:06.129745 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-6daecb28-79ec-4470-93f6-87fc0cad101d service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.245s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:25:06.186930 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.managers [req-8e1675ae-fba7-4da9-9cd2-22fe13072f5c req-6daecb28-79ec-4470-93f6-87fc0cad101d service neutron] Attempting to bind port 367f8cc3-bd5c-4497-8fc5-2b73175a0939 on host hv-cinder-79091 for vnic_type normal with profile  {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 04:25:06.187267 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.managers [req-8e1675ae-fba7-4da9-9cd2-22fe13072f5c req-6daecb28-79ec-4470-93f6-87fc0cad101d service neutron] Attempting to bind port 367f8cc3-bd5c-4497-8fc5-2b73175a0939 by drivers openvswitch,hyperv on host hv-cinder-79091 at level 0 using segments [{'id': '0ad1d987-000a-4092-8d15-811f90922b00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': '20ab5e30-591a-443a-9e34-f3a1b7563f5d'}] {{(pid=91687) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 04:25:06.187575 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8e1675ae-fba7-4da9-9cd2-22fe13072f5c req-6daecb28-79ec-4470-93f6-87fc0cad101d service neutron] Attempting to bind port 367f8cc3-bd5c-4497-8fc5-2b73175a0939 on network 20ab5e30-591a-443a-9e34-f3a1b7563f5d {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:25:06.196583 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef0e7f14-4771-4839-999a-5d190747461a req-c8d0a4cf-d453-4944-9b76-fbc6ff5cbf70 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:06.198115 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-ef0e7f14-4771-4839-999a-5d190747461a req-c8d0a4cf-d453-4944-9b76-fbc6ff5cbf70 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.2771382
May 20 04:25:06.201816 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8e1675ae-fba7-4da9-9cd2-22fe13072f5c req-6daecb28-79ec-4470-93f6-87fc0cad101d service neutron] Port 367f8cc3-bd5c-4497-8fc5-2b73175a0939 on network 20ab5e30-591a-443a-9e34-f3a1b7563f5d not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79091 {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 20 04:25:06.202158 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8e1675ae-fba7-4da9-9cd2-22fe13072f5c req-6daecb28-79ec-4470-93f6-87fc0cad101d service neutron] Attempting to bind port 367f8cc3-bd5c-4497-8fc5-2b73175a0939 on network 20ab5e30-591a-443a-9e34-f3a1b7563f5d {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:25:06.222491 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8e1675ae-fba7-4da9-9cd2-22fe13072f5c req-6daecb28-79ec-4470-93f6-87fc0cad101d service neutron] Checking agent: {'id': '7cc947fd-92eb-4d43-ad6b-ea002afff217', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79091', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 4, 19, 34), 'started_at': datetime.datetime(2021, 5, 20, 4, 19, 34), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 4, 25, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 04:25:06.222837 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8e1675ae-fba7-4da9-9cd2-22fe13072f5c req-6daecb28-79ec-4470-93f6-87fc0cad101d service neutron] Checking segment: {'id': '0ad1d987-000a-4092-8d15-811f90922b00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': '20ab5e30-591a-443a-9e34-f3a1b7563f5d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91687) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:25:06.223219 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8e1675ae-fba7-4da9-9cd2-22fe13072f5c req-6daecb28-79ec-4470-93f6-87fc0cad101d service neutron] Bound using segment: {'id': '0ad1d987-000a-4092-8d15-811f90922b00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': '20ab5e30-591a-443a-9e34-f3a1b7563f5d'} {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 04:25:06.223644 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.managers [req-8e1675ae-fba7-4da9-9cd2-22fe13072f5c req-6daecb28-79ec-4470-93f6-87fc0cad101d service neutron] Bound port: 367f8cc3-bd5c-4497-8fc5-2b73175a0939, host: hv-cinder-79091, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '0ad1d987-000a-4092-8d15-811f90922b00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': '20ab5e30-591a-443a-9e34-f3a1b7563f5d'}}] {{(pid=91687) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 04:25:06.223987 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-8e1675ae-fba7-4da9-9cd2-22fe13072f5c req-6daecb28-79ec-4470-93f6-87fc0cad101d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:06.306420 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-ef0e7f14-4771-4839-999a-5d190747461a req-34cf13fa-755c-4af6-8a2d-6608022700b6 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1018946
May 20 04:25:06.346066 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [req-8e1675ae-fba7-4da9-9cd2-22fe13072f5c req-6daecb28-79ec-4470-93f6-87fc0cad101d service neutron] For port 367f8cc3-bd5c-4497-8fc5-2b73175a0939, host hv-cinder-79091, cleared binding levels {{(pid=91687) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 04:25:06.350228 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [req-8e1675ae-fba7-4da9-9cd2-22fe13072f5c req-6daecb28-79ec-4470-93f6-87fc0cad101d service neutron] For port 367f8cc3-bd5c-4497-8fc5-2b73175a0939, host hv-cinder-79091, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=367f8cc3-bd5c-4497-8fc5-2b73175a0939,segment=NetworkSegment(0ad1d987-000a-4092-8d15-811f90922b00),segment_id=0ad1d987-000a-4092-8d15-811f90922b00)] {{(pid=91687) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 04:25:06.356277 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-8e1675ae-fba7-4da9-9cd2-22fe13072f5c req-6daecb28-79ec-4470-93f6-87fc0cad101d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4162185'] for port, after_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:06.362222 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-16df77b6-9316-41df-a571-139cc955c831 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:25:06.373725 dv-cinder-790910-4-iscsi neutron-server[91688]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'badc13d9-1d9b-4a5d-a461-b96945f2edc9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '11028190-b228-415d-b5ee-2da1d6800073', 'code': 200}
May 20 04:25:06.441620 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e1675ae-fba7-4da9-9cd2-22fe13072f5c req-6daecb28-79ec-4470-93f6-87fc0cad101d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:06.442323 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-8e1675ae-fba7-4da9-9cd2-22fe13072f5c req-6daecb28-79ec-4470-93f6-87fc0cad101d service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for port, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:06.443956 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-8e1675ae-fba7-4da9-9cd2-22fe13072f5c req-6daecb28-79ec-4470-93f6-87fc0cad101d service neutron] 10.222.0.82 "PUT /v2.0/ports/367f8cc3-bd5c-4497-8fc5-2b73175a0939 HTTP/1.1" status: 200  len: 1093 time: 1.4324911
May 20 04:25:06.444516 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '69d5fa5c-ad33-4afb-bf39-39cd00f6030c', 'tag': '367f8cc3-bd5c-4497-8fc5-2b73175a0939'}] {{(pid=91687) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:25:06.475082 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6daecb28-79ec-4470-93f6-87fc0cad101d service neutron] Pushing event updated for resources: {'Port': ['ID=367f8cc3-bd5c-4497-8fc5-2b73175a0939,revision_number=3']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:25:06.481137 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-6daecb28-79ec-4470-93f6-87fc0cad101d service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:25:06.557008 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '69d5fa5c-ad33-4afb-bf39-39cd00f6030c', 'tag': '367f8cc3-bd5c-4497-8fc5-2b73175a0939', 'status': 'completed', 'code': 200}
May 20 04:25:06.663978 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2df59804-4627-4b12-a969-639cd90d8e7d req-882267e1-8b84-4aec-b765-f1901780d476 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:06.664722 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-2df59804-4627-4b12-a969-639cd90d8e7d req-882267e1-8b84-4aec-b765-f1901780d476 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Synchronizing usage tracker for tenant:6484c55ce8204dc3802efc929a51c4a5 on resource:port {{(pid=91687) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:25:06.740996 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-2df59804-4627-4b12-a969-639cd90d8e7d req-882267e1-8b84-4aec-b765-f1901780d476 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Unset dirty status for tenant:6484c55ce8204dc3802efc929a51c4a5 on resource:port {{(pid=91687) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:25:06.742353 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-2df59804-4627-4b12-a969-639cd90d8e7d req-882267e1-8b84-4aec-b765-f1901780d476 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=69d5fa5c-ad33-4afb-bf39-39cd00f6030c HTTP/1.1" status: 200  len: 943 time: 0.2323484
May 20 04:25:06.766574 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e1675ae-fba7-4da9-9cd2-22fe13072f5c req-20102839-e76e-4e25-aee3-c31ec2b2aa03 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:06.768085 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-8e1675ae-fba7-4da9-9cd2-22fe13072f5c req-20102839-e76e-4e25-aee3-c31ec2b2aa03 service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=6484c55ce8204dc3802efc929a51c4a5&device_id=69d5fa5c-ad33-4afb-bf39-39cd00f6030c HTTP/1.1" status: 200  len: 1096 time: 0.1940703
May 20 04:25:06.858085 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-8e1675ae-fba7-4da9-9cd2-22fe13072f5c req-8dc01a0e-dadf-4498-bf63-af1fece8d6e8 service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=367f8cc3-bd5c-4497-8fc5-2b73175a0939 HTTP/1.1" status: 200  len: 217 time: 0.0798509
May 20 04:25:06.878828 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-2df59804-4627-4b12-a969-639cd90d8e7d req-c032943a-093b-4107-a4e0-e7cbc4417169 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1296489
May 20 04:25:06.941797 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01a457b7-4610-4581-9677-068036b5dde1 req-50f06534-2d4c-4e8f-acb5-c0611c2c458d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:06.944343 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-01a457b7-4610-4581-9677-068036b5dde1 req-50f06534-2d4c-4e8f-acb5-c0611c2c458d service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 1098 time: 0.2752547
May 20 04:25:07.039680 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e1675ae-fba7-4da9-9cd2-22fe13072f5c req-0122fc77-3c12-4d92-ac3c-be280ec25ba9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:07.042201 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-8e1675ae-fba7-4da9-9cd2-22fe13072f5c req-0122fc77-3c12-4d92-ac3c-be280ec25ba9 service neutron] 10.222.0.82 "GET /v2.0/subnets?id=2a9c681d-a9be-4897-91bb-31aeb6432254 HTTP/1.1" status: 200  len: 855 time: 0.1745877
May 20 04:25:07.048640 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-01a457b7-4610-4581-9677-068036b5dde1 req-5cec5e48-0d58-45e5-a1c7-4068261750ff service neutron] 10.222.0.82 "GET /v2.0/security-groups?id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0901427
May 20 04:25:07.074859 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ec5a3fd-8f09-4a88-b1dd-9a1e5c7efb7e req-0504b96f-daa0-4457-aa91-a9bb12a5260f tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:07.077910 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-8ec5a3fd-8f09-4a88-b1dd-9a1e5c7efb7e req-0504b96f-daa0-4457-aa91-a9bb12a5260f tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 945 time: 0.1113260
May 20 04:25:07.129456 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-8ec5a3fd-8f09-4a88-b1dd-9a1e5c7efb7e req-bf151174-f6ac-4f31-86ef-6bdf7418e031 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0408154
May 20 04:25:07.141162 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 40802) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:25:07.185472 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 40808) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:25:07.263797 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-8e1675ae-fba7-4da9-9cd2-22fe13072f5c req-c45802e4-56cb-48fc-bbe9-42789c7585bd service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=20ab5e30-591a-443a-9e34-f3a1b7563f5d&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0427558
May 20 04:25:07.329421 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-4af6c81e-6f6d-46f2-b02a-367d8779a9d9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:07.346347 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-4af6c81e-6f6d-46f2-b02a-367d8779a9d9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:25:07.351933 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-4af6c81e-6f6d-46f2-b02a-367d8779a9d9 admin admin] Usage tracker for resource:security_group_rule and tenant:be8b9398e6aa460ab700a8303575c961 is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:25:07.355658 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-4af6c81e-6f6d-46f2-b02a-367d8779a9d9 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:25:07.362621 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-4af6c81e-6f6d-46f2-b02a-367d8779a9d9 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:25:07.466822 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-4af6c81e-6f6d-46f2-b02a-367d8779a9d9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:07.469658 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-a7e3788e-1ab8-4001-9892-2638c5e155dd admin admin] Notify callbacks [] for security_group, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:07.472472 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-4af6c81e-6f6d-46f2-b02a-367d8779a9d9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:07.484126 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-03254c0c-5617-47e0-85f8-4225335c82a3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:25:07.529278 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-4af6c81e-6f6d-46f2-b02a-367d8779a9d9 admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=be8b9398e6aa460ab700a8303575c961&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3867671
May 20 04:25:07.530627 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4af6c81e-6f6d-46f2-b02a-367d8779a9d9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ad16c812-e6df-4085-a10c-12e00df53b5e,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:25:07.533519 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 40818) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:25:07.546467 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-a7e3788e-1ab8-4001-9892-2638c5e155dd admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:25:07.550663 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-4af6c81e-6f6d-46f2-b02a-367d8779a9d9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.067s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:25:07.562521 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-a7e3788e-1ab8-4001-9892-2638c5e155dd admin admin] Usage tracker for resource:security_group_rule and tenant:901910e88bf74dcfa95fa798c5d21f77 is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:25:07.569215 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-a7e3788e-1ab8-4001-9892-2638c5e155dd admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:25:07.588631 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-a7e3788e-1ab8-4001-9892-2638c5e155dd admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:25:07.609032 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-8e1675ae-fba7-4da9-9cd2-22fe13072f5c req-d29c8631-85f9-4fc7-af07-6292beddd943 service neutron] 10.222.0.82 "GET /v2.0/networks/20ab5e30-591a-443a-9e34-f3a1b7563f5d?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3367617
May 20 04:25:07.626867 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-d160a3aa-8305-44ef-8931-353b1c33f745 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:07.664814 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-d160a3aa-8305-44ef-8931-353b1c33f745 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:07.779972 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e0812f5-7350-44fe-99fa-2ea5b21c0561 req-4f669e19-78b6-45fc-b54f-bc870a1f26d4 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:07.781668 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-0e0812f5-7350-44fe-99fa-2ea5b21c0561 req-4f669e19-78b6-45fc-b54f-bc870a1f26d4 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.3182309
May 20 04:25:07.806300 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-d160a3aa-8305-44ef-8931-353b1c33f745 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:07.813391 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-28af7a2f-52bd-44c4-802b-e11cddc29fa4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:25:07.842654 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d160a3aa-8305-44ef-8931-353b1c33f745 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ad16c812-e6df-4085-a10c-12e00df53b5e,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:25:07.853385 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-d160a3aa-8305-44ef-8931-353b1c33f745 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:25:07.885512 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-d160a3aa-8305-44ef-8931-353b1c33f745 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:07.888188 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-d160a3aa-8305-44ef-8931-353b1c33f745 admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/ad16c812-e6df-4085-a10c-12e00df53b5e HTTP/1.1" status: 204  len: 168 time: 0.3531358
May 20 04:25:07.930049 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-0e0812f5-7350-44fe-99fa-2ea5b21c0561 req-74167b89-5d98-4d48-9144-1c4fe5e3c15b tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1262376
May 20 04:25:07.937687 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-a7e3788e-1ab8-4001-9892-2638c5e155dd admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:07.957675 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-a7e3788e-1ab8-4001-9892-2638c5e155dd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:07.986578 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-5a5b1279-621d-4345-b99e-1f126d68a250 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:25:08.016693 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-8e1675ae-fba7-4da9-9cd2-22fe13072f5c req-8b6d366b-26a6-4049-806b-564f026acd18 service neutron] 10.222.0.82 "GET /v2.0/networks/20ab5e30-591a-443a-9e34-f3a1b7563f5d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3963118
May 20 04:25:08.174315 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-a7e3788e-1ab8-4001-9892-2638c5e155dd admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=901910e88bf74dcfa95fa798c5d21f77&name=default HTTP/1.1" status: 200  len: 2979 time: 0.9834306
May 20 04:25:08.179166 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 40840) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:25:08.248342 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7e3788e-1ab8-4001-9892-2638c5e155dd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2d79c370-44ac-4871-99cb-cc0f2b5f6248,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:25:08.259427 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-a7e3788e-1ab8-4001-9892-2638c5e155dd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.275s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:25:08.331598 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74d33f3d-633a-4da8-b808-21d05e4eb08e req-c6522257-52a3-4fb2-8188-bebaf9095e9f tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:08.332566 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-74d33f3d-633a-4da8-b808-21d05e4eb08e req-c6522257-52a3-4fb2-8188-bebaf9095e9f tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=69d5fa5c-ad33-4afb-bf39-39cd00f6030c HTTP/1.1" status: 200  len: 943 time: 0.2683449
May 20 04:25:08.336291 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18a43ad7-3674-4d23-885d-29334fe96394 req-2693af5c-76df-4e5a-ab27-b33f250aab5b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:08.338628 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-18a43ad7-3674-4d23-885d-29334fe96394 req-2693af5c-76df-4e5a-ab27-b33f250aab5b service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=6484c55ce8204dc3802efc929a51c4a5&device_id=69d5fa5c-ad33-4afb-bf39-39cd00f6030c HTTP/1.1" status: 200  len: 1096 time: 0.1615312
May 20 04:25:08.426291 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-f4ed59d7-c8b6-4b08-99b0-e1502cb2603a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:08.470074 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-f4ed59d7-c8b6-4b08-99b0-e1502cb2603a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:08.471482 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-74d33f3d-633a-4da8-b808-21d05e4eb08e req-610b3a4a-d99d-4162-a147-aaf22d35c20b tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1377757
May 20 04:25:08.515109 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18a43ad7-3674-4d23-885d-29334fe96394 req-77ff5120-42e5-4218-9da4-5599f4f05cbc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:08.516550 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-18a43ad7-3674-4d23-885d-29334fe96394 req-77ff5120-42e5-4218-9da4-5599f4f05cbc service neutron] 10.222.0.82 "GET /v2.0/networks?id=20ab5e30-591a-443a-9e34-f3a1b7563f5d HTTP/1.1" status: 200  len: 916 time: 0.1594977
May 20 04:25:08.517876 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-437e0c20-bc02-4b3b-b089-56209c322dea req-c83e894f-9ae2-41d9-aaae-a121b10ff4af tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:08.519371 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-437e0c20-bc02-4b3b-b089-56209c322dea req-c83e894f-9ae2-41d9-aaae-a121b10ff4af tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 945 time: 0.1721249
May 20 04:25:08.575735 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-437e0c20-bc02-4b3b-b089-56209c322dea req-558de5c3-935d-4d1d-9f2f-523564f4605a tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0503681
May 20 04:25:08.576843 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-f4ed59d7-c8b6-4b08-99b0-e1502cb2603a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:08.582039 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-d556cdab-b038-476e-99eb-5881cb73663a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:25:08.593398 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-18a43ad7-3674-4d23-885d-29334fe96394 req-4f36fe9b-cac8-4452-a774-9439150c3a19 service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=367f8cc3-bd5c-4497-8fc5-2b73175a0939 HTTP/1.1" status: 200  len: 217 time: 0.0678599
May 20 04:25:08.595038 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4ed59d7-c8b6-4b08-99b0-e1502cb2603a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2d79c370-44ac-4871-99cb-cc0f2b5f6248,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:25:08.597505 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-f4ed59d7-c8b6-4b08-99b0-e1502cb2603a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:25:08.602066 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-f4ed59d7-c8b6-4b08-99b0-e1502cb2603a admin admin] Notify callbacks [] for security_group, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:08.603179 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-f4ed59d7-c8b6-4b08-99b0-e1502cb2603a admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/2d79c370-44ac-4871-99cb-cc0f2b5f6248 HTTP/1.1" status: 204  len: 168 time: 0.4212637
May 20 04:25:08.657235 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18a43ad7-3674-4d23-885d-29334fe96394 req-cf210231-c516-4648-b431-949df2e9a5b7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:08.658886 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-18a43ad7-3674-4d23-885d-29334fe96394 req-cf210231-c516-4648-b431-949df2e9a5b7 service neutron] 10.222.0.82 "GET /v2.0/subnets?id=2a9c681d-a9be-4897-91bb-31aeb6432254 HTTP/1.1" status: 200  len: 855 time: 0.0586734
May 20 04:25:08.721500 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-18a43ad7-3674-4d23-885d-29334fe96394 req-29cf6c62-586f-4354-95de-9eff402802f3 service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=20ab5e30-591a-443a-9e34-f3a1b7563f5d&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0525844
May 20 04:25:08.869758 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-18a43ad7-3674-4d23-885d-29334fe96394 req-e5b67f2f-5525-4f05-b002-227034d2ba70 service neutron] 10.222.0.82 "GET /v2.0/networks/20ab5e30-591a-443a-9e34-f3a1b7563f5d?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1400404
May 20 04:25:09.023458 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-18a43ad7-3674-4d23-885d-29334fe96394 req-14578272-cbfb-425b-8a31-2f25ef726190 service neutron] 10.222.0.82 "GET /v2.0/networks/20ab5e30-591a-443a-9e34-f3a1b7563f5d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1457245
May 20 04:25:09.192983 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3fbf816-059a-489f-8ca9-50b6650029b6 req-673e268f-d66b-4b4c-b5cf-87425e4cd216 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:09.194943 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-b3fbf816-059a-489f-8ca9-50b6650029b6 req-673e268f-d66b-4b4c-b5cf-87425e4cd216 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.1512787
May 20 04:25:09.246731 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-b3fbf816-059a-489f-8ca9-50b6650029b6 req-df5aaf34-f3ba-41cd-865c-7787183e462d tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0441048
May 20 04:25:09.781923 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc931d65-3811-4a59-825b-307282bae58a req-4cdebc81-c9d1-4778-869b-8575fd43a090 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:09.784302 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-bc931d65-3811-4a59-825b-307282bae58a req-4cdebc81-c9d1-4778-869b-8575fd43a090 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=69d5fa5c-ad33-4afb-bf39-39cd00f6030c HTTP/1.1" status: 200  len: 943 time: 0.1788933
May 20 04:25:09.847467 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-bc931d65-3811-4a59-825b-307282bae58a req-60ad0395-e269-4e1d-a53a-69e8e87c21f9 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0551734
May 20 04:25:09.976255 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86910964-80dd-4a47-b421-a02b3d71b03f req-04990a0e-d57d-40e4-8308-7c0eb625c16a tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:09.978162 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-86910964-80dd-4a47-b421-a02b3d71b03f req-04990a0e-d57d-40e4-8308-7c0eb625c16a tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 945 time: 0.1197979
May 20 04:25:09.980438 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84dfaa89-4f3e-4007-a00c-8cf807b2dc4e req-afe7c2ec-94a2-418c-9e2a-2ed6c98a0b74 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:09.982293 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-84dfaa89-4f3e-4007-a00c-8cf807b2dc4e req-afe7c2ec-94a2-418c-9e2a-2ed6c98a0b74 service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=b7d86d894a5f420e86f4c28d7772bd22&device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 1098 time: 0.1774988
May 20 04:25:10.044638 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6337688f-8f7b-43c8-9481-d99ef58f86d7 req-d8e3dd32-43ac-4ea6-ac6b-ec4cfdb6ee72 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:10.047323 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-6337688f-8f7b-43c8-9481-d99ef58f86d7 req-d8e3dd32-43ac-4ea6-ac6b-ec4cfdb6ee72 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.1047118
May 20 04:25:10.079183 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 40880) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:25:10.109074 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-86910964-80dd-4a47-b421-a02b3d71b03f req-41ddfc9d-8745-48d0-8465-04a2812b79b0 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1226821
May 20 04:25:10.128867 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-6337688f-8f7b-43c8-9481-d99ef58f86d7 req-a9255a7c-3b54-4fe7-bd45-c12b0dcae881 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0737467
May 20 04:25:10.154872 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84dfaa89-4f3e-4007-a00c-8cf807b2dc4e req-953319f9-619f-4901-ba55-d9383d4cbe78 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:10.157757 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-84dfaa89-4f3e-4007-a00c-8cf807b2dc4e req-953319f9-619f-4901-ba55-d9383d4cbe78 service neutron] 10.222.0.82 "GET /v2.0/networks?id=348b2b0f-c826-45ab-ba85-8430235b9cac HTTP/1.1" status: 200  len: 920 time: 0.1574333
May 20 04:25:10.234434 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-efd3c63c-a8a2-4fb2-afe3-1d7ca57b7603 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:10.250985 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-efd3c63c-a8a2-4fb2-afe3-1d7ca57b7603 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:25:10.255911 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-efd3c63c-a8a2-4fb2-afe3-1d7ca57b7603 admin admin] Usage tracker for resource:security_group_rule and tenant:15afe7c5867142958fc15bcfb56f5fbb is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:25:10.259271 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-efd3c63c-a8a2-4fb2-afe3-1d7ca57b7603 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:25:10.275619 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-efd3c63c-a8a2-4fb2-afe3-1d7ca57b7603 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:25:10.348932 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-84dfaa89-4f3e-4007-a00c-8cf807b2dc4e req-9ece2568-91d9-4157-9156-0d06846a2feb service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=65d523e1-f132-4819-aa42-995ded4a1ad8 HTTP/1.1" status: 200  len: 217 time: 0.1838095
May 20 04:25:10.359652 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-efd3c63c-a8a2-4fb2-afe3-1d7ca57b7603 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:10.364636 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-efd3c63c-a8a2-4fb2-afe3-1d7ca57b7603 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:10.372144 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-4af6c81e-6f6d-46f2-b02a-367d8779a9d9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:25:10.419845 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-efd3c63c-a8a2-4fb2-afe3-1d7ca57b7603 admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=15afe7c5867142958fc15bcfb56f5fbb&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3395846
May 20 04:25:10.421097 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-efd3c63c-a8a2-4fb2-afe3-1d7ca57b7603 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=af75fd2d-fb64-4b50-90bd-ff09d98e7e8e,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:25:10.423296 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 40890) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:25:10.425845 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-efd3c63c-a8a2-4fb2-afe3-1d7ca57b7603 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:25:10.432115 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84dfaa89-4f3e-4007-a00c-8cf807b2dc4e req-7affd423-2425-404f-a444-bfeaf1a4eb16 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:10.435237 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-84dfaa89-4f3e-4007-a00c-8cf807b2dc4e req-7affd423-2425-404f-a444-bfeaf1a4eb16 service neutron] 10.222.0.82 "GET /v2.0/subnets?id=b488dc7d-0e70-4e52-9179-7e6c3e4fb0a1 HTTP/1.1" status: 200  len: 859 time: 0.0768104
May 20 04:25:10.484135 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-84dfaa89-4f3e-4007-a00c-8cf807b2dc4e req-ef0f3718-489a-4b36-91e3-c8632b9f5b8f service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=348b2b0f-c826-45ab-ba85-8430235b9cac&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0420511
May 20 04:25:10.491050 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-379bbc62-71c4-4ef2-b85e-654a4980ac5a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:10.521054 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-379bbc62-71c4-4ef2-b85e-654a4980ac5a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:10.609916 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-379bbc62-71c4-4ef2-b85e-654a4980ac5a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:10.618170 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-23ddbdf1-48e5-4ee6-8693-9eff8e4468fe admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:25:10.635537 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-379bbc62-71c4-4ef2-b85e-654a4980ac5a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=af75fd2d-fb64-4b50-90bd-ff09d98e7e8e,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:25:10.640477 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-379bbc62-71c4-4ef2-b85e-654a4980ac5a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:25:10.644844 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-379bbc62-71c4-4ef2-b85e-654a4980ac5a admin admin] Notify callbacks [] for security_group, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:10.646432 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-379bbc62-71c4-4ef2-b85e-654a4980ac5a admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/af75fd2d-fb64-4b50-90bd-ff09d98e7e8e HTTP/1.1" status: 204  len: 168 time: 0.2221351
May 20 04:25:10.680378 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-84dfaa89-4f3e-4007-a00c-8cf807b2dc4e req-ac4654ed-5a26-4289-9c8c-da85f6a08003 service neutron] 10.222.0.82 "GET /v2.0/networks/348b2b0f-c826-45ab-ba85-8430235b9cac?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1860881
May 20 04:25:10.836752 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-84dfaa89-4f3e-4007-a00c-8cf807b2dc4e req-f3d34b4b-53b4-449a-a0d7-c2eb80520a58 service neutron] 10.222.0.82 "GET /v2.0/networks/348b2b0f-c826-45ab-ba85-8430235b9cac?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1430380
May 20 04:25:10.950842 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.agents_db [None req-92d61f12-17bc-4bf9-9eab-8a69b8c6da2f None None] Agent healthcheck: found 6 active agents {{(pid=91689) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 04:25:11.066184 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39a4a035-1c7a-4291-bca7-1d6368d071bf req-0f21d44b-6402-4041-a441-7cd76c5cecf4 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:11.067816 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-39a4a035-1c7a-4291-bca7-1d6368d071bf req-0f21d44b-6402-4041-a441-7cd76c5cecf4 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=69d5fa5c-ad33-4afb-bf39-39cd00f6030c HTTP/1.1" status: 200  len: 943 time: 0.0965014
May 20 04:25:11.116733 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-39a4a035-1c7a-4291-bca7-1d6368d071bf req-53ca9d1f-95c1-4df3-b128-7f72ab3d7397 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0425105
May 20 04:25:11.314428 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60559c72-70db-4c6a-a22c-b0ffeebf3684 req-6e34603f-d3cb-4fb8-b44b-9d8df02acf3d tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:11.316134 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-60559c72-70db-4c6a-a22c-b0ffeebf3684 req-6e34603f-d3cb-4fb8-b44b-9d8df02acf3d tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 945 time: 0.0917294
May 20 04:25:11.366078 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b685703-a8db-4906-b478-5dc18316b210 req-b7c96237-194a-4e43-b8c7-83a5625c2b83 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:11.368165 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-1b685703-a8db-4906-b478-5dc18316b210 req-b7c96237-194a-4e43-b8c7-83a5625c2b83 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.1193600
May 20 04:25:11.394071 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-60559c72-70db-4c6a-a22c-b0ffeebf3684 req-ce6c05af-6895-42b7-9a7e-33624d2af4d5 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0631747
May 20 04:25:11.424724 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-1b685703-a8db-4906-b478-5dc18316b210 req-78bacf12-0600-4b41-ac25-e0404b3321f0 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0464151
May 20 04:25:11.612537 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 40926) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:25:11.662914 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e607ab1-3f24-48a2-92d4-81e9cc18e09c req-7af7ac83-50f0-4aee-8a73-ffc844933790 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:11.664737 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4e607ab1-3f24-48a2-92d4-81e9cc18e09c req-7af7ac83-50f0-4aee-8a73-ffc844933790 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 945 time: 0.1085997
May 20 04:25:11.679873 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 367f8cc3-bd5c-4497-8fc5-2b73175a0939 details requested by agent hyperv_hv-cinder-79091 with host hv-cinder-79091 {{(pid=91688) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 20 04:25:11.721592 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4e607ab1-3f24-48a2-92d4-81e9cc18e09c req-d75e6121-ac21-416f-83c2-eb3c1fbd4f22 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0463798
May 20 04:25:11.746920 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.v2.base [None req-82119079-54e0-41d8-ad60-f87fc2ed103f admin admin] Request body: {'network': {'name': 'tempest-VolumesSnapshotTestJSON-750530534-network', 'tenant_id': '8a32187e285543a88aae7f4283a9636f'}} {{(pid=91686) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:25:11.752408 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-82119079-54e0-41d8-ad60-f87fc2ed103f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:25:11.757436 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-82119079-54e0-41d8-ad60-f87fc2ed103f admin admin] Usage tracker for resource:network and tenant:8a32187e285543a88aae7f4283a9636f is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:25:11.761418 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-82119079-54e0-41d8-ad60-f87fc2ed103f admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:25:11.769751 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-82119079-54e0-41d8-ad60-f87fc2ed103f admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:25:11.782844 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-82119079-54e0-41d8-ad60-f87fc2ed103f admin admin] Made reservation on behalf of 8a32187e285543a88aae7f4283a9636f for: {'network': 1} {{(pid=91686) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 04:25:11.786114 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-82119079-54e0-41d8-ad60-f87fc2ed103f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-578118'] for network, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:11.803491 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-82119079-54e0-41d8-ad60-f87fc2ed103f admin admin] Notify callbacks [] for security_group, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:11.831412 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port 367f8cc3-bd5c-4497-8fc5-2b73175a0939, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=367f8cc3-bd5c-4497-8fc5-2b73175a0939,segment=NetworkSegment(0ad1d987-000a-4092-8d15-811f90922b00),segment_id=0ad1d987-000a-4092-8d15-811f90922b00)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:25:11.848079 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Returning: {'device': '367f8cc3-bd5c-4497-8fc5-2b73175a0939', 'network_id': '20ab5e30-591a-443a-9e34-f3a1b7563f5d', 'port_id': '367f8cc3-bd5c-4497-8fc5-2b73175a0939', 'mac_address': 'fa:16:3e:f0:e3:86', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 876, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2a9c681d-a9be-4897-91bb-31aeb6432254', 'ip_address': '172.20.0.2'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91688) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 20 04:25:11.903057 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-82119079-54e0-41d8-ad60-f87fc2ed103f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:25:11.908646 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-82119079-54e0-41d8-ad60-f87fc2ed103f admin admin] Usage tracker for resource:security_group_rule and tenant:8a32187e285543a88aae7f4283a9636f is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:25:11.915820 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-82119079-54e0-41d8-ad60-f87fc2ed103f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:25:11.916852 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:11.922267 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-82119079-54e0-41d8-ad60-f87fc2ed103f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:25:11.949428 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.notifiers.nova [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 367f8cc3-bd5c-4497-8fc5-2b73175a0939 {{(pid=91688) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 04:25:11.976595 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port 367f8cc3-bd5c-4497-8fc5-2b73175a0939, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=367f8cc3-bd5c-4497-8fc5-2b73175a0939,segment=NetworkSegment(0ad1d987-000a-4092-8d15-811f90922b00),segment_id=0ad1d987-000a-4092-8d15-811f90922b00)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:25:11.982631 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:11.984589 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:25:12.031668 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-82119079-54e0-41d8-ad60-f87fc2ed103f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:12.035999 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-82119079-54e0-41d8-ad60-f87fc2ed103f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:12.039677 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-8088882d-251f-415b-8b38-3f18cc0f51cb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:25:12.071633 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-82119079-54e0-41d8-ad60-f87fc2ed103f admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 899}  {{(pid=91686) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 20 04:25:12.077448 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82119079-54e0-41d8-ad60-f87fc2ed103f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e79e4ba4-358f-4b35-b5f3-7372b5116def,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:25:12.080841 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Pushing event updated for resources: {'Port': ['ID=367f8cc3-bd5c-4497-8fc5-2b73175a0939,revision_number=4']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:25:12.081431 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-82119079-54e0-41d8-ad60-f87fc2ed103f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:25:12.083913 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:25:12.085582 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-82119079-54e0-41d8-ad60-f87fc2ed103f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1501910'] for segment, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:12.085975 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.db.segments_db [None req-82119079-54e0-41d8-ad60-f87fc2ed103f admin admin] Added segment 3cfe6ee0-17fa-47f2-8f37-995aaef6bfdc of type vlan for network c6308b4a-efff-48c2-b41d-58a08edddda1
May 20 04:25:12.122099 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-82119079-54e0-41d8-ad60-f87fc2ed103f admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8782892092784'] for network, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:12.155120 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-82119079-54e0-41d8-ad60-f87fc2ed103f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1590664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1781430'] for network, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:12.157180 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-82119079-54e0-41d8-ad60-f87fc2ed103f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:12.157967 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-82119079-54e0-41d8-ad60-f87fc2ed103f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for network, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:12.161837 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-d3094b96-60ea-4e42-bbdf-13f522966312 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:25:12.185040 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbf5d815-6686-4170-aea8-44a35d9d365e req-456bc36d-3424-485b-9b32-5ffe1ccaffee tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:12.186882 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-dbf5d815-6686-4170-aea8-44a35d9d365e req-456bc36d-3424-485b-9b32-5ffe1ccaffee tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 945 time: 0.0998869
May 20 04:25:12.245994 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-dbf5d815-6686-4170-aea8-44a35d9d365e req-9a45818d-c295-4a8e-931f-ce1d2ce184c6 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0462370
May 20 04:25:12.301605 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82119079-54e0-41d8-ad60-f87fc2ed103f admin admin] Pushing event updated for resources: {'Network': ['ID=c6308b4a-efff-48c2-b41d-58a08edddda1,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:25:12.305153 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-82119079-54e0-41d8-ad60-f87fc2ed103f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.143s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:25:12.321820 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Network c6308b4a-efff-48c2-b41d-58a08edddda1 details requested by agent ovs-agent-dv-cinder-790910-4-iscsi with host dv-cinder-790910-4-iscsi {{(pid=91688) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 20 04:25:12.322081 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-82119079-54e0-41d8-ad60-f87fc2ed103f admin admin] 10.222.0.71 "POST /v2.0/networks HTTP/1.1" status: 201  len: 886 time: 0.7025943
May 20 04:25:12.322697 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 40940) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:25:12.338998 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.v2.base [None req-295b8786-8605-44f2-8d17-d4fca7dbe11f admin admin] Request body: {'subnet': {'network_id': 'c6308b4a-efff-48c2-b41d-58a08edddda1', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesSnapshotTestJSON-750530534-subnet', 'tenant_id': '8a32187e285543a88aae7f4283a9636f', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=91686) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:25:12.345631 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-295b8786-8605-44f2-8d17-d4fca7dbe11f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:25:12.350884 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-295b8786-8605-44f2-8d17-d4fca7dbe11f admin admin] Usage tracker for resource:subnet and tenant:8a32187e285543a88aae7f4283a9636f is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:25:12.354981 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-295b8786-8605-44f2-8d17-d4fca7dbe11f admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:25:12.363559 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-295b8786-8605-44f2-8d17-d4fca7dbe11f admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:25:12.390554 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47bca76c-ae08-4bb1-aeb2-2432b8acbbe2 req-89f3851e-2a7b-4e62-9aa2-7bf3ec1e6106 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:12.392200 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-47bca76c-ae08-4bb1-aeb2-2432b8acbbe2 req-89f3851e-2a7b-4e62-9aa2-7bf3ec1e6106 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=69d5fa5c-ad33-4afb-bf39-39cd00f6030c HTTP/1.1" status: 200  len: 944 time: 0.1413965
May 20 04:25:12.393455 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-295b8786-8605-44f2-8d17-d4fca7dbe11f admin admin] Made reservation on behalf of 8a32187e285543a88aae7f4283a9636f for: {'subnet': 1} {{(pid=91686) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 04:25:12.396302 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-295b8786-8605-44f2-8d17-d4fca7dbe11f admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-2442182'] for subnet, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:12.529671 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-47bca76c-ae08-4bb1-aeb2-2432b8acbbe2 req-3b87393d-7aaf-4244-b6bf-ebc8b0375942 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1207180
May 20 04:25:12.679447 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40e04d3e-5d26-4d0e-9e81-69c826b0d4bc req-aa0f9dbe-b22d-4129-9f39-ae89a4265f33 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:12.681253 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-40e04d3e-5d26-4d0e-9e81-69c826b0d4bc req-aa0f9dbe-b22d-4129-9f39-ae89a4265f33 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.0979578
May 20 04:25:12.769905 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-40e04d3e-5d26-4d0e-9e81-69c826b0d4bc req-e4336138-ef95-4f30-8356-80d56a2d2c99 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0564513
May 20 04:25:12.925026 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] get_ports_and_sgs() called for port_ids ['367f8cc3-bd5c-4497-8fc5-2b73175a0939'] {{(pid=91688) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 04:25:12.933719 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-295b8786-8605-44f2-8d17-d4fca7dbe11f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-255887', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2114700', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-2442228'] for subnet, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:12.937732 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-c75ec4a4-0774-4efc-873b-169952deddca admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:25:13.002314 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-295b8786-8605-44f2-8d17-d4fca7dbe11f admin admin] Pushing event updated for resources: {'Subnet': ['ID=2dceece0-8bc3-4f29-a183-108f8744d094,revision_number=0']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:25:13.011054 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-295b8786-8605-44f2-8d17-d4fca7dbe11f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:25:13.025539 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-295b8786-8605-44f2-8d17-d4fca7dbe11f admin admin] Checking segment: {'id': '3cfe6ee0-17fa-47f2-8f37-995aaef6bfdc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 899, 'network_id': 'c6308b4a-efff-48c2-b41d-58a08edddda1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91686) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:25:13.025926 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-295b8786-8605-44f2-8d17-d4fca7dbe11f admin admin] Network hostable DHCP agents. Network: c6308b4a-efff-48c2-b41d-58a08edddda1, hostable agents: ['36d27813-c368-4fd7-ae26-0f662e0a96fd'], hosted agents: [] {{(pid=91686) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 20 04:25:13.043781 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-295b8786-8605-44f2-8d17-d4fca7dbe11f admin admin] Network c6308b4a-efff-48c2-b41d-58a08edddda1 is scheduled to be hosted by DHCP agent 36d27813-c368-4fd7-ae26-0f662e0a96fd with binding_index 1 {{(pid=91686) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 20 04:25:13.053993 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.base_scheduler [None req-295b8786-8605-44f2-8d17-d4fca7dbe11f admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-790910-4-iscsi, c6308b4a-efff-48c2-b41d-58a08edddda1) {{(pid=91686) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:25:13.064320 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e34581b2-da71-4e7c-8156-af6c65312ab7 None None] Network c6308b4a-efff-48c2-b41d-58a08edddda1 requested from dv-cinder-790910-4-iscsi {{(pid=91688) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 04:25:13.066371 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-295b8786-8605-44f2-8d17-d4fca7dbe11f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:13.066978 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-295b8786-8605-44f2-8d17-d4fca7dbe11f admin admin] Notify callbacks [] for subnet, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:13.087990 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-295b8786-8605-44f2-8d17-d4fca7dbe11f admin admin] 10.222.0.71 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 850 time: 0.7591121
May 20 04:25:13.320625 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-41eea143-44a3-4bda-9a38-f8b5314ce37a None None] Network c6308b4a-efff-48c2-b41d-58a08edddda1 requested from dv-cinder-790910-4-iscsi {{(pid=91688) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 04:25:13.762365 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9992dca8-36fd-45e8-be4f-bd73d2d3c3bf req-7a8244a6-ba72-4fda-8131-66ff8cf40457 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:13.764888 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9992dca8-36fd-45e8-be4f-bd73d2d3c3bf req-7a8244a6-ba72-4fda-8131-66ff8cf40457 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=69d5fa5c-ad33-4afb-bf39-39cd00f6030c HTTP/1.1" status: 200  len: 944 time: 0.1076767
May 20 04:25:13.854207 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9992dca8-36fd-45e8-be4f-bd73d2d3c3bf req-1d8be42b-ef9b-4822-beb5-c61c095715af tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0800295
May 20 04:25:14.012883 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a68f1be2-963f-42db-b3f9-64c8227ad3f2 req-55993e0f-dc15-435f-81ae-30ae54684634 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:14.014494 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-a68f1be2-963f-42db-b3f9-64c8227ad3f2 req-55993e0f-dc15-435f-81ae-30ae54684634 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.1057513
May 20 04:25:14.066362 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-a68f1be2-963f-42db-b3f9-64c8227ad3f2 req-451b8885-21d0-4631-8649-4cef03518932 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0460536
May 20 04:25:15.061539 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acbfb284-edef-440e-9fd2-9aac53b15c7e req-60397868-8d9c-42ef-b2ed-3c42eee80ae7 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:15.063282 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-acbfb284-edef-440e-9fd2-9aac53b15c7e req-60397868-8d9c-42ef-b2ed-3c42eee80ae7 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=69d5fa5c-ad33-4afb-bf39-39cd00f6030c HTTP/1.1" status: 200  len: 944 time: 0.0916312
May 20 04:25:15.131821 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-acbfb284-edef-440e-9fd2-9aac53b15c7e req-75fc0939-f7a5-46e5-abba-72657bae82e2 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0485389
May 20 04:25:15.301598 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f64b99d-9d47-4aa4-a08b-cf9dcebc6402 req-0e63b4ba-5df0-4884-9a86-d5838d5d1beb tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:15.309147 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-2f64b99d-9d47-4aa4-a08b-cf9dcebc6402 req-0e63b4ba-5df0-4884-9a86-d5838d5d1beb tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.71 "GET /v2.0/networks?id=c6308b4a-efff-48c2-b41d-58a08edddda1 HTTP/1.1" status: 200  len: 813 time: 0.1813097
May 20 04:25:15.325820 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-2f64b99d-9d47-4aa4-a08b-cf9dcebc6402 req-5ebe52b3-5426-46af-89bf-349ef8a9a9fd tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.71 "GET /v2.0/quotas/8a32187e285543a88aae7f4283a9636f HTTP/1.1" status: 200  len: 375 time: 0.0154603
May 20 04:25:15.333437 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9827ac41-db4b-49e0-a837-f3d263070d4c req-d119ec8e-8481-48d1-80fe-f4bb3442c58e tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:15.335416 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-9827ac41-db4b-49e0-a837-f3d263070d4c req-d119ec8e-8481-48d1-80fe-f4bb3442c58e tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.1003375
May 20 04:25:15.390497 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-2f64b99d-9d47-4aa4-a08b-cf9dcebc6402 req-6f1abb37-01c0-49fc-bdfa-8603b330d432 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.71 "GET /v2.0/ports?tenant_id=8a32187e285543a88aae7f4283a9636f&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0637858
May 20 04:25:15.394145 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-9827ac41-db4b-49e0-a837-f3d263070d4c req-fc5fef30-c804-4c1d-97b9-e45aacee554e tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0522428
May 20 04:25:15.533823 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-2f64b99d-9d47-4aa4-a08b-cf9dcebc6402 req-ca03e2fb-a2ba-4590-9d83-f2330f510d01 service neutron] 10.222.0.71 "GET /v2.0/networks/c6308b4a-efff-48c2-b41d-58a08edddda1?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1317697
May 20 04:25:15.689138 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-2f64b99d-9d47-4aa4-a08b-cf9dcebc6402 req-15ce9b43-35fe-4b32-8b7d-48209b35511a service neutron] 10.222.0.71 "GET /v2.0/networks/c6308b4a-efff-48c2-b41d-58a08edddda1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1441004
May 20 04:25:15.698974 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 367f8cc3-bd5c-4497-8fc5-2b73175a0939 up at agent hyperv_hv-cinder-79091 {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:25:15.776560 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Provisioning for port 367f8cc3-bd5c-4497-8fc5-2b73175a0939 completed by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:25:15.783386 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Provisioning complete for port 367f8cc3-bd5c-4497-8fc5-2b73175a0939 triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:25:15.783973 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:15.896072 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9bd23a75-7ee4-4468-b473-666753956f74 req-7ea83bc9-930f-4e28-a4d4-a417332b49d1 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.71 "GET /v2.0/ports?device_id=e503d184-7bd9-4052-b1a1-8cd725e700e4 HTTP/1.1" status: 200  len: 210 time: 0.0455930
May 20 04:25:15.959303 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:15.992655 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '69d5fa5c-ad33-4afb-bf39-39cd00f6030c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '367f8cc3-bd5c-4497-8fc5-2b73175a0939'}] {{(pid=91688) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:25:16.003190 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port 367f8cc3-bd5c-4497-8fc5-2b73175a0939, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=367f8cc3-bd5c-4497-8fc5-2b73175a0939,segment=NetworkSegment(0ad1d987-000a-4092-8d15-811f90922b00),segment_id=0ad1d987-000a-4092-8d15-811f90922b00)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:25:16.011751 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:16.017496 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-8644445b-4d14-465a-a116-1e1f3a9585b8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:25:16.123502 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Pushing event updated for resources: {'Port': ['ID=367f8cc3-bd5c-4497-8fc5-2b73175a0939,revision_number=5']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:25:16.143684 dv-cinder-790910-4-iscsi neutron-server[91688]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '69d5fa5c-ad33-4afb-bf39-39cd00f6030c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '367f8cc3-bd5c-4497-8fc5-2b73175a0939', 'code': 200}
May 20 04:25:16.145013 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:25:16.145375 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:25:16.145798 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:25:16.146359 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:25:16.146935 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:25:16.147504 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:25:16.148163 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:25:16.148719 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:25:16.149257 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:25:16.149807 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:25:16.150464 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:25:16.151032 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:25:16.157240 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.140s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:25:16.171041 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-93cfdad1-3d31-4f96-8bf5-7853f6f3cbd8 req-005ee4e1-898f-44e5-9edd-830ddd78ed2f tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Synchronizing usage tracker for tenant:a1319e4a0fc74f98ba4bb88d8a04086b on resource:security_group {{(pid=91687) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:25:16.196163 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-93cfdad1-3d31-4f96-8bf5-7853f6f3cbd8 req-005ee4e1-898f-44e5-9edd-830ddd78ed2f tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Unset dirty status for tenant:a1319e4a0fc74f98ba4bb88d8a04086b on resource:security_group {{(pid=91687) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:25:16.197950 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-93cfdad1-3d31-4f96-8bf5-7853f6f3cbd8 req-005ee4e1-898f-44e5-9edd-830ddd78ed2f tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1162085151&fields=id&tenant_id=a1319e4a0fc74f98ba4bb88d8a04086b HTTP/1.1" status: 200  len: 267 time: 0.0999370
May 20 04:25:16.379132 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05762b43-3bb5-48a3-b899-624fc19ef857 req-15147270-5195-49fe-97ca-343e29853940 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:16.380937 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-05762b43-3bb5-48a3-b899-624fc19ef857 req-15147270-5195-49fe-97ca-343e29853940 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=69d5fa5c-ad33-4afb-bf39-39cd00f6030c HTTP/1.1" status: 200  len: 945 time: 0.0971143
May 20 04:25:16.437839 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-05762b43-3bb5-48a3-b899-624fc19ef857 req-0a57dba4-1ca7-423b-a7c0-bf1dbfddef2c tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0494967
May 20 04:25:16.538808 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93cfdad1-3d31-4f96-8bf5-7853f6f3cbd8 req-f3e8c947-b5cf-45b9-bc5e-4aa2d6ce955d tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:16.539558 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-93cfdad1-3d31-4f96-8bf5-7853f6f3cbd8 req-f3e8c947-b5cf-45b9-bc5e-4aa2d6ce955d tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Synchronizing usage tracker for tenant:a1319e4a0fc74f98ba4bb88d8a04086b on resource:network {{(pid=91687) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:25:16.562808 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82b29963-84c5-4314-b63e-4619e2bcb011 req-ae58f7f8-ed5f-43ee-be86-ac8fb977c4c7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:16.564416 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-82b29963-84c5-4314-b63e-4619e2bcb011 req-ae58f7f8-ed5f-43ee-be86-ac8fb977c4c7 service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=69d5fa5c-ad33-4afb-bf39-39cd00f6030c HTTP/1.1" status: 200  len: 1098 time: 0.1502101
May 20 04:25:16.565473 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-93cfdad1-3d31-4f96-8bf5-7853f6f3cbd8 req-f3e8c947-b5cf-45b9-bc5e-4aa2d6ce955d tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Unset dirty status for tenant:a1319e4a0fc74f98ba4bb88d8a04086b on resource:network {{(pid=91687) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:25:16.566464 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-93cfdad1-3d31-4f96-8bf5-7853f6f3cbd8 req-f3e8c947-b5cf-45b9-bc5e-4aa2d6ce955d tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/networks?id=e31171ff-f097-446e-b691-bef7aad2fb3b HTTP/1.1" status: 200  len: 809 time: 0.3606074
May 20 04:25:16.605893 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-93cfdad1-3d31-4f96-8bf5-7853f6f3cbd8 req-4680c328-1d3e-4c2a-b848-9597866509de tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/quotas/a1319e4a0fc74f98ba4bb88d8a04086b HTTP/1.1" status: 200  len: 375 time: 0.0303581
May 20 04:25:16.643655 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41f7d709-cd8c-4503-a6c8-a0884a49fe32 req-c3c426c0-0f0d-454c-b7e4-46362a11ab92 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:16.645212 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-41f7d709-cd8c-4503-a6c8-a0884a49fe32 req-c3c426c0-0f0d-454c-b7e4-46362a11ab92 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.0979545
May 20 04:25:16.670525 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-82b29963-84c5-4314-b63e-4619e2bcb011 req-2e4070d5-1a11-4a04-8d6d-380eb4cffaf1 service neutron] 10.222.0.82 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0980325
May 20 04:25:16.700201 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-41f7d709-cd8c-4503-a6c8-a0884a49fe32 req-9543a44a-8a56-4f26-90b2-7cda176325c9 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0457435
May 20 04:25:16.708127 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-93cfdad1-3d31-4f96-8bf5-7853f6f3cbd8 req-0e1f3443-652f-4b2e-aa74-848954de4aac tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/ports?tenant_id=a1319e4a0fc74f98ba4bb88d8a04086b&fields=id HTTP/1.1" status: 200  len: 302 time: 0.0974357
May 20 04:25:16.868010 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-93cfdad1-3d31-4f96-8bf5-7853f6f3cbd8 req-1ef7c260-ee24-4a42-8bee-15f3180e5dce service neutron] 10.222.0.71 "GET /v2.0/networks/e31171ff-f097-446e-b691-bef7aad2fb3b?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1417925
May 20 04:25:17.013938 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-93cfdad1-3d31-4f96-8bf5-7853f6f3cbd8 req-7b2f53bc-8291-47c2-9779-22a4a858eb76 service neutron] 10.222.0.71 "GET /v2.0/networks/e31171ff-f097-446e-b691-bef7aad2fb3b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1395118
May 20 04:25:17.464794 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-cb3c18eb-483c-4532-87c4-da32edd37683 req-955cde7d-ff9e-4cc3-bfc4-6c310ecf9b2a tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.71 "GET /v2.0/ports?device_id=e503d184-7bd9-4052-b1a1-8cd725e700e4 HTTP/1.1" status: 200  len: 210 time: 0.1309733
May 20 04:25:17.577017 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-b90db540-3e18-4ef1-add1-cc2238600a63 req-41a76f24-fdbd-44cd-936b-afca7861fb1a tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 210 time: 0.1012077
May 20 04:25:17.649674 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f64b99d-9d47-4aa4-a08b-cf9dcebc6402 req-b00e56a4-2686-43da-a0c2-b39c419c1b8e tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:17.655056 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-2f64b99d-9d47-4aa4-a08b-cf9dcebc6402 req-b00e56a4-2686-43da-a0c2-b39c419c1b8e tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.82 "GET /v2.0/networks?id=c6308b4a-efff-48c2-b41d-58a08edddda1 HTTP/1.1" status: 200  len: 813 time: 0.3283491
May 20 04:25:17.686259 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [req-2f64b99d-9d47-4aa4-a08b-cf9dcebc6402 req-c9220066-2ed2-4769-aca6-feaab33f4003 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Request body: {'port': {'device_id': 'e503d184-7bd9-4052-b1a1-8cd725e700e4', 'network_id': 'c6308b4a-efff-48c2-b41d-58a08edddda1', 'admin_state_up': True, 'tenant_id': '8a32187e285543a88aae7f4283a9636f'}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:25:17.717559 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74395cf8-fec1-4e7a-8eed-c062e058cb18 req-24a39d21-9808-4f6b-9073-87b840b09343 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:17.725777 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-74395cf8-fec1-4e7a-8eed-c062e058cb18 req-24a39d21-9808-4f6b-9073-87b840b09343 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=69d5fa5c-ad33-4afb-bf39-39cd00f6030c HTTP/1.1" status: 200  len: 945 time: 0.1230109
May 20 04:25:17.781162 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-74395cf8-fec1-4e7a-8eed-c062e058cb18 req-9b0f8264-765a-4981-9d09-79059f348f74 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0543098
May 20 04:25:17.895394 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [req-2f64b99d-9d47-4aa4-a08b-cf9dcebc6402 req-c9220066-2ed2-4769-aca6-feaab33f4003 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:25:17.901456 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-2f64b99d-9d47-4aa4-a08b-cf9dcebc6402 req-c9220066-2ed2-4769-aca6-feaab33f4003 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Usage tracker for resource:port and tenant:8a32187e285543a88aae7f4283a9636f is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:25:17.904844 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-2f64b99d-9d47-4aa4-a08b-cf9dcebc6402 req-c9220066-2ed2-4769-aca6-feaab33f4003 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Quota usage for port was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:25:17.911522 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [req-2f64b99d-9d47-4aa4-a08b-cf9dcebc6402 req-c9220066-2ed2-4769-aca6-feaab33f4003 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:25:17.928041 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-2f64b99d-9d47-4aa4-a08b-cf9dcebc6402 req-c9220066-2ed2-4769-aca6-feaab33f4003 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Made reservation on behalf of 8a32187e285543a88aae7f4283a9636f for: {'port': 1} {{(pid=91687) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 04:25:17.933479 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-2f64b99d-9d47-4aa4-a08b-cf9dcebc6402 req-c9220066-2ed2-4769-aca6-feaab33f4003 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:18.208926 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.db_base_plugin_common [req-2f64b99d-9d47-4aa4-a08b-cf9dcebc6402 req-c9220066-2ed2-4769-aca6-feaab33f4003 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Allocated IP 172.20.0.6 (c6308b4a-efff-48c2-b41d-58a08edddda1/2dceece0-8bc3-4f29-a183-108f8744d094/66e2d45a-eeae-4758-ad0e-fdb997dca9f5) {{(pid=91687) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 04:25:18.441456 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-2f64b99d-9d47-4aa4-a08b-cf9dcebc6402 req-c9220066-2ed2-4769-aca6-feaab33f4003 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Notify callbacks [] for port, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:18.473275 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-2f64b99d-9d47-4aa4-a08b-cf9dcebc6402 req-c9220066-2ed2-4769-aca6-feaab33f4003 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8782892106231', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4162192'] for port, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:18.479423 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-b70d3868-2c68-40d2-a9f3-d266ac24b6f3 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:25:18.553249 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-2f64b99d-9d47-4aa4-a08b-cf9dcebc6402 req-c9220066-2ed2-4769-aca6-feaab33f4003 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Network c6308b4a-efff-48c2-b41d-58a08edddda1 is already hosted by enough agents. {{(pid=91687) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:25:18.557121 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.base_scheduler [req-2f64b99d-9d47-4aa4-a08b-cf9dcebc6402 req-c9220066-2ed2-4769-aca6-feaab33f4003 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Resources bound (agent type, host, resource id):  {{(pid=91687) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:25:18.561590 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.l3_dvrscheduler_db [req-2f64b99d-9d47-4aa4-a08b-cf9dcebc6402 req-c9220066-2ed2-4769-aca6-feaab33f4003 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Received port after_create {{(pid=91687) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 04:25:18.617581 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9220066-2ed2-4769-aca6-feaab33f4003 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Pushing event updated for resources: {'Port': ['ID=66e2d45a-eeae-4758-ad0e-fdb997dca9f5,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:25:18.660781 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c9220066-2ed2-4769-aca6-feaab33f4003 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:25:18.661176 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c9220066-2ed2-4769-aca6-feaab33f4003 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:25:18.661528 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c9220066-2ed2-4769-aca6-feaab33f4003 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:25:18.661876 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c9220066-2ed2-4769-aca6-feaab33f4003 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:25:18.662243 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c9220066-2ed2-4769-aca6-feaab33f4003 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:25:18.662566 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c9220066-2ed2-4769-aca6-feaab33f4003 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:25:18.662921 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c9220066-2ed2-4769-aca6-feaab33f4003 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:25:18.663640 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c9220066-2ed2-4769-aca6-feaab33f4003 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:25:18.664028 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c9220066-2ed2-4769-aca6-feaab33f4003 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:25:18.664393 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c9220066-2ed2-4769-aca6-feaab33f4003 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:25:18.664725 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c9220066-2ed2-4769-aca6-feaab33f4003 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:25:18.665087 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c9220066-2ed2-4769-aca6-feaab33f4003 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:25:18.676721 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-c9220066-2ed2-4769-aca6-feaab33f4003 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.197s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:25:18.701442 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f64b99d-9d47-4aa4-a08b-cf9dcebc6402 req-c9220066-2ed2-4769-aca6-feaab33f4003 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:18.702107 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-2f64b99d-9d47-4aa4-a08b-cf9dcebc6402 req-c9220066-2ed2-4769-aca6-feaab33f4003 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for port, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:18.732857 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-2f64b99d-9d47-4aa4-a08b-cf9dcebc6402 req-c9220066-2ed2-4769-aca6-feaab33f4003 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.0534961
May 20 04:25:18.745745 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [req-2f64b99d-9d47-4aa4-a08b-cf9dcebc6402 req-3c70f0e8-8ed6-4fc4-9746-0153ff435fe4 service neutron] Request body: {'port': {'device_id': 'e503d184-7bd9-4052-b1a1-8cd725e700e4', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79091'}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:25:18.786192 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [req-a9608104-9352-43e9-bb82-ea02bee64442 req-99da2ba7-1e44-41d4-97d2-9127ffadbebc tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Synchronizing usage tracker for tenant:a1319e4a0fc74f98ba4bb88d8a04086b on resource:port {{(pid=91686) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:25:18.819001 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [req-a9608104-9352-43e9-bb82-ea02bee64442 req-99da2ba7-1e44-41d4-97d2-9127ffadbebc tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Unset dirty status for tenant:a1319e4a0fc74f98ba4bb88d8a04086b on resource:port {{(pid=91686) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:25:18.821406 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-a9608104-9352-43e9-bb82-ea02bee64442 req-99da2ba7-1e44-41d4-97d2-9127ffadbebc tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 210 time: 0.1065612
May 20 04:25:18.832490 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d3c0fab-8211-4340-8da2-a3c1b0b6d327 req-76bcdfdf-d152-4bc8-8525-4f780e67fe36 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:18.833313 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-5d3c0fab-8211-4340-8da2-a3c1b0b6d327 req-76bcdfdf-d152-4bc8-8525-4f780e67fe36 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Synchronizing usage tracker for tenant:8a32187e285543a88aae7f4283a9636f on resource:port {{(pid=91687) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:25:18.908064 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-2f64b99d-9d47-4aa4-a08b-cf9dcebc6402 req-3c70f0e8-8ed6-4fc4-9746-0153ff435fe4 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:18.919837 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-5d3c0fab-8211-4340-8da2-a3c1b0b6d327 req-76bcdfdf-d152-4bc8-8525-4f780e67fe36 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Unset dirty status for tenant:8a32187e285543a88aae7f4283a9636f on resource:port {{(pid=91687) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:25:18.921077 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-5d3c0fab-8211-4340-8da2-a3c1b0b6d327 req-76bcdfdf-d152-4bc8-8525-4f780e67fe36 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.71 "GET /v2.0/ports?device_id=e503d184-7bd9-4052-b1a1-8cd725e700e4 HTTP/1.1" status: 200  len: 931 time: 0.3047090
May 20 04:25:19.046132 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3409ecaa-fe3e-4420-9513-001c145ba3cd req-96c33591-4704-43ff-a40d-dff7338230a0 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:19.047830 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-3409ecaa-fe3e-4420-9513-001c145ba3cd req-96c33591-4704-43ff-a40d-dff7338230a0 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=69d5fa5c-ad33-4afb-bf39-39cd00f6030c HTTP/1.1" status: 200  len: 945 time: 0.0920274
May 20 04:25:19.103884 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-3409ecaa-fe3e-4420-9513-001c145ba3cd req-5e5d756c-8108-44e8-a29d-e1c414a615af tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0470345
May 20 04:25:19.195080 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-5d3c0fab-8211-4340-8da2-a3c1b0b6d327 req-a13a9bb7-12e9-4498-9ab9-63f285ac7bc2 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.71 "GET /v2.0/security-groups?id=e79e4ba4-358f-4b35-b5f3-7372b5116def&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2674999
May 20 04:25:19.336094 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93cfdad1-3d31-4f96-8bf5-7853f6f3cbd8 req-b3e58b54-e8d3-44e5-b6f4-9fa2995229b0 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:19.337754 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-93cfdad1-3d31-4f96-8bf5-7853f6f3cbd8 req-b3e58b54-e8d3-44e5-b6f4-9fa2995229b0 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.82 "GET /v2.0/networks?id=e31171ff-f097-446e-b691-bef7aad2fb3b HTTP/1.1" status: 200  len: 809 time: 0.3684919
May 20 04:25:19.462893 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-93cfdad1-3d31-4f96-8bf5-7853f6f3cbd8 req-8c14d241-7f90-4442-826d-d6c7e0a6b581 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.82 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=a1319e4a0fc74f98ba4bb88d8a04086b HTTP/1.1" status: 200  len: 380 time: 0.0771782
May 20 04:25:19.475906 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [req-93cfdad1-3d31-4f96-8bf5-7853f6f3cbd8 req-4bf1b852-57cd-4d8b-a4ba-0b8f81e57489 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Request body: {'port': {'device_id': '940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18', 'network_id': 'e31171ff-f097-446e-b691-bef7aad2fb3b', 'admin_state_up': True, 'tenant_id': 'a1319e4a0fc74f98ba4bb88d8a04086b', 'security_groups': ['34e473fa-df05-422b-9abc-99aed131bade']}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:25:19.663834 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [req-93cfdad1-3d31-4f96-8bf5-7853f6f3cbd8 req-4bf1b852-57cd-4d8b-a4ba-0b8f81e57489 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:25:19.692209 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [req-93cfdad1-3d31-4f96-8bf5-7853f6f3cbd8 req-4bf1b852-57cd-4d8b-a4ba-0b8f81e57489 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:25:19.747988 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-93cfdad1-3d31-4f96-8bf5-7853f6f3cbd8 req-4bf1b852-57cd-4d8b-a4ba-0b8f81e57489 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Made reservation on behalf of a1319e4a0fc74f98ba4bb88d8a04086b for: {'port': 1} {{(pid=91687) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 04:25:19.751598 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-93cfdad1-3d31-4f96-8bf5-7853f6f3cbd8 req-4bf1b852-57cd-4d8b-a4ba-0b8f81e57489 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:19.770469 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.notifiers.nova [req-2f64b99d-9d47-4aa4-a08b-cf9dcebc6402 req-3c70f0e8-8ed6-4fc4-9746-0153ff435fe4 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 66e2d45a-eeae-4758-ad0e-fdb997dca9f5 {{(pid=91687) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 04:25:19.780875 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-2f64b99d-9d47-4aa4-a08b-cf9dcebc6402 req-3c70f0e8-8ed6-4fc4-9746-0153ff435fe4 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:19.840193 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.provisioning_blocks [req-2f64b99d-9d47-4aa4-a08b-cf9dcebc6402 req-3c70f0e8-8ed6-4fc4-9746-0153ff435fe4 service neutron] Transition to ACTIVE for port object 66e2d45a-eeae-4758-ad0e-fdb997dca9f5 will not be triggered until provisioned by entity L2. {{(pid=91687) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:25:19.847461 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-2f64b99d-9d47-4aa4-a08b-cf9dcebc6402 req-3c70f0e8-8ed6-4fc4-9746-0153ff435fe4 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4162185'] for port, after_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:19.854760 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-6daecb28-79ec-4470-93f6-87fc0cad101d service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:25:20.047005 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c70f0e8-8ed6-4fc4-9746-0153ff435fe4 service neutron] Pushing event updated for resources: {'Port': ['ID=66e2d45a-eeae-4758-ad0e-fdb997dca9f5,revision_number=2']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:25:20.065191 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-fe259670-e469-442e-a877-cb3f80dccb5e req-1484a2bc-c57b-4c1f-8fe2-0818780f8432 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 210 time: 0.0499861
May 20 04:25:20.075443 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-3c70f0e8-8ed6-4fc4-9746-0153ff435fe4 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.221s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:25:20.142821 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.db_base_plugin_common [req-93cfdad1-3d31-4f96-8bf5-7853f6f3cbd8 req-4bf1b852-57cd-4d8b-a4ba-0b8f81e57489 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Allocated IP 172.20.0.13 (e31171ff-f097-446e-b691-bef7aad2fb3b/410f59de-055d-4298-96bf-5d9a7712368d/9c846663-c90b-41d4-a8d1-1086882ba27e) {{(pid=91687) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 04:25:20.192109 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.managers [req-2f64b99d-9d47-4aa4-a08b-cf9dcebc6402 req-3c70f0e8-8ed6-4fc4-9746-0153ff435fe4 service neutron] Attempting to bind port 66e2d45a-eeae-4758-ad0e-fdb997dca9f5 on host hv-cinder-79091 for vnic_type normal with profile  {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 04:25:20.192440 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.managers [req-2f64b99d-9d47-4aa4-a08b-cf9dcebc6402 req-3c70f0e8-8ed6-4fc4-9746-0153ff435fe4 service neutron] Attempting to bind port 66e2d45a-eeae-4758-ad0e-fdb997dca9f5 by drivers openvswitch,hyperv on host hv-cinder-79091 at level 0 using segments [{'id': '3cfe6ee0-17fa-47f2-8f37-995aaef6bfdc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 899, 'network_id': 'c6308b4a-efff-48c2-b41d-58a08edddda1'}] {{(pid=91687) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 04:25:20.192766 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2f64b99d-9d47-4aa4-a08b-cf9dcebc6402 req-3c70f0e8-8ed6-4fc4-9746-0153ff435fe4 service neutron] Attempting to bind port 66e2d45a-eeae-4758-ad0e-fdb997dca9f5 on network c6308b4a-efff-48c2-b41d-58a08edddda1 {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:25:20.210212 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2f64b99d-9d47-4aa4-a08b-cf9dcebc6402 req-3c70f0e8-8ed6-4fc4-9746-0153ff435fe4 service neutron] Port 66e2d45a-eeae-4758-ad0e-fdb997dca9f5 on network c6308b4a-efff-48c2-b41d-58a08edddda1 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79091 {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 20 04:25:20.210514 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2f64b99d-9d47-4aa4-a08b-cf9dcebc6402 req-3c70f0e8-8ed6-4fc4-9746-0153ff435fe4 service neutron] Attempting to bind port 66e2d45a-eeae-4758-ad0e-fdb997dca9f5 on network c6308b4a-efff-48c2-b41d-58a08edddda1 {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:25:20.244776 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2f64b99d-9d47-4aa4-a08b-cf9dcebc6402 req-3c70f0e8-8ed6-4fc4-9746-0153ff435fe4 service neutron] Checking agent: {'id': '7cc947fd-92eb-4d43-ad6b-ea002afff217', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79091', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 4, 19, 34), 'started_at': datetime.datetime(2021, 5, 20, 4, 19, 34), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 4, 25, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 04:25:20.245145 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2f64b99d-9d47-4aa4-a08b-cf9dcebc6402 req-3c70f0e8-8ed6-4fc4-9746-0153ff435fe4 service neutron] Checking segment: {'id': '3cfe6ee0-17fa-47f2-8f37-995aaef6bfdc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 899, 'network_id': 'c6308b4a-efff-48c2-b41d-58a08edddda1'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91687) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:25:20.245538 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2f64b99d-9d47-4aa4-a08b-cf9dcebc6402 req-3c70f0e8-8ed6-4fc4-9746-0153ff435fe4 service neutron] Bound using segment: {'id': '3cfe6ee0-17fa-47f2-8f37-995aaef6bfdc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 899, 'network_id': 'c6308b4a-efff-48c2-b41d-58a08edddda1'} {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 04:25:20.245991 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.managers [req-2f64b99d-9d47-4aa4-a08b-cf9dcebc6402 req-3c70f0e8-8ed6-4fc4-9746-0153ff435fe4 service neutron] Bound port: 66e2d45a-eeae-4758-ad0e-fdb997dca9f5, host: hv-cinder-79091, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '3cfe6ee0-17fa-47f2-8f37-995aaef6bfdc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 899, 'network_id': 'c6308b4a-efff-48c2-b41d-58a08edddda1'}}] {{(pid=91687) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 04:25:20.246344 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-2f64b99d-9d47-4aa4-a08b-cf9dcebc6402 req-3c70f0e8-8ed6-4fc4-9746-0153ff435fe4 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:20.494734 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [req-2f64b99d-9d47-4aa4-a08b-cf9dcebc6402 req-3c70f0e8-8ed6-4fc4-9746-0153ff435fe4 service neutron] For port 66e2d45a-eeae-4758-ad0e-fdb997dca9f5, host hv-cinder-79091, cleared binding levels {{(pid=91687) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 04:25:20.507992 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-93cfdad1-3d31-4f96-8bf5-7853f6f3cbd8 req-4bf1b852-57cd-4d8b-a4ba-0b8f81e57489 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Notify callbacks [] for port, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:20.521379 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [req-2f64b99d-9d47-4aa4-a08b-cf9dcebc6402 req-3c70f0e8-8ed6-4fc4-9746-0153ff435fe4 service neutron] For port 66e2d45a-eeae-4758-ad0e-fdb997dca9f5, host hv-cinder-79091, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=66e2d45a-eeae-4758-ad0e-fdb997dca9f5,segment=NetworkSegment(3cfe6ee0-17fa-47f2-8f37-995aaef6bfdc),segment_id=3cfe6ee0-17fa-47f2-8f37-995aaef6bfdc)] {{(pid=91687) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 04:25:20.532321 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-2f64b99d-9d47-4aa4-a08b-cf9dcebc6402 req-3c70f0e8-8ed6-4fc4-9746-0153ff435fe4 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4162185'] for port, after_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:20.538935 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-d3ec6aea-5da8-4b00-b67d-6b2b5becaf98 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:25:20.570618 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.provisioning_blocks [req-93cfdad1-3d31-4f96-8bf5-7853f6f3cbd8 req-4bf1b852-57cd-4d8b-a4ba-0b8f81e57489 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Transition to ACTIVE for port object 9c846663-c90b-41d4-a8d1-1086882ba27e will not be triggered until provisioned by entity DHCP. {{(pid=91687) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:25:20.610626 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f64b99d-9d47-4aa4-a08b-cf9dcebc6402 req-3c70f0e8-8ed6-4fc4-9746-0153ff435fe4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:20.611234 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-2f64b99d-9d47-4aa4-a08b-cf9dcebc6402 req-3c70f0e8-8ed6-4fc4-9746-0153ff435fe4 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for port, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:20.612638 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-2f64b99d-9d47-4aa4-a08b-cf9dcebc6402 req-3c70f0e8-8ed6-4fc4-9746-0153ff435fe4 service neutron] 10.222.0.82 "PUT /v2.0/ports/66e2d45a-eeae-4758-ad0e-fdb997dca9f5 HTTP/1.1" status: 200  len: 1093 time: 1.8713121
May 20 04:25:20.615296 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e503d184-7bd9-4052-b1a1-8cd725e700e4', 'tag': '66e2d45a-eeae-4758-ad0e-fdb997dca9f5'}] {{(pid=91687) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:25:20.630810 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7300e5f-6fd4-4222-a73f-a2ad428e5d7e req-da6a57a1-9c39-4920-a339-0d62b19f8595 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:20.632510 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a7300e5f-6fd4-4222-a73f-a2ad428e5d7e req-da6a57a1-9c39-4920-a339-0d62b19f8595 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.71 "GET /v2.0/ports?device_id=e503d184-7bd9-4052-b1a1-8cd725e700e4 HTTP/1.1" status: 200  len: 943 time: 0.3172829
May 20 04:25:20.724233 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c70f0e8-8ed6-4fc4-9746-0153ff435fe4 service neutron] Pushing event updated for resources: {'Port': ['ID=66e2d45a-eeae-4758-ad0e-fdb997dca9f5,revision_number=3']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:25:20.732653 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e503d184-7bd9-4052-b1a1-8cd725e700e4', 'tag': '66e2d45a-eeae-4758-ad0e-fdb997dca9f5', 'status': 'completed', 'code': 200}
May 20 04:25:20.736530 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-3c70f0e8-8ed6-4fc4-9746-0153ff435fe4 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.198s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:25:20.771166 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-93cfdad1-3d31-4f96-8bf5-7853f6f3cbd8 req-4bf1b852-57cd-4d8b-a4ba-0b8f81e57489 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8782892106231', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4162192'] for port, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:20.788719 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-c9220066-2ed2-4769-aca6-feaab33f4003 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:25:20.844048 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a7300e5f-6fd4-4222-a73f-a2ad428e5d7e req-a6124ab8-76d6-420c-afd7-b948d61b2047 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.71 "GET /v2.0/security-groups?id=e79e4ba4-358f-4b35-b5f3-7372b5116def&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1981881
May 20 04:25:20.995188 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-93cfdad1-3d31-4f96-8bf5-7853f6f3cbd8 req-4bf1b852-57cd-4d8b-a4ba-0b8f81e57489 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Network e31171ff-f097-446e-b691-bef7aad2fb3b is already hosted by enough agents. {{(pid=91687) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:25:21.003684 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.base_scheduler [req-93cfdad1-3d31-4f96-8bf5-7853f6f3cbd8 req-4bf1b852-57cd-4d8b-a4ba-0b8f81e57489 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Resources bound (agent type, host, resource id):  {{(pid=91687) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:25:21.008998 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bf1b852-57cd-4d8b-a4ba-0b8f81e57489 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Pushing event updated for resources: {'Port': ['ID=9c846663-c90b-41d4-a8d1-1086882ba27e,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:25:21.010119 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.l3_dvrscheduler_db [req-93cfdad1-3d31-4f96-8bf5-7853f6f3cbd8 req-4bf1b852-57cd-4d8b-a4ba-0b8f81e57489 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Received port after_create {{(pid=91687) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 04:25:21.036027 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-4bf1b852-57cd-4d8b-a4ba-0b8f81e57489 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.248s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:25:21.051433 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f64b99d-9d47-4aa4-a08b-cf9dcebc6402 req-a9cdad38-0dd0-4c7c-89cf-a61bbf9ab7ff service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:21.052946 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-2f64b99d-9d47-4aa4-a08b-cf9dcebc6402 req-a9cdad38-0dd0-4c7c-89cf-a61bbf9ab7ff service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=8a32187e285543a88aae7f4283a9636f&device_id=e503d184-7bd9-4052-b1a1-8cd725e700e4 HTTP/1.1" status: 200  len: 1096 time: 0.3711760
May 20 04:25:21.154030 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-2f64b99d-9d47-4aa4-a08b-cf9dcebc6402 req-ffcbc154-83e7-4d8e-856b-a817f506c9d1 service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=66e2d45a-eeae-4758-ad0e-fdb997dca9f5 HTTP/1.1" status: 200  len: 217 time: 0.0900233
May 20 04:25:21.163534 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93cfdad1-3d31-4f96-8bf5-7853f6f3cbd8 req-4bf1b852-57cd-4d8b-a4ba-0b8f81e57489 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:21.164178 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-93cfdad1-3d31-4f96-8bf5-7853f6f3cbd8 req-4bf1b852-57cd-4d8b-a4ba-0b8f81e57489 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for port, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:21.241165 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-93cfdad1-3d31-4f96-8bf5-7853f6f3cbd8 req-4bf1b852-57cd-4d8b-a4ba-0b8f81e57489 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 1.7722983
May 20 04:25:21.256193 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [req-93cfdad1-3d31-4f96-8bf5-7853f6f3cbd8 req-a0717b7b-9c8d-4b0f-b43a-dbc08a748ec8 service neutron] Request body: {'port': {'device_id': '940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79091'}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:25:21.287797 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f64b99d-9d47-4aa4-a08b-cf9dcebc6402 req-1a9d6c20-789a-489a-9e41-35dbf73d3d24 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:21.289417 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-2f64b99d-9d47-4aa4-a08b-cf9dcebc6402 req-1a9d6c20-789a-489a-9e41-35dbf73d3d24 service neutron] 10.222.0.82 "GET /v2.0/subnets?id=2dceece0-8bc3-4f29-a183-108f8744d094 HTTP/1.1" status: 200  len: 853 time: 0.1015985
May 20 04:25:21.358622 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-2f64b99d-9d47-4aa4-a08b-cf9dcebc6402 req-998a8b82-a38c-4b20-84a9-3a76482b640d service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=c6308b4a-efff-48c2-b41d-58a08edddda1&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0543339
May 20 04:25:21.368564 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-9c660deb-8680-4ad4-bd04-7f4ce02793a9 None None] Provisioning for port 9c846663-c90b-41d4-a8d1-1086882ba27e completed by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:25:21.377189 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-9c660deb-8680-4ad4-bd04-7f4ce02793a9 None None] Provisioning complete for port 9c846663-c90b-41d4-a8d1-1086882ba27e triggered by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:25:21.377652 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-9c660deb-8680-4ad4-bd04-7f4ce02793a9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:21.453256 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-9c660deb-8680-4ad4-bd04-7f4ce02793a9 None None] Port 9c846663-c90b-41d4-a8d1-1086882ba27e cannot update to ACTIVE because it is not bound. {{(pid=91688) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 20 04:25:21.623024 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-2f64b99d-9d47-4aa4-a08b-cf9dcebc6402 req-e8d9662d-dd3f-4401-a1bd-5a04f8337f35 service neutron] 10.222.0.82 "GET /v2.0/networks/c6308b4a-efff-48c2-b41d-58a08edddda1?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2558792
May 20 04:25:21.701725 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5426f176-737d-41e6-a8bf-86998b857f86 req-8316352d-0401-45a5-92e2-a60fcb40cfa5 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:21.704058 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-5426f176-737d-41e6-a8bf-86998b857f86 req-8316352d-0401-45a5-92e2-a60fcb40cfa5 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 932 time: 0.1976342
May 20 04:25:21.785909 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-5426f176-737d-41e6-a8bf-86998b857f86 req-c86bb37e-2c45-473e-9dea-e9dec01bcd93 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/security-groups?id=34e473fa-df05-422b-9abc-99aed131bade&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0706797
May 20 04:25:21.793088 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-93cfdad1-3d31-4f96-8bf5-7853f6f3cbd8 req-a0717b7b-9c8d-4b0f-b43a-dbc08a748ec8 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:21.993918 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-2f64b99d-9d47-4aa4-a08b-cf9dcebc6402 req-d7abff90-002d-4568-b2f8-8a0b64847d49 service neutron] 10.222.0.82 "GET /v2.0/networks/c6308b4a-efff-48c2-b41d-58a08edddda1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3419220
May 20 04:25:22.087899 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eca3dced-f7b5-49a8-b53c-3442619f61da req-79d6c240-32ad-4a82-be37-9eb73741a26a tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:22.090410 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-eca3dced-f7b5-49a8-b53c-3442619f61da req-79d6c240-32ad-4a82-be37-9eb73741a26a tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.71 "GET /v2.0/ports?device_id=e503d184-7bd9-4052-b1a1-8cd725e700e4 HTTP/1.1" status: 200  len: 943 time: 0.1055598
May 20 04:25:22.136978 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [req-eca3dced-f7b5-49a8-b53c-3442619f61da req-e51b87ab-e1a2-4c51-a783-2b7f66c22419 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Synchronizing usage tracker for tenant:8a32187e285543a88aae7f4283a9636f on resource:security_group {{(pid=91686) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:25:22.154420 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [req-eca3dced-f7b5-49a8-b53c-3442619f61da req-e51b87ab-e1a2-4c51-a783-2b7f66c22419 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Unset dirty status for tenant:8a32187e285543a88aae7f4283a9636f on resource:security_group {{(pid=91686) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:25:22.155593 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-eca3dced-f7b5-49a8-b53c-3442619f61da req-e51b87ab-e1a2-4c51-a783-2b7f66c22419 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.71 "GET /v2.0/security-groups?id=e79e4ba4-358f-4b35-b5f3-7372b5116def&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0593271
May 20 04:25:22.195809 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5059d38-548e-4569-af4c-4c23375526d0 req-ae2a7adc-fd98-4d61-837c-f9acba25eb63 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:22.197324 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a5059d38-548e-4569-af4c-4c23375526d0 req-ae2a7adc-fd98-4d61-837c-f9acba25eb63 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 946 time: 0.3066661
May 20 04:25:22.298155 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fadf99e1-2e2b-49ea-870a-fdf424fd9904 req-a362bcf3-02f9-45e5-9f77-7186a74ec3d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:22.299656 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-fadf99e1-2e2b-49ea-870a-fdf424fd9904 req-a362bcf3-02f9-45e5-9f77-7186a74ec3d5 service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=8a32187e285543a88aae7f4283a9636f&device_id=e503d184-7bd9-4052-b1a1-8cd725e700e4 HTTP/1.1" status: 200  len: 1096 time: 0.2257357
May 20 04:25:22.366142 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a5059d38-548e-4569-af4c-4c23375526d0 req-87006753-6768-4655-be2a-c4548584e922 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1191633
May 20 04:25:22.527272 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fadf99e1-2e2b-49ea-870a-fdf424fd9904 req-710096f0-a0d4-4a06-ace6-587e0edaa876 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:22.528745 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-fadf99e1-2e2b-49ea-870a-fdf424fd9904 req-710096f0-a0d4-4a06-ace6-587e0edaa876 service neutron] 10.222.0.82 "GET /v2.0/networks?id=c6308b4a-efff-48c2-b41d-58a08edddda1 HTTP/1.1" status: 200  len: 914 time: 0.2180045
May 20 04:25:22.536604 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.notifiers.nova [req-93cfdad1-3d31-4f96-8bf5-7853f6f3cbd8 req-a0717b7b-9c8d-4b0f-b43a-dbc08a748ec8 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 9c846663-c90b-41d4-a8d1-1086882ba27e {{(pid=91687) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 04:25:22.592240 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-93cfdad1-3d31-4f96-8bf5-7853f6f3cbd8 req-a0717b7b-9c8d-4b0f-b43a-dbc08a748ec8 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:22.622614 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-fadf99e1-2e2b-49ea-870a-fdf424fd9904 req-f8c4eb4f-1bf7-4c27-8b95-e569034a561b service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=66e2d45a-eeae-4758-ad0e-fdb997dca9f5 HTTP/1.1" status: 200  len: 217 time: 0.0786612
May 20 04:25:22.661451 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.provisioning_blocks [req-93cfdad1-3d31-4f96-8bf5-7853f6f3cbd8 req-a0717b7b-9c8d-4b0f-b43a-dbc08a748ec8 service neutron] Transition to ACTIVE for port object 9c846663-c90b-41d4-a8d1-1086882ba27e will not be triggered until provisioned by entity L2. {{(pid=91687) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:25:22.666657 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-93cfdad1-3d31-4f96-8bf5-7853f6f3cbd8 req-a0717b7b-9c8d-4b0f-b43a-dbc08a748ec8 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4162185'] for port, after_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:22.675102 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:25:22.935358 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fadf99e1-2e2b-49ea-870a-fdf424fd9904 req-2e44e407-9397-4417-be73-26540f08f420 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:22.937119 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-fadf99e1-2e2b-49ea-870a-fdf424fd9904 req-2e44e407-9397-4417-be73-26540f08f420 service neutron] 10.222.0.82 "GET /v2.0/subnets?id=2dceece0-8bc3-4f29-a183-108f8744d094 HTTP/1.1" status: 200  len: 853 time: 0.3064954
May 20 04:25:23.025982 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0717b7b-9c8d-4b0f-b43a-dbc08a748ec8 service neutron] Pushing event updated for resources: {'Port': ['ID=9c846663-c90b-41d4-a8d1-1086882ba27e,revision_number=2']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:25:23.045230 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da65acc3-b9b0-4dd0-814d-c8c7e640071e req-faa7a71a-1342-4018-8895-6d0521533fc0 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:23.047518 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-da65acc3-b9b0-4dd0-814d-c8c7e640071e req-faa7a71a-1342-4018-8895-6d0521533fc0 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 944 time: 0.1029043
May 20 04:25:23.070561 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-a0717b7b-9c8d-4b0f-b43a-dbc08a748ec8 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.395s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:25:23.073029 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-fadf99e1-2e2b-49ea-870a-fdf424fd9904 req-df0db23c-c275-4fb8-a688-8f2793ede443 service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=c6308b4a-efff-48c2-b41d-58a08edddda1&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1046829
May 20 04:25:23.113151 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-da65acc3-b9b0-4dd0-814d-c8c7e640071e req-e8fe898b-e5e9-4991-9ff8-3822931085b6 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/security-groups?id=34e473fa-df05-422b-9abc-99aed131bade&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0543764
May 20 04:25:23.211881 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.managers [req-93cfdad1-3d31-4f96-8bf5-7853f6f3cbd8 req-a0717b7b-9c8d-4b0f-b43a-dbc08a748ec8 service neutron] Attempting to bind port 9c846663-c90b-41d4-a8d1-1086882ba27e on host hv-cinder-79091 for vnic_type normal with profile  {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 04:25:23.212212 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.managers [req-93cfdad1-3d31-4f96-8bf5-7853f6f3cbd8 req-a0717b7b-9c8d-4b0f-b43a-dbc08a748ec8 service neutron] Attempting to bind port 9c846663-c90b-41d4-a8d1-1086882ba27e by drivers openvswitch,hyperv on host hv-cinder-79091 at level 0 using segments [{'id': 'e5874c72-d111-4955-a5aa-fbad5f078a34', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': 'e31171ff-f097-446e-b691-bef7aad2fb3b'}] {{(pid=91687) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 04:25:23.212540 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-93cfdad1-3d31-4f96-8bf5-7853f6f3cbd8 req-a0717b7b-9c8d-4b0f-b43a-dbc08a748ec8 service neutron] Attempting to bind port 9c846663-c90b-41d4-a8d1-1086882ba27e on network e31171ff-f097-446e-b691-bef7aad2fb3b {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:25:23.222594 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-93cfdad1-3d31-4f96-8bf5-7853f6f3cbd8 req-a0717b7b-9c8d-4b0f-b43a-dbc08a748ec8 service neutron] Port 9c846663-c90b-41d4-a8d1-1086882ba27e on network e31171ff-f097-446e-b691-bef7aad2fb3b not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79091 {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 20 04:25:23.222921 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-93cfdad1-3d31-4f96-8bf5-7853f6f3cbd8 req-a0717b7b-9c8d-4b0f-b43a-dbc08a748ec8 service neutron] Attempting to bind port 9c846663-c90b-41d4-a8d1-1086882ba27e on network e31171ff-f097-446e-b691-bef7aad2fb3b {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:25:23.234313 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-93cfdad1-3d31-4f96-8bf5-7853f6f3cbd8 req-a0717b7b-9c8d-4b0f-b43a-dbc08a748ec8 service neutron] Checking agent: {'id': '7cc947fd-92eb-4d43-ad6b-ea002afff217', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79091', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 4, 19, 34), 'started_at': datetime.datetime(2021, 5, 20, 4, 19, 34), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 4, 25, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 04:25:23.234759 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-93cfdad1-3d31-4f96-8bf5-7853f6f3cbd8 req-a0717b7b-9c8d-4b0f-b43a-dbc08a748ec8 service neutron] Checking segment: {'id': 'e5874c72-d111-4955-a5aa-fbad5f078a34', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': 'e31171ff-f097-446e-b691-bef7aad2fb3b'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91687) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:25:23.235152 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-93cfdad1-3d31-4f96-8bf5-7853f6f3cbd8 req-a0717b7b-9c8d-4b0f-b43a-dbc08a748ec8 service neutron] Bound using segment: {'id': 'e5874c72-d111-4955-a5aa-fbad5f078a34', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': 'e31171ff-f097-446e-b691-bef7aad2fb3b'} {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 04:25:23.235586 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.managers [req-93cfdad1-3d31-4f96-8bf5-7853f6f3cbd8 req-a0717b7b-9c8d-4b0f-b43a-dbc08a748ec8 service neutron] Bound port: 9c846663-c90b-41d4-a8d1-1086882ba27e, host: hv-cinder-79091, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'e5874c72-d111-4955-a5aa-fbad5f078a34', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': 'e31171ff-f097-446e-b691-bef7aad2fb3b'}}] {{(pid=91687) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 04:25:23.235931 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-93cfdad1-3d31-4f96-8bf5-7853f6f3cbd8 req-a0717b7b-9c8d-4b0f-b43a-dbc08a748ec8 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:23.267420 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-fadf99e1-2e2b-49ea-870a-fdf424fd9904 req-829bff81-87a4-4aef-838d-653d731ab336 service neutron] 10.222.0.82 "GET /v2.0/networks/c6308b4a-efff-48c2-b41d-58a08edddda1?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1848524
May 20 04:25:23.499419 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [req-93cfdad1-3d31-4f96-8bf5-7853f6f3cbd8 req-a0717b7b-9c8d-4b0f-b43a-dbc08a748ec8 service neutron] For port 9c846663-c90b-41d4-a8d1-1086882ba27e, host hv-cinder-79091, cleared binding levels {{(pid=91687) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 04:25:23.528773 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [req-93cfdad1-3d31-4f96-8bf5-7853f6f3cbd8 req-a0717b7b-9c8d-4b0f-b43a-dbc08a748ec8 service neutron] For port 9c846663-c90b-41d4-a8d1-1086882ba27e, host hv-cinder-79091, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=9c846663-c90b-41d4-a8d1-1086882ba27e,segment=NetworkSegment(e5874c72-d111-4955-a5aa-fbad5f078a34),segment_id=e5874c72-d111-4955-a5aa-fbad5f078a34)] {{(pid=91687) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 04:25:23.537574 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-fadf99e1-2e2b-49ea-870a-fdf424fd9904 req-f127eea8-e61f-4afa-b45b-d1a9d71f81f0 service neutron] 10.222.0.82 "GET /v2.0/networks/c6308b4a-efff-48c2-b41d-58a08edddda1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2406497
May 20 04:25:23.539718 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-93cfdad1-3d31-4f96-8bf5-7853f6f3cbd8 req-a0717b7b-9c8d-4b0f-b43a-dbc08a748ec8 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4162185'] for port, after_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:23.543539 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:25:23.568546 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-252b5a96-140c-4aa3-8d65-78c6685cbec7 req-860e4a06-68e1-4e69-bb78-3af69c813e08 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:23.570068 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-252b5a96-140c-4aa3-8d65-78c6685cbec7 req-860e4a06-68e1-4e69-bb78-3af69c813e08 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 946 time: 0.0878744
May 20 04:25:23.610288 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74b40274-981d-445c-a105-0d2c1b7b56ed req-a148da8f-590a-4be2-bdd3-57a672ef3ca6 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:23.611810 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-74b40274-981d-445c-a105-0d2c1b7b56ed req-a148da8f-590a-4be2-bdd3-57a672ef3ca6 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.71 "GET /v2.0/ports?device_id=e503d184-7bd9-4052-b1a1-8cd725e700e4 HTTP/1.1" status: 200  len: 943 time: 0.3160732
May 20 04:25:23.620438 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93cfdad1-3d31-4f96-8bf5-7853f6f3cbd8 req-a0717b7b-9c8d-4b0f-b43a-dbc08a748ec8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:23.621259 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-93cfdad1-3d31-4f96-8bf5-7853f6f3cbd8 req-a0717b7b-9c8d-4b0f-b43a-dbc08a748ec8 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for port, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:23.622566 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-93cfdad1-3d31-4f96-8bf5-7853f6f3cbd8 req-a0717b7b-9c8d-4b0f-b43a-dbc08a748ec8 service neutron] 10.222.0.82 "PUT /v2.0/ports/9c846663-c90b-41d4-a8d1-1086882ba27e HTTP/1.1" status: 200  len: 1094 time: 2.3728552
May 20 04:25:23.622917 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18', 'tag': '9c846663-c90b-41d4-a8d1-1086882ba27e'}] {{(pid=91687) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:25:23.624391 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-252b5a96-140c-4aa3-8d65-78c6685cbec7 req-625e8eba-f597-4f2e-9c1d-529698a1a4f3 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0480106
May 20 04:25:23.662573 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0717b7b-9c8d-4b0f-b43a-dbc08a748ec8 service neutron] Pushing event updated for resources: {'Port': ['ID=9c846663-c90b-41d4-a8d1-1086882ba27e,revision_number=3']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:25:23.678970 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-a0717b7b-9c8d-4b0f-b43a-dbc08a748ec8 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.135s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:25:23.727754 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18', 'tag': '9c846663-c90b-41d4-a8d1-1086882ba27e', 'status': 'completed', 'code': 200}
May 20 04:25:23.737406 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-74b40274-981d-445c-a105-0d2c1b7b56ed req-5b70c9f3-cb25-4483-a490-fc9dbaf3c80c tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.71 "GET /v2.0/security-groups?id=e79e4ba4-358f-4b35-b5f3-7372b5116def&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1095912
May 20 04:25:23.796439 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93cfdad1-3d31-4f96-8bf5-7853f6f3cbd8 req-b061ceae-eafd-45e5-87e2-8b2089b2010b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:23.798381 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-93cfdad1-3d31-4f96-8bf5-7853f6f3cbd8 req-b061ceae-eafd-45e5-87e2-8b2089b2010b service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=a1319e4a0fc74f98ba4bb88d8a04086b&device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 1097 time: 0.1044250
May 20 04:25:23.879356 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-93cfdad1-3d31-4f96-8bf5-7853f6f3cbd8 req-f6cc060f-7a69-43fd-a4b2-23abce6dbb0e service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=9c846663-c90b-41d4-a8d1-1086882ba27e HTTP/1.1" status: 200  len: 217 time: 0.0686858
May 20 04:25:23.971746 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93cfdad1-3d31-4f96-8bf5-7853f6f3cbd8 req-bc43a388-92ef-47dd-af42-c28cfe350bdc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:23.973834 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-93cfdad1-3d31-4f96-8bf5-7853f6f3cbd8 req-bc43a388-92ef-47dd-af42-c28cfe350bdc service neutron] 10.222.0.82 "GET /v2.0/subnets?id=410f59de-055d-4298-96bf-5d9a7712368d HTTP/1.1" status: 200  len: 848 time: 0.0739570
May 20 04:25:24.058840 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93cfdad1-3d31-4f96-8bf5-7853f6f3cbd8 req-9e31e0d2-a3b5-4f6c-ad72-707b93f7298e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:24.061282 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-93cfdad1-3d31-4f96-8bf5-7853f6f3cbd8 req-9e31e0d2-a3b5-4f6c-ad72-707b93f7298e service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=e31171ff-f097-446e-b691-bef7aad2fb3b&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0777926
May 20 04:25:24.204181 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-93cfdad1-3d31-4f96-8bf5-7853f6f3cbd8 req-6ed13b82-2fe1-4df2-8e23-1d11a49a94fa service neutron] 10.222.0.82 "GET /v2.0/networks/e31171ff-f097-446e-b691-bef7aad2fb3b?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1340499
May 20 04:25:24.339022 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c40a7aba-a6e4-4685-b954-ca020804f687 req-78028c92-6880-4456-a458-a519eca1591b tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:24.342760 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-c40a7aba-a6e4-4685-b954-ca020804f687 req-78028c92-6880-4456-a458-a519eca1591b tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 944 time: 0.1067188
May 20 04:25:24.354404 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-93cfdad1-3d31-4f96-8bf5-7853f6f3cbd8 req-b61e6da9-1023-4f99-a07e-efdab5a9e640 service neutron] 10.222.0.82 "GET /v2.0/networks/e31171ff-f097-446e-b691-bef7aad2fb3b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1417863
May 20 04:25:24.404420 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-c40a7aba-a6e4-4685-b954-ca020804f687 req-cba43b1d-f805-4767-94a1-ed64ceca9d67 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/security-groups?id=34e473fa-df05-422b-9abc-99aed131bade&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0559347
May 20 04:25:24.523844 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-189656b9-1a81-4e9b-957c-56bdb19530e7 req-aaa2d892-3cbf-4018-a58b-297303b8d0d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:24.525426 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-189656b9-1a81-4e9b-957c-56bdb19530e7 req-aaa2d892-3cbf-4018-a58b-297303b8d0d5 service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=a1319e4a0fc74f98ba4bb88d8a04086b&device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 1097 time: 0.1022608
May 20 04:25:24.815138 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-189656b9-1a81-4e9b-957c-56bdb19530e7 req-00a721a2-d605-44ce-9d1f-69c3ced301f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:24.816770 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-189656b9-1a81-4e9b-957c-56bdb19530e7 req-00a721a2-d605-44ce-9d1f-69c3ced301f2 service neutron] 10.222.0.82 "GET /v2.0/networks?id=e31171ff-f097-446e-b691-bef7aad2fb3b HTTP/1.1" status: 200  len: 910 time: 0.2771997
May 20 04:25:24.836987 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2c9d2ab-7b3b-49a5-ab06-d8f2f26de649 req-a86dc192-77df-4717-bdd1-a0247010ff91 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:24.838549 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-b2c9d2ab-7b3b-49a5-ab06-d8f2f26de649 req-a86dc192-77df-4717-bdd1-a0247010ff91 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 945 time: 0.2087140
May 20 04:25:24.858911 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a0d74c5-86df-4cc2-acc8-4d62f630f19c req-a533fe49-c951-4a1b-b85c-747c6e3a8574 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:24.860622 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-5a0d74c5-86df-4cc2-acc8-4d62f630f19c req-a533fe49-c951-4a1b-b85c-747c6e3a8574 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 946 time: 0.1078618
May 20 04:25:24.919400 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-5a0d74c5-86df-4cc2-acc8-4d62f630f19c req-4f4402be-3c60-44e4-b8cd-6c6236464965 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0526626
May 20 04:25:24.921074 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-189656b9-1a81-4e9b-957c-56bdb19530e7 req-9c3b336c-9d13-4094-b6a5-e6cdd5c24223 service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=9c846663-c90b-41d4-a8d1-1086882ba27e HTTP/1.1" status: 200  len: 217 time: 0.0815148
May 20 04:25:24.983043 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-b2c9d2ab-7b3b-49a5-ab06-d8f2f26de649 req-6dc04e82-7529-4a67-acf9-1ff91158bde1 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0959065
May 20 04:25:25.009081 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-189656b9-1a81-4e9b-957c-56bdb19530e7 req-6f2847f9-9d9f-4510-bc22-720914e9839b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:25.010750 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-189656b9-1a81-4e9b-957c-56bdb19530e7 req-6f2847f9-9d9f-4510-bc22-720914e9839b service neutron] 10.222.0.82 "GET /v2.0/subnets?id=410f59de-055d-4298-96bf-5d9a7712368d HTTP/1.1" status: 200  len: 848 time: 0.0740018
May 20 04:25:25.015315 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 41190) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:25:25.141756 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-189656b9-1a81-4e9b-957c-56bdb19530e7 req-57ddd2e7-e24f-4d8e-8cff-ea9816b2e5b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:25.143587 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-189656b9-1a81-4e9b-957c-56bdb19530e7 req-57ddd2e7-e24f-4d8e-8cff-ea9816b2e5b1 service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=e31171ff-f097-446e-b691-bef7aad2fb3b&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1057112
May 20 04:25:25.176796 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00360e39-2211-4be8-ac47-5702414de61b req-f48d4141-dd3d-447e-88c8-8356ee8cbc9e tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:25.184172 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-00360e39-2211-4be8-ac47-5702414de61b req-f48d4141-dd3d-447e-88c8-8356ee8cbc9e tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.71 "GET /v2.0/ports?device_id=e503d184-7bd9-4052-b1a1-8cd725e700e4 HTTP/1.1" status: 200  len: 943 time: 0.1267369
May 20 04:25:25.299279 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-00360e39-2211-4be8-ac47-5702414de61b req-e96cf6b3-7884-46b2-a4ac-a6b042e94f96 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.71 "GET /v2.0/security-groups?id=e79e4ba4-358f-4b35-b5f3-7372b5116def&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0741813
May 20 04:25:25.317303 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-23bc50ac-3c84-41ef-8491-14eb0b7f2e05 tempest-TestMinimumBasicScenario-1297300454 tempest-TestMinimumBasicScenario-1297300454-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:25.318585 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-23bc50ac-3c84-41ef-8491-14eb0b7f2e05 tempest-TestMinimumBasicScenario-1297300454 tempest-TestMinimumBasicScenario-1297300454-project-admin] Synchronizing usage tracker for tenant:a588c51341504beda6a1803a15cc919c on resource:port {{(pid=91686) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:25:25.330233 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-189656b9-1a81-4e9b-957c-56bdb19530e7 req-06bfe392-ec47-4702-9342-3b9d76412e9b service neutron] 10.222.0.82 "GET /v2.0/networks/e31171ff-f097-446e-b691-bef7aad2fb3b?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1766016
May 20 04:25:25.338256 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-23bc50ac-3c84-41ef-8491-14eb0b7f2e05 tempest-TestMinimumBasicScenario-1297300454 tempest-TestMinimumBasicScenario-1297300454-project-admin] Unset dirty status for tenant:a588c51341504beda6a1803a15cc919c on resource:port {{(pid=91686) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:25:25.342778 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-23bc50ac-3c84-41ef-8491-14eb0b7f2e05 tempest-TestMinimumBasicScenario-1297300454 tempest-TestMinimumBasicScenario-1297300454-project-admin] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 1093 time: 0.3263142
May 20 04:25:25.343685 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 41200) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:25:25.349185 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.v2.base [None req-db3e56b1-3fb2-4c33-911d-32c38ad6aee8 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Request body: {'floatingip': {'floating_network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'port_id': '11028190-b228-415d-b5ee-2da1d6800073', 'tenant_id': 'e6fe6bea38b946a5a97ea42bf787f1b3', 'fixed_ip_address': '172.20.0.5'}} {{(pid=91686) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:25:25.356995 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-db3e56b1-3fb2-4c33-911d-32c38ad6aee8 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:25:25.362286 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-db3e56b1-3fb2-4c33-911d-32c38ad6aee8 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Usage tracker for resource:floatingip and tenant:e6fe6bea38b946a5a97ea42bf787f1b3 is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:25:25.366010 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-db3e56b1-3fb2-4c33-911d-32c38ad6aee8 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:25:25.374863 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-db3e56b1-3fb2-4c33-911d-32c38ad6aee8 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:25:25.387074 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-db3e56b1-3fb2-4c33-911d-32c38ad6aee8 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Notify callbacks [] for floatingip, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:25.504547 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-189656b9-1a81-4e9b-957c-56bdb19530e7 req-10c2cbfa-c5e6-4758-9675-2b23c4c7ee22 service neutron] 10.222.0.82 "GET /v2.0/networks/e31171ff-f097-446e-b691-bef7aad2fb3b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1657355
May 20 04:25:25.548516 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-db3e56b1-3fb2-4c33-911d-32c38ad6aee8 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:25.623316 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c07e026c-5d85-4f7b-9474-4a09e9238432 req-71104b4a-a417-4eab-877f-8f0657cbe287 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:25.624115 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-c07e026c-5d85-4f7b-9474-4a09e9238432 req-71104b4a-a417-4eab-877f-8f0657cbe287 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Synchronizing usage tracker for tenant:a1319e4a0fc74f98ba4bb88d8a04086b on resource:port {{(pid=91687) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:25:25.642186 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-c07e026c-5d85-4f7b-9474-4a09e9238432 req-71104b4a-a417-4eab-877f-8f0657cbe287 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Unset dirty status for tenant:a1319e4a0fc74f98ba4bb88d8a04086b on resource:port {{(pid=91687) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:25:25.643377 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-c07e026c-5d85-4f7b-9474-4a09e9238432 req-71104b4a-a417-4eab-877f-8f0657cbe287 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 944 time: 0.0988152
May 20 04:25:25.688671 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-c07e026c-5d85-4f7b-9474-4a09e9238432 req-d63c0245-edb2-402f-9265-907aa83cc4b8 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/security-groups?id=34e473fa-df05-422b-9abc-99aed131bade&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0393569
May 20 04:25:25.694370 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.db_base_plugin_common [None req-db3e56b1-3fb2-4c33-911d-32c38ad6aee8 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Allocated IP 172.27.1.219 (aec557db-0c02-4008-8c9f-2efcd7462f90/217f4b55-4415-4d57-8b43-2ff4c8ac8e81/b0ccda3d-4db4-4d4c-9952-99d4400de3f8) {{(pid=91686) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 04:25:25.783815 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 66e2d45a-eeae-4758-ad0e-fdb997dca9f5 details requested by agent hyperv_hv-cinder-79091 with host hv-cinder-79091 {{(pid=91688) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 20 04:25:25.887607 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-db3e56b1-3fb2-4c33-911d-32c38ad6aee8 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Notify callbacks [] for port, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:25.937654 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-db3e56b1-3fb2-4c33-911d-32c38ad6aee8 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8782892106231', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2145052'] for port, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:25.948046 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:25:25.985551 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port 66e2d45a-eeae-4758-ad0e-fdb997dca9f5, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=66e2d45a-eeae-4758-ad0e-fdb997dca9f5,segment=NetworkSegment(3cfe6ee0-17fa-47f2-8f37-995aaef6bfdc),segment_id=3cfe6ee0-17fa-47f2-8f37-995aaef6bfdc)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:25:26.042042 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Returning: {'device': '66e2d45a-eeae-4758-ad0e-fdb997dca9f5', 'network_id': 'c6308b4a-efff-48c2-b41d-58a08edddda1', 'port_id': '66e2d45a-eeae-4758-ad0e-fdb997dca9f5', 'mac_address': 'fa:16:3e:4f:aa:2e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 899, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2dceece0-8bc3-4f29-a183-108f8744d094', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91688) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 20 04:25:26.090451 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-db3e56b1-3fb2-4c33-911d-32c38ad6aee8 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Network aec557db-0c02-4008-8c9f-2efcd7462f90 is already hosted by enough agents. {{(pid=91686) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:25:26.094441 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.base_scheduler [None req-db3e56b1-3fb2-4c33-911d-32c38ad6aee8 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Resources bound (agent type, host, resource id):  {{(pid=91686) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:25:26.103536 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.l3_dvrscheduler_db [None req-db3e56b1-3fb2-4c33-911d-32c38ad6aee8 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Received port after_create {{(pid=91686) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 04:25:26.146285 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:26.169010 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.notifiers.nova [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 66e2d45a-eeae-4758-ad0e-fdb997dca9f5 {{(pid=91688) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 04:25:26.187447 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port 66e2d45a-eeae-4758-ad0e-fdb997dca9f5, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=66e2d45a-eeae-4758-ad0e-fdb997dca9f5,segment=NetworkSegment(3cfe6ee0-17fa-47f2-8f37-995aaef6bfdc),segment_id=3cfe6ee0-17fa-47f2-8f37-995aaef6bfdc)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:25:26.193964 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:26.196329 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:25:26.203243 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db3e56b1-3fb2-4c33-911d-32c38ad6aee8 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Pushing event updated for resources: {'Port': ['ID=b0ccda3d-4db4-4d4c-9952-99d4400de3f8,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:25:26.254774 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db3e56b1-3fb2-4c33-911d-32c38ad6aee8 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:25:26.255137 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db3e56b1-3fb2-4c33-911d-32c38ad6aee8 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:25:26.255492 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db3e56b1-3fb2-4c33-911d-32c38ad6aee8 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:25:26.255903 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db3e56b1-3fb2-4c33-911d-32c38ad6aee8 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:25:26.256249 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db3e56b1-3fb2-4c33-911d-32c38ad6aee8 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:25:26.256594 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db3e56b1-3fb2-4c33-911d-32c38ad6aee8 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:25:26.256929 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db3e56b1-3fb2-4c33-911d-32c38ad6aee8 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:25:26.257290 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db3e56b1-3fb2-4c33-911d-32c38ad6aee8 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:25:26.257638 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db3e56b1-3fb2-4c33-911d-32c38ad6aee8 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:25:26.257969 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db3e56b1-3fb2-4c33-911d-32c38ad6aee8 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:25:26.258304 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db3e56b1-3fb2-4c33-911d-32c38ad6aee8 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:25:26.258637 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db3e56b1-3fb2-4c33-911d-32c38ad6aee8 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:25:26.262877 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Pushing event updated for resources: {'Port': ['ID=66e2d45a-eeae-4758-ad0e-fdb997dca9f5,revision_number=4']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:25:26.265880 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:25:26.272921 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-db3e56b1-3fb2-4c33-911d-32c38ad6aee8 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.325s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:25:26.429577 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fd2cc86-8223-4fd1-829e-f1eb66d733cd req-4dcab71b-85cc-4367-9af5-ecf33be37e28 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:26.431066 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-3fd2cc86-8223-4fd1-829e-f1eb66d733cd req-4dcab71b-85cc-4367-9af5-ecf33be37e28 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 946 time: 0.3286853
May 20 04:25:26.500383 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d9bc8a1-a432-494a-acb1-379921c183d6 req-964ff2f2-b73d-4e5f-96e4-56aef76fea64 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:26.502211 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-8d9bc8a1-a432-494a-acb1-379921c183d6 req-964ff2f2-b73d-4e5f-96e4-56aef76fea64 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.71 "GET /v2.0/ports?device_id=e503d184-7bd9-4052-b1a1-8cd725e700e4 HTTP/1.1" status: 200  len: 944 time: 0.0895922
May 20 04:25:26.559796 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-8d9bc8a1-a432-494a-acb1-379921c183d6 req-2a91c6ae-51b1-4afc-b625-bfe8904efc60 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.71 "GET /v2.0/security-groups?id=e79e4ba4-358f-4b35-b5f3-7372b5116def&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0505495
May 20 04:25:26.657611 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-3fd2cc86-8223-4fd1-829e-f1eb66d733cd req-62042332-2909-4dc7-a4b2-dcba70448d52 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.2174797
May 20 04:25:26.751866 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-db3e56b1-3fb2-4c33-911d-32c38ad6aee8 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Notify callbacks [] for floatingip, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:26.833437 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-db3e56b1-3fb2-4c33-911d-32c38ad6aee8 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:26.902764 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0a9d492-3d9e-45ab-8e09-74627dbda9b0 req-49b71d26-e3d0-43b1-a820-d1711ff9b39b tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:26.904790 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-b0a9d492-3d9e-45ab-8e09-74627dbda9b0 req-49b71d26-e3d0-43b1-a820-d1711ff9b39b tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 944 time: 0.0961883
May 20 04:25:26.957148 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-b0a9d492-3d9e-45ab-8e09-74627dbda9b0 req-b0e1ee34-f59f-4679-a61f-3b425fe38f86 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/security-groups?id=34e473fa-df05-422b-9abc-99aed131bade&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0459130
May 20 04:25:27.066482 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-db3e56b1-3fb2-4c33-911d-32c38ad6aee8 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Notify callbacks [] for port, precommit_update {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:27.071772 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-db3e56b1-3fb2-4c33-911d-32c38ad6aee8 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2145029'] for port, after_update {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:27.076073 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:25:27.081190 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] get_ports_and_sgs() called for port_ids ['66e2d45a-eeae-4758-ad0e-fdb997dca9f5'] {{(pid=91688) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 04:25:27.187400 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db3e56b1-3fb2-4c33-911d-32c38ad6aee8 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Pushing event updated for resources: {'Port': ['ID=b0ccda3d-4db4-4d4c-9952-99d4400de3f8,revision_number=2']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:25:27.191872 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-db3e56b1-3fb2-4c33-911d-32c38ad6aee8 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.116s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:25:27.206615 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-db3e56b1-3fb2-4c33-911d-32c38ad6aee8 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1716406'] for floatingip, after_update {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:27.385265 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.db.l3_db [None req-db3e56b1-3fb2-4c33-911d-32c38ad6aee8 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Floating IP cdf6f05c-2933-4ca5-ace6-6998562ef031 associated. External IP: 172.27.1.219, port: 11028190-b228-415d-b5ee-2da1d6800073.
May 20 04:25:27.821760 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-db3e56b1-3fb2-4c33-911d-32c38ad6aee8 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Router 9c2e249a-3b4f-4271-8226-b44c455943cc has already been hosted by L3 agent 02733fc0-fc9c-4e29-bc03-c27a792d539d {{(pid=91686) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 04:25:27.853079 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4dbfe45-de09-4873-bc2d-410575485457 req-9c0b2a53-f257-46f7-afb0-305f6071fe46 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:27.854453 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-b4dbfe45-de09-4873-bc2d-410575485457 req-9c0b2a53-f257-46f7-afb0-305f6071fe46 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 946 time: 0.0847638
May 20 04:25:27.901739 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-b4dbfe45-de09-4873-bc2d-410575485457 req-68771bc2-566d-4668-ac5f-9584375cb5a6 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0412130
May 20 04:25:27.910040 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd4efc8e-b571-4edf-9414-144d27b8be8e req-0ee165ae-00cb-489d-97dd-c95c58eba6fb tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:27.911550 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-cd4efc8e-b571-4edf-9414-144d27b8be8e req-0ee165ae-00cb-489d-97dd-c95c58eba6fb tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.71 "GET /v2.0/ports?device_id=e503d184-7bd9-4052-b1a1-8cd725e700e4 HTTP/1.1" status: 200  len: 944 time: 0.1891820
May 20 04:25:28.041901 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-cd4efc8e-b571-4edf-9414-144d27b8be8e req-282f8c16-fb50-415b-8d5d-8fca751bf774 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.71 "GET /v2.0/security-groups?id=e79e4ba4-358f-4b35-b5f3-7372b5116def&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1210005
May 20 04:25:28.072201 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-db3e56b1-3fb2-4c33-911d-32c38ad6aee8 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Notify agent at l3_agent.dv-cinder-790910-4-iscsi the message routers_updated {{(pid=91686) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 04:25:28.084486 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fd21db1c-45d0-4512-954f-67bfc3bbaabe None None] Sync routers for ids ['9c2e249a-3b4f-4271-8226-b44c455943cc'] in dv-cinder-790910-4-iscsi {{(pid=91689) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 04:25:28.095314 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fd21db1c-45d0-4512-954f-67bfc3bbaabe None None] Routers {'9c2e249a-3b4f-4271-8226-b44c455943cc'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91689) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:25:28.096216 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-fd21db1c-45d0-4512-954f-67bfc3bbaabe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced176dee0>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:25:03Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['9c2e249a-3b4f-4271-8226-b44c455943cc'], 'active': True} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:25:28.108289 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-db3e56b1-3fb2-4c33-911d-32c38ad6aee8 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for floatingip, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:28.312930 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvr_db [None req-fd21db1c-45d0-4512-954f-67bfc3bbaabe None None] Set router 9c2e249a-3b4f-4271-8226-b44c455943cc gateway port host: dv-cinder-790910-4-iscsi {{(pid=91689) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:25:28.347316 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-db3e56b1-3fb2-4c33-911d-32c38ad6aee8 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 996 time: 3.0016425
May 20 04:25:28.348744 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'badc13d9-1d9b-4a5d-a461-b96945f2edc9', 'tag': '11028190-b228-415d-b5ee-2da1d6800073'}] {{(pid=91686) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:25:28.351099 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 41238) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:25:28.362596 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [None req-4aa381c2-1b3b-4a81-b4ea-3731ff52692d tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-358881961', 'description': 'tempest-secgroup-smoke-358881961 description', 'project_id': 'e6fe6bea38b946a5a97ea42bf787f1b3'}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:25:28.376478 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-4aa381c2-1b3b-4a81-b4ea-3731ff52692d tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:25:28.382653 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f28c738-8725-4c54-bf92-bc244cf73d23 req-c5cf2918-750e-454a-a717-4ee7c580934a tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:28.383633 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-7f28c738-8725-4c54-bf92-bc244cf73d23 req-c5cf2918-750e-454a-a717-4ee7c580934a tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 944 time: 0.1193490
May 20 04:25:28.397690 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c5a7d33-5e5e-4472-a3ae-b437bf6cce71 req-351fd981-394e-4eb2-bf6f-e7952add4f4b tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:28.399212 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-0c5a7d33-5e5e-4472-a3ae-b437bf6cce71 req-351fd981-394e-4eb2-bf6f-e7952add4f4b tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 945 time: 0.1432726
May 20 04:25:28.404049 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-4aa381c2-1b3b-4a81-b4ea-3731ff52692d tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:25:28.435634 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-4aa381c2-1b3b-4a81-b4ea-3731ff52692d tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Notify callbacks [] for security_group, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:28.467202 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-7f28c738-8725-4c54-bf92-bc244cf73d23 req-d7fe7564-a3b3-4f66-9021-dc2c3557d515 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/security-groups?id=34e473fa-df05-422b-9abc-99aed131bade&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0721960
May 20 04:25:28.474609 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-4aa381c2-1b3b-4a81-b4ea-3731ff52692d tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:25:28.485479 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-0c5a7d33-5e5e-4472-a3ae-b437bf6cce71 req-98dc95b7-80aa-4e4d-8b65-504cfa5ca3ff tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0724864
May 20 04:25:28.488152 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-4aa381c2-1b3b-4a81-b4ea-3731ff52692d tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Usage tracker for resource:security_group_rule and tenant:e6fe6bea38b946a5a97ea42bf787f1b3 is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:25:28.491389 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-4aa381c2-1b3b-4a81-b4ea-3731ff52692d tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:25:28.501316 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-4aa381c2-1b3b-4a81-b4ea-3731ff52692d tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:25:28.535655 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'badc13d9-1d9b-4a5d-a461-b96945f2edc9', 'tag': '11028190-b228-415d-b5ee-2da1d6800073', 'status': 'completed', 'code': 200}
May 20 04:25:28.637524 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-4aa381c2-1b3b-4a81-b4ea-3731ff52692d tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Notify callbacks [] for security_group, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:28.647433 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-4aa381c2-1b3b-4a81-b4ea-3731ff52692d tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:28.653209 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-a0b9e856-781b-443a-9872-bdf65b593a0b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:25:28.691845 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-fd21db1c-45d0-4512-954f-67bfc3bbaabe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced176dee0>, [{'id': '9c2e249a-3b4f-4271-8226-b44c455943cc', 'name': 'tempest-TestMinimumBasicScenario-1023892954-router', 'tenant_id': 'e6fe6bea38b946a5a97ea42bf787f1b3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.213'}], 'enable_snat': True}, 'gw_port_id': 'b4b174b3-1436-4e17-8fa3-97243bad59c3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:23:14Z', 'updated_at': '2021-05-20T04:23:21Z', 'revision_number': 4, 'project_id': 'e6fe6bea38b946a5a97ea42bf787f1b3', 'gw_port': {'id': 'b4b174b3-1436-4e17-8fa3-97243bad59c3', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:4d:2f:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c2e249a-3b4f-4271-8226-b44c455943cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 330, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:23:15Z', 'updated_at': '2021-05-20T04:23:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_floatingips': [{'id': 'cdf6f05c-2933-4ca5-ace6-6998562ef031', 'tenant_id': 'e6fe6bea38b946a5a97ea42bf787f1b3', 'floating_ip_address': '172.27.1.219', 'floating_network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'router_id': '9c2e249a-3b4f-4271-8226-b44c455943cc', 'port_id': '11028190-b228-415d-b5ee-2da1d6800073', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 451, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'fdf92998-25fa-4179-ab1b-131af0ce059a', 'mac_address': 'fa:16:3e:ed:24:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'badc13d9-1d9b-4a5d-a461-b96945f2edc9', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T04:25:26Z', 'updated_at': '2021-05-20T04:25:26Z', 'revision_number': 0, 'project_id': 'e6fe6bea38b946a5a97ea42bf787f1b3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '907a9337-b889-44b2-b856-48e472d2bc38', 'name': '', 'network_id': 'fdf92998-25fa-4179-ab1b-131af0ce059a', 'tenant_id': 'e6fe6bea38b946a5a97ea42bf787f1b3', 'mac_address': 'fa:16:3e:0f:d2:47', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c2e249a-3b4f-4271-8226-b44c455943cc', 'device_owner': 'network:router_interface', 'standard_attr_id': 333, 'fixed_ips': [{'subnet_id': 'e905ed23-00d1-4991-b3bb-e1a1e32b4c86', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:23:20Z', 'updated_at': '2021-05-20T04:23:36Z', 'revision_number': 5, 'project_id': 'e6fe6bea38b946a5a97ea42bf787f1b3', 'subnets': [{'id': 'e905ed23-00d1-4991-b3bb-e1a1e32b4c86', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:25:28.695816 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4aa381c2-1b3b-4a81-b4ea-3731ff52692d tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Pushing event updated for resources: {'SecurityGroup': ['ID=84c434c2-401c-4319-a0ff-8ceaf7cae545,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:25:28.697407 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fd21db1c-45d0-4512-954f-67bfc3bbaabe None None] Checking router: 9c2e249a-3b4f-4271-8226-b44c455943cc for host: dv-cinder-790910-4-iscsi {{(pid=91689) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 04:25:28.702329 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-4aa381c2-1b3b-4a81-b4ea-3731ff52692d tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:25:28.712432 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fd21db1c-45d0-4512-954f-67bfc3bbaabe None None] Routers {'9c2e249a-3b4f-4271-8226-b44c455943cc'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91689) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:25:28.713380 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-fd21db1c-45d0-4512-954f-67bfc3bbaabe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced176dee0>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:25:03Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['9c2e249a-3b4f-4271-8226-b44c455943cc'], 'active': True} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:25:28.717437 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-4aa381c2-1b3b-4a81-b4ea-3731ff52692d tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Notify callbacks [] for security_group, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:28.724629 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-4aa381c2-1b3b-4a81-b4ea-3731ff52692d tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1792 time: 0.3634286
May 20 04:25:28.724629 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b759e482-678d-4977-92d0-415655ac4bbc req-8cd0ffe9-ffe8-4f5b-97fa-48aef80c860d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:28.724629 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-b759e482-678d-4977-92d0-415655ac4bbc req-8cd0ffe9-ffe8-4f5b-97fa-48aef80c860d service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=e6fe6bea38b946a5a97ea42bf787f1b3&device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 1098 time: 0.1429248
May 20 04:25:28.725247 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 41244) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:25:28.729848 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [None req-825462b7-d089-4c45-aeac-b0ab8c3bae66 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Request body: {'security_group_rule': {'security_group_id': '84c434c2-401c-4319-a0ff-8ceaf7cae545', 'project_id': 'e6fe6bea38b946a5a97ea42bf787f1b3', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:25:28.736497 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-825462b7-d089-4c45-aeac-b0ab8c3bae66 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:25:28.760543 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-825462b7-d089-4c45-aeac-b0ab8c3bae66 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Usage tracker for resource:security_group_rule and tenant:e6fe6bea38b946a5a97ea42bf787f1b3 is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:25:28.774132 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-825462b7-d089-4c45-aeac-b0ab8c3bae66 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:25:28.783273 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-825462b7-d089-4c45-aeac-b0ab8c3bae66 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:25:28.867512 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-825462b7-d089-4c45-aeac-b0ab8c3bae66 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:28.908133 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvr_db [None req-fd21db1c-45d0-4512-954f-67bfc3bbaabe None None] Set router 9c2e249a-3b4f-4271-8226-b44c455943cc gateway port host: dv-cinder-790910-4-iscsi {{(pid=91689) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:25:28.958772 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b759e482-678d-4977-92d0-415655ac4bbc req-a2c2e3e4-8965-4c5d-be33-054d5b0ced5b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:28.960342 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-b759e482-678d-4977-92d0-415655ac4bbc req-a2c2e3e4-8965-4c5d-be33-054d5b0ced5b service neutron] 10.222.0.82 "GET /v2.0/networks?id=fdf92998-25fa-4179-ab1b-131af0ce059a HTTP/1.1" status: 200  len: 916 time: 0.2212639
May 20 04:25:29.113648 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-825462b7-d089-4c45-aeac-b0ab8c3bae66 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:29.121816 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-825462b7-d089-4c45-aeac-b0ab8c3bae66 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1597377'] for security_group_rule, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:29.238651 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-dcf78548-ff8c-4dcc-b517-bef34bbbc0d3 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:25:29.253001 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-b759e482-678d-4977-92d0-415655ac4bbc req-39b81fb9-061c-445c-a1de-424d1779a3f3 service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=11028190-b228-415d-b5ee-2da1d6800073 HTTP/1.1" status: 200  len: 999 time: 0.2838373
May 20 04:25:29.263401 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-825462b7-d089-4c45-aeac-b0ab8c3bae66 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=bc596e53-2f9f-4f96-ad57-5b688ebf2eba,revision_number=0']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:25:29.264739 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d09d9df-c3ea-4109-9925-6e310df6f49c req-ae9b0827-9ff7-4b82-971f-4063b17c3ac5 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:29.267824 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-825462b7-d089-4c45-aeac-b0ab8c3bae66 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:25:29.268890 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-8d09d9df-c3ea-4109-9925-6e310df6f49c req-ae9b0827-9ff7-4b82-971f-4063b17c3ac5 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.71 "GET /v2.0/ports?device_id=e503d184-7bd9-4052-b1a1-8cd725e700e4 HTTP/1.1" status: 200  len: 944 time: 0.1003995
May 20 04:25:29.319560 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-825462b7-d089-4c45-aeac-b0ab8c3bae66 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:29.320727 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-825462b7-d089-4c45-aeac-b0ab8c3bae66 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.5950525
May 20 04:25:29.328616 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 41252) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:25:29.338304 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [None req-1f43bae2-3c97-49fe-89ca-9123dafaf88f tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Request body: {'security_group_rule': {'security_group_id': '84c434c2-401c-4319-a0ff-8ceaf7cae545', 'project_id': 'e6fe6bea38b946a5a97ea42bf787f1b3', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:25:29.342294 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-fd21db1c-45d0-4512-954f-67bfc3bbaabe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced176dee0>, [{'id': '9c2e249a-3b4f-4271-8226-b44c455943cc', 'name': 'tempest-TestMinimumBasicScenario-1023892954-router', 'tenant_id': 'e6fe6bea38b946a5a97ea42bf787f1b3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.213'}], 'enable_snat': True}, 'gw_port_id': 'b4b174b3-1436-4e17-8fa3-97243bad59c3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:23:14Z', 'updated_at': '2021-05-20T04:23:21Z', 'revision_number': 4, 'project_id': 'e6fe6bea38b946a5a97ea42bf787f1b3', 'gw_port': {'id': 'b4b174b3-1436-4e17-8fa3-97243bad59c3', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:4d:2f:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c2e249a-3b4f-4271-8226-b44c455943cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 330, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:23:15Z', 'updated_at': '2021-05-20T04:23:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_floatingips': [{'id': 'cdf6f05c-2933-4ca5-ace6-6998562ef031', 'tenant_id': 'e6fe6bea38b946a5a97ea42bf787f1b3', 'floating_ip_address': '172.27.1.219', 'floating_network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'router_id': '9c2e249a-3b4f-4271-8226-b44c455943cc', 'port_id': '11028190-b228-415d-b5ee-2da1d6800073', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 451, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'fdf92998-25fa-4179-ab1b-131af0ce059a', 'mac_address': 'fa:16:3e:ed:24:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'badc13d9-1d9b-4a5d-a461-b96945f2edc9', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T04:25:26Z', 'updated_at': '2021-05-20T04:25:26Z', 'revision_number': 0, 'project_id': 'e6fe6bea38b946a5a97ea42bf787f1b3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '907a9337-b889-44b2-b856-48e472d2bc38', 'name': '', 'network_id': 'fdf92998-25fa-4179-ab1b-131af0ce059a', 'tenant_id': 'e6fe6bea38b946a5a97ea42bf787f1b3', 'mac_address': 'fa:16:3e:0f:d2:47', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c2e249a-3b4f-4271-8226-b44c455943cc', 'device_owner': 'network:router_interface', 'standard_attr_id': 333, 'fixed_ips': [{'subnet_id': 'e905ed23-00d1-4991-b3bb-e1a1e32b4c86', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:23:20Z', 'updated_at': '2021-05-20T04:23:36Z', 'revision_number': 5, 'project_id': 'e6fe6bea38b946a5a97ea42bf787f1b3', 'subnets': [{'id': 'e905ed23-00d1-4991-b3bb-e1a1e32b4c86', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:25:29.344425 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-1f43bae2-3c97-49fe-89ca-9123dafaf88f tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:25:29.348426 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-1f43bae2-3c97-49fe-89ca-9123dafaf88f tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Usage tracker for resource:security_group_rule and tenant:e6fe6bea38b946a5a97ea42bf787f1b3 is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:25:29.351817 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-1f43bae2-3c97-49fe-89ca-9123dafaf88f tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:25:29.358133 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-1f43bae2-3c97-49fe-89ca-9123dafaf88f tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:25:29.359028 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fd21db1c-45d0-4512-954f-67bfc3bbaabe None None] The sync data for ids ['9c2e249a-3b4f-4271-8226-b44c455943cc'] in dv-cinder-790910-4-iscsi is: [{'id': '9c2e249a-3b4f-4271-8226-b44c455943cc', 'name': 'tempest-TestMinimumBasicScenario-1023892954-router', 'tenant_id': 'e6fe6bea38b946a5a97ea42bf787f1b3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.213'}], 'enable_snat': True}, 'gw_port_id': 'b4b174b3-1436-4e17-8fa3-97243bad59c3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:23:14Z', 'updated_at': '2021-05-20T04:23:21Z', 'revision_number': 4, 'project_id': 'e6fe6bea38b946a5a97ea42bf787f1b3', 'gw_port': {'id': 'b4b174b3-1436-4e17-8fa3-97243bad59c3', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:4d:2f:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c2e249a-3b4f-4271-8226-b44c455943cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 330, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:23:15Z', 'updated_at': '2021-05-20T04:23:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_floatingips': [{'id': 'cdf6f05c-2933-4ca5-ace6-6998562ef031', 'tenant_id': 'e6fe6bea38b946a5a97ea42bf787f1b3', 'floating_ip_address': '172.27.1.219', 'floating_network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'router_id': '9c2e249a-3b4f-4271-8226-b44c455943cc', 'port_id': '11028190-b228-415d-b5ee-2da1d6800073', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 451, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'fdf92998-25fa-4179-ab1b-131af0ce059a', 'mac_address': 'fa:16:3e:ed:24:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'badc13d9-1d9b-4a5d-a461-b96945f2edc9', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T04:25:26Z', 'updated_at': '2021-05-20T04:25:26Z', 'revision_number': 0, 'project_id': 'e6fe6bea38b946a5a97ea42bf787f1b3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '907a9337-b889-44b2-b856-48e472d2bc38', 'name': '', 'network_id': 'fdf92998-25fa-4179-ab1b-131af0ce059a', 'tenant_id': 'e6fe6bea38b946a5a97ea42bf787f1b3', 'mac_address': 'fa:16:3e:0f:d2:47', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c2e249a-3b4f-4271-8226-b44c455943cc', 'device_owner': 'network:router_interface', 'standard_attr_id': 333, 'fixed_ips': [{'subnet_id': 'e905ed23-00d1-4991-b3bb-e1a1e32b4c86', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:23:20Z', 'updated_at': '2021-05-20T04:23:36Z', 'revision_number': 5, 'project_id': 'e6fe6bea38b946a5a97ea42bf787f1b3', 'subnets': [{'id': 'e905ed23-00d1-4991-b3bb-e1a1e32b4c86', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91689) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 04:25:29.407370 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-8d09d9df-c3ea-4109-9925-6e310df6f49c req-53308002-461f-48f0-8769-b45941f89a88 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.71 "GET /v2.0/security-groups?id=e79e4ba4-358f-4b35-b5f3-7372b5116def&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1265552
May 20 04:25:29.417362 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c84f4df4-1991-40e3-a9ef-8983e4125f53 req-a018519c-d7f3-4bba-ac69-acb0890a13e2 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:29.425206 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-c84f4df4-1991-40e3-a9ef-8983e4125f53 req-a018519c-d7f3-4bba-ac69-acb0890a13e2 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 946 time: 0.3934863
May 20 04:25:29.429144 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b759e482-678d-4977-92d0-415655ac4bbc req-dbb3d3ab-f662-4850-b331-0b24575b8e9b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:29.430547 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-b759e482-678d-4977-92d0-415655ac4bbc req-dbb3d3ab-f662-4850-b331-0b24575b8e9b service neutron] 10.222.0.82 "GET /v2.0/subnets?id=e905ed23-00d1-4991-b3bb-e1a1e32b4c86 HTTP/1.1" status: 200  len: 854 time: 0.1586761
May 20 04:25:29.468114 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-1f43bae2-3c97-49fe-89ca-9123dafaf88f tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:29.591329 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-c84f4df4-1991-40e3-a9ef-8983e4125f53 req-c5639e1e-fd3b-4ab2-8fb6-429334119f87 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1653235
May 20 04:25:29.658465 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-1f43bae2-3c97-49fe-89ca-9123dafaf88f tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:29.676871 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c11bacc4-1d36-44fc-b140-c9deee264d7d None None] New status for floating IP cdf6f05c-2933-4ca5-ace6-6998562ef031: ACTIVE {{(pid=91688) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 20 04:25:29.687455 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-1f43bae2-3c97-49fe-89ca-9123dafaf88f tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1597377'] for security_group_rule, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:29.710010 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:25:29.721510 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea8ea9d6-5309-4f86-b679-d4a19498292a req-e5dcf60c-d824-45ef-8e93-988a9b1799bc tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:29.723302 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-ea8ea9d6-5309-4f86-b679-d4a19498292a req-e5dcf60c-d824-45ef-8e93-988a9b1799bc tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 944 time: 0.1099172
May 20 04:25:29.773221 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f43bae2-3c97-49fe-89ca-9123dafaf88f tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f504cdef-8ff4-46a5-bad9-47028ccb3f74,revision_number=0']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:25:29.774221 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-ea8ea9d6-5309-4f86-b679-d4a19498292a req-f318f641-aa8a-4755-90c4-0f21c60bcf3d tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/security-groups?id=34e473fa-df05-422b-9abc-99aed131bade&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0445867
May 20 04:25:29.777676 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b759e482-678d-4977-92d0-415655ac4bbc req-92e9de7d-4d25-402b-92ee-82dd53a2e03a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:29.780085 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-b759e482-678d-4977-92d0-415655ac4bbc req-92e9de7d-4d25-402b-92ee-82dd53a2e03a service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=fdf92998-25fa-4179-ab1b-131af0ce059a&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.3013370
May 20 04:25:29.783136 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-1f43bae2-3c97-49fe-89ca-9123dafaf88f tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:25:29.794322 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 66e2d45a-eeae-4758-ad0e-fdb997dca9f5 up at agent hyperv_hv-cinder-79091 {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:25:29.797346 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-1f43bae2-3c97-49fe-89ca-9123dafaf88f tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:29.798470 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-1f43bae2-3c97-49fe-89ca-9123dafaf88f tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 763 time: 0.4680555
May 20 04:25:29.802537 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 41262) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:25:29.809449 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.v2.base [None req-d1c01625-e4e5-451a-9b15-0068a1528c28 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Request body: {'security_group_rule': {'security_group_id': '84c434c2-401c-4319-a0ff-8ceaf7cae545', 'project_id': 'e6fe6bea38b946a5a97ea42bf787f1b3', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=91686) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:25:29.816878 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-d1c01625-e4e5-451a-9b15-0068a1528c28 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:25:29.821672 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-d1c01625-e4e5-451a-9b15-0068a1528c28 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Usage tracker for resource:security_group_rule and tenant:e6fe6bea38b946a5a97ea42bf787f1b3 is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:25:29.825734 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-d1c01625-e4e5-451a-9b15-0068a1528c28 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:25:29.833710 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-d1c01625-e4e5-451a-9b15-0068a1528c28 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:25:29.852913 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-d1c01625-e4e5-451a-9b15-0068a1528c28 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:29.945080 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12b2ee94-6940-49c1-9597-49e14b879f8e req-bfbc74a9-4e29-49ee-977c-0db78cd6a01e tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:29.946637 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-12b2ee94-6940-49c1-9597-49e14b879f8e req-bfbc74a9-4e29-49ee-977c-0db78cd6a01e tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 945 time: 0.2207394
May 20 04:25:29.951387 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-d1c01625-e4e5-451a-9b15-0068a1528c28 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:29.957220 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-d1c01625-e4e5-451a-9b15-0068a1528c28 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1597377'] for security_group_rule, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:29.973466 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-efe1d76d-8b9a-4697-8056-aa3a51861427 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:25:29.984844 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-b759e482-678d-4977-92d0-415655ac4bbc req-32e7c9c9-ed97-46e4-bf35-97fe11a40019 service neutron] 10.222.0.82 "GET /v2.0/networks/fdf92998-25fa-4179-ab1b-131af0ce059a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1896615
May 20 04:25:29.989252 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-fd65c746-7773-4e32-8d7a-5257f661d925 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:29.990184 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1c01625-e4e5-451a-9b15-0068a1528c28 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=177a2044-2867-4a4b-ae83-21b8c6c8c25d,revision_number=0']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:25:29.993554 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-d1c01625-e4e5-451a-9b15-0068a1528c28 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:25:29.995608 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-d1c01625-e4e5-451a-9b15-0068a1528c28 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:29.996845 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-d1c01625-e4e5-451a-9b15-0068a1528c28 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.1930995
May 20 04:25:29.999795 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 41266) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:25:30.006361 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.v2.base [None req-3939627d-33d1-4c53-a8b6-ab8a6101c0aa tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Request body: {'security_group_rule': {'security_group_id': '84c434c2-401c-4319-a0ff-8ceaf7cae545', 'project_id': 'e6fe6bea38b946a5a97ea42bf787f1b3', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=91686) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:25:30.012288 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-3939627d-33d1-4c53-a8b6-ab8a6101c0aa tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:25:30.016793 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-3939627d-33d1-4c53-a8b6-ab8a6101c0aa tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Usage tracker for resource:security_group_rule and tenant:e6fe6bea38b946a5a97ea42bf787f1b3 is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:25:30.021466 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-3939627d-33d1-4c53-a8b6-ab8a6101c0aa tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:25:30.027529 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-3939627d-33d1-4c53-a8b6-ab8a6101c0aa tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:25:30.046087 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-3939627d-33d1-4c53-a8b6-ab8a6101c0aa tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:30.075072 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Provisioning for port 66e2d45a-eeae-4758-ad0e-fdb997dca9f5 completed by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:25:30.080821 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Provisioning complete for port 66e2d45a-eeae-4758-ad0e-fdb997dca9f5 triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:25:30.081254 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:30.118012 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-12b2ee94-6940-49c1-9597-49e14b879f8e req-09e61b05-ed98-4528-a173-b725945b2657 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1618459
May 20 04:25:30.121586 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-3939627d-33d1-4c53-a8b6-ab8a6101c0aa tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:30.129891 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-3939627d-33d1-4c53-a8b6-ab8a6101c0aa tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1597377'] for security_group_rule, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:30.140747 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-eeea5085-8f3d-4f2a-8d03-bfe7ce50b5dc tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:25:30.162105 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3939627d-33d1-4c53-a8b6-ab8a6101c0aa tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=11b9704c-de02-44c9-87ff-8ac1b1fd3352,revision_number=0']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:25:30.162531 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-b759e482-678d-4977-92d0-415655ac4bbc req-84900435-e483-4584-bb1e-ae9b306af666 service neutron] 10.222.0.82 "GET /v2.0/networks/fdf92998-25fa-4179-ab1b-131af0ce059a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1630633
May 20 04:25:30.165114 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-3939627d-33d1-4c53-a8b6-ab8a6101c0aa tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:25:30.170608 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-3939627d-33d1-4c53-a8b6-ab8a6101c0aa tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:30.172018 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-3939627d-33d1-4c53-a8b6-ab8a6101c0aa tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 768 time: 0.1710143
May 20 04:25:30.174850 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 41270) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:25:30.180083 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [None req-0ce1bdfe-2fff-446f-80e7-96c5997b8c61 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Request body: {'security_group_rule': {'security_group_id': '84c434c2-401c-4319-a0ff-8ceaf7cae545', 'project_id': 'e6fe6bea38b946a5a97ea42bf787f1b3', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:25:30.186053 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-0ce1bdfe-2fff-446f-80e7-96c5997b8c61 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:25:30.190196 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-0ce1bdfe-2fff-446f-80e7-96c5997b8c61 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Usage tracker for resource:security_group_rule and tenant:e6fe6bea38b946a5a97ea42bf787f1b3 is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:25:30.193133 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-0ce1bdfe-2fff-446f-80e7-96c5997b8c61 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:25:30.199323 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-0ce1bdfe-2fff-446f-80e7-96c5997b8c61 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:25:30.210156 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.db.securitygroups_db [None req-0ce1bdfe-2fff-446f-80e7-96c5997b8c61 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Project e6fe6bea38b946a5a97ea42bf787f1b3 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
May 20 04:25:30.215880 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-0ce1bdfe-2fff-446f-80e7-96c5997b8c61 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:30.235328 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:30.284680 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-0ce1bdfe-2fff-446f-80e7-96c5997b8c61 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:30.289572 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-0ce1bdfe-2fff-446f-80e7-96c5997b8c61 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1597377'] for security_group_rule, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:30.292324 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e503d184-7bd9-4052-b1a1-8cd725e700e4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '66e2d45a-eeae-4758-ad0e-fdb997dca9f5'}] {{(pid=91688) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:25:30.297381 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-1f43bae2-3c97-49fe-89ca-9123dafaf88f tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:25:30.301961 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port 66e2d45a-eeae-4758-ad0e-fdb997dca9f5, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=66e2d45a-eeae-4758-ad0e-fdb997dca9f5,segment=NetworkSegment(3cfe6ee0-17fa-47f2-8f37-995aaef6bfdc),segment_id=3cfe6ee0-17fa-47f2-8f37-995aaef6bfdc)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:25:30.307517 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:30.309407 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:25:30.317610 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ce1bdfe-2fff-446f-80e7-96c5997b8c61 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2dfa4fc3-4662-4725-98f8-9a27c8a8243d,revision_number=0']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:25:30.320195 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-0ce1bdfe-2fff-446f-80e7-96c5997b8c61 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:25:30.329555 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-0ce1bdfe-2fff-446f-80e7-96c5997b8c61 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:30.331197 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-0ce1bdfe-2fff-446f-80e7-96c5997b8c61 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 774 time: 0.1549630
May 20 04:25:30.333489 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 41276) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:25:30.340838 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [None req-d1e6c3a9-b859-402e-acca-ca1c4e5d92a1 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Request body: {'security_group_rule': {'security_group_id': '84c434c2-401c-4319-a0ff-8ceaf7cae545', 'project_id': 'e6fe6bea38b946a5a97ea42bf787f1b3', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:25:30.347614 dv-cinder-790910-4-iscsi neutron-server[91688]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e503d184-7bd9-4052-b1a1-8cd725e700e4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '66e2d45a-eeae-4758-ad0e-fdb997dca9f5', 'code': 200}
May 20 04:25:30.347810 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-d1e6c3a9-b859-402e-acca-ca1c4e5d92a1 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:25:30.351933 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-d1e6c3a9-b859-402e-acca-ca1c4e5d92a1 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Usage tracker for resource:security_group_rule and tenant:e6fe6bea38b946a5a97ea42bf787f1b3 is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:25:30.354850 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-d1e6c3a9-b859-402e-acca-ca1c4e5d92a1 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:25:30.361083 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-d1e6c3a9-b859-402e-acca-ca1c4e5d92a1 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:25:30.374331 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.db.securitygroups_db [None req-d1e6c3a9-b859-402e-acca-ca1c4e5d92a1 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Project e6fe6bea38b946a5a97ea42bf787f1b3 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
May 20 04:25:30.380785 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-d1e6c3a9-b859-402e-acca-ca1c4e5d92a1 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:30.382263 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Pushing event updated for resources: {'Port': ['ID=66e2d45a-eeae-4758-ad0e-fdb997dca9f5,revision_number=5']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:25:30.385448 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:25:30.456564 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-d1e6c3a9-b859-402e-acca-ca1c4e5d92a1 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:30.464040 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-d1e6c3a9-b859-402e-acca-ca1c4e5d92a1 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1597377'] for security_group_rule, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:30.466479 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:25:30.496904 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1e6c3a9-b859-402e-acca-ca1c4e5d92a1 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d34aa0ef-f646-47b1-b997-5e591fc05f3f,revision_number=0']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:25:30.499394 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-d1e6c3a9-b859-402e-acca-ca1c4e5d92a1 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:25:30.514358 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-d1e6c3a9-b859-402e-acca-ca1c4e5d92a1 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:30.519500 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-d1e6c3a9-b859-402e-acca-ca1c4e5d92a1 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 773 time: 0.1844764
May 20 04:25:30.646420 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-ce9836c0-8f09-4526-843c-373a693fc8f4 req-e67a53e5-f2e6-4185-ab73-8353d2a628be tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-358881961&fields=id&tenant_id=e6fe6bea38b946a5a97ea42bf787f1b3 HTTP/1.1" status: 200  len: 267 time: 0.0403504
May 20 04:25:30.673206 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adfdc1a8-0513-42df-bcb3-f5d73f3b533e req-8816aaee-a501-49b2-8226-d8c69c222330 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:30.674680 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-adfdc1a8-0513-42df-bcb3-f5d73f3b533e req-8816aaee-a501-49b2-8226-d8c69c222330 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.71 "GET /v2.0/ports?device_id=e503d184-7bd9-4052-b1a1-8cd725e700e4 HTTP/1.1" status: 200  len: 945 time: 0.1474171
May 20 04:25:30.695798 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-072f01ac-c8c6-4cf8-9c9c-9dbecf18c0c2 req-db5db475-554c-4fe5-a62d-651b1fae975f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:30.697316 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-072f01ac-c8c6-4cf8-9c9c-9dbecf18c0c2 req-db5db475-554c-4fe5-a62d-651b1fae975f service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=e503d184-7bd9-4052-b1a1-8cd725e700e4 HTTP/1.1" status: 200  len: 1098 time: 0.1299269
May 20 04:25:30.740941 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce9836c0-8f09-4526-843c-373a693fc8f4 req-0b99e8b6-f98d-4df9-9ed4-1a47995f7fec tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:30.742503 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-ce9836c0-8f09-4526-843c-373a693fc8f4 req-0b99e8b6-f98d-4df9-9ed4-1a47995f7fec tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 945 time: 0.0899339
May 20 04:25:30.754796 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.v2.base [req-ce9836c0-8f09-4526-843c-373a693fc8f4 req-f44c4d83-2f82-44be-8d25-edfdd61c6646 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Request body: {'port': {'security_groups': ['c188bb94-d954-43bd-b580-a3037bfce567', '84c434c2-401c-4319-a0ff-8ceaf7cae545']}} {{(pid=91686) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:25:30.758942 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-adfdc1a8-0513-42df-bcb3-f5d73f3b533e req-cddde43e-c7a1-495b-9c48-34fc29fdaff7 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.71 "GET /v2.0/security-groups?id=e79e4ba4-358f-4b35-b5f3-7372b5116def&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0778766
May 20 04:25:30.769577 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-072f01ac-c8c6-4cf8-9c9c-9dbecf18c0c2 req-e73c7ee3-238a-4cad-a020-859840fa141c service neutron] 10.222.0.82 "GET /v2.0/security-groups?id=e79e4ba4-358f-4b35-b5f3-7372b5116def&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0631337
May 20 04:25:30.880879 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [req-ce9836c0-8f09-4526-843c-373a693fc8f4 req-f44c4d83-2f82-44be-8d25-edfdd61c6646 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:30.937993 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce082dd4-91af-4029-8790-0d618fc9c7b7 req-f87a0451-28be-45b3-87e0-a11d32025b22 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:30.939515 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-ce082dd4-91af-4029-8790-0d618fc9c7b7 req-f87a0451-28be-45b3-87e0-a11d32025b22 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 946 time: 0.0876360
May 20 04:25:30.986647 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-ce082dd4-91af-4029-8790-0d618fc9c7b7 req-a84ee740-91ed-42ed-bcbc-d86877e89fca tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0405896
May 20 04:25:31.174218 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.db [req-ce9836c0-8f09-4526-843c-373a693fc8f4 req-f44c4d83-2f82-44be-8d25-edfdd61c6646 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] For port 11028190-b228-415d-b5ee-2da1d6800073, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=11028190-b228-415d-b5ee-2da1d6800073,segment=NetworkSegment(b84e1e85-c58b-4982-b59b-cb9584098e15),segment_id=b84e1e85-c58b-4982-b59b-cb9584098e15)] {{(pid=91686) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:25:31.182899 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed9ae33c-6535-4dbb-a9fd-57b8be257a39 req-d053a4c9-fbe5-4d63-9f6b-129619e63808 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:31.184401 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-ed9ae33c-6535-4dbb-a9fd-57b8be257a39 req-d053a4c9-fbe5-4d63-9f6b-129619e63808 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 944 time: 0.0908864
May 20 04:25:31.200984 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [req-ce9836c0-8f09-4526-843c-373a693fc8f4 req-f44c4d83-2f82-44be-8d25-edfdd61c6646 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Notify callbacks [] for port, precommit_update {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:31.207166 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [req-ce9836c0-8f09-4526-843c-373a693fc8f4 req-f44c4d83-2f82-44be-8d25-edfdd61c6646 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2145029'] for port, after_update {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:31.214391 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-0be043de-d532-41b2-935d-7b5c73f44b64 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:25:31.229058 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] get_ports_and_sgs() called for port_ids ['11028190-b228-415d-b5ee-2da1d6800073'] {{(pid=91688) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 04:25:31.234880 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-ed9ae33c-6535-4dbb-a9fd-57b8be257a39 req-01d57faa-9f49-46e6-b03a-2a6bc90d1d52 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/security-groups?id=34e473fa-df05-422b-9abc-99aed131bade&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0440876
May 20 04:25:31.276321 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce9836c0-8f09-4526-843c-373a693fc8f4 req-f44c4d83-2f82-44be-8d25-edfdd61c6646 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:31.277029 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [req-ce9836c0-8f09-4526-843c-373a693fc8f4 req-f44c4d83-2f82-44be-8d25-edfdd61c6646 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for port, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:31.278465 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-ce9836c0-8f09-4526-843c-373a693fc8f4 req-f44c4d83-2f82-44be-8d25-edfdd61c6646 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "PUT /v2.0/ports/11028190-b228-415d-b5ee-2da1d6800073 HTTP/1.1" status: 200  len: 981 time: 0.5292478
May 20 04:25:31.278959 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'badc13d9-1d9b-4a5d-a461-b96945f2edc9', 'tag': '11028190-b228-415d-b5ee-2da1d6800073'}] {{(pid=91686) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:25:31.337066 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f44c4d83-2f82-44be-8d25-edfdd61c6646 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Pushing event updated for resources: {'Port': ['ID=11028190-b228-415d-b5ee-2da1d6800073,revision_number=6']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:25:31.343653 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-f44c4d83-2f82-44be-8d25-edfdd61c6646 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.129s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:25:31.478296 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-855d8f43-8967-4ead-b6ca-d97c0eb0529b req-f37c1acd-4dd0-40aa-af9a-a9d7f6963f48 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:31.480013 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-855d8f43-8967-4ead-b6ca-d97c0eb0529b req-f37c1acd-4dd0-40aa-af9a-a9d7f6963f48 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 945 time: 0.0993843
May 20 04:25:31.480388 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a49e661d-2383-4db9-9c5f-15ed3ccc3f23 req-3f7062d1-27fc-4c27-8666-dc81b6e874ce tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:31.482043 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-a49e661d-2383-4db9-9c5f-15ed3ccc3f23 req-3f7062d1-27fc-4c27-8666-dc81b6e874ce tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 984 time: 0.0866632
May 20 04:25:31.541682 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-a49e661d-2383-4db9-9c5f-15ed3ccc3f23 req-5f58ff6e-f955-4691-ad39-f1fbdf0c92a6 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=84c434c2-401c-4319-a0ff-8ceaf7cae545&id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0522177
May 20 04:25:31.545086 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-855d8f43-8967-4ead-b6ca-d97c0eb0529b req-c00b3ef7-15d5-425e-9aa8-7c82f37a2b14 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0531974
May 20 04:25:31.553888 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-0c44265f-da8f-4828-b1e9-e4e4dc0ba05b None None] Provisioning complete for port 11028190-b228-415d-b5ee-2da1d6800073 triggered by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:25:31.554258 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-0c44265f-da8f-4828-b1e9-e4e4dc0ba05b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:31.579239 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] get_ports_and_sgs() called for port_ids ['11028190-b228-415d-b5ee-2da1d6800073'] {{(pid=91688) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 04:25:31.602901 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'badc13d9-1d9b-4a5d-a461-b96945f2edc9', 'tag': '11028190-b228-415d-b5ee-2da1d6800073', 'status': 'completed', 'code': 200}
May 20 04:25:31.721192 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b37d7a7e-b28d-44b3-a805-7fafac4320af req-2f2498ac-5ef9-4cb2-89f9-305b4fe3a881 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:31.722707 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-b37d7a7e-b28d-44b3-a805-7fafac4320af req-2f2498ac-5ef9-4cb2-89f9-305b4fe3a881 service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=e6fe6bea38b946a5a97ea42bf787f1b3&device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 1137 time: 0.0860982
May 20 04:25:31.870541 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b37d7a7e-b28d-44b3-a805-7fafac4320af req-a1972c1a-ac9f-45dd-b47e-969971022de4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:31.871625 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-b37d7a7e-b28d-44b3-a805-7fafac4320af req-a1972c1a-ac9f-45dd-b47e-969971022de4 service neutron] 10.222.0.82 "GET /v2.0/networks?id=fdf92998-25fa-4179-ab1b-131af0ce059a HTTP/1.1" status: 200  len: 916 time: 0.1397812
May 20 04:25:32.034298 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-b37d7a7e-b28d-44b3-a805-7fafac4320af req-eaaa32f6-69be-439b-82a4-c65119359b3b service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=11028190-b228-415d-b5ee-2da1d6800073 HTTP/1.1" status: 200  len: 1001 time: 0.1272728
May 20 04:25:32.178231 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22d586f4-6803-4d8d-bc25-ef5acfd4b1db req-dd264217-76e9-46ad-a62d-27c83c5679e4 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:32.179762 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-22d586f4-6803-4d8d-bc25-ef5acfd4b1db req-dd264217-76e9-46ad-a62d-27c83c5679e4 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.71 "GET /v2.0/ports?device_id=e503d184-7bd9-4052-b1a1-8cd725e700e4 HTTP/1.1" status: 200  len: 945 time: 0.3075354
May 20 04:25:32.212890 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b37d7a7e-b28d-44b3-a805-7fafac4320af req-cc2226f5-0707-446b-9dfc-0af575f8cfb5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:32.214353 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-b37d7a7e-b28d-44b3-a805-7fafac4320af req-cc2226f5-0707-446b-9dfc-0af575f8cfb5 service neutron] 10.222.0.82 "GET /v2.0/subnets?id=e905ed23-00d1-4991-b3bb-e1a1e32b4c86 HTTP/1.1" status: 200  len: 854 time: 0.1707516
May 20 04:25:32.226828 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f51ec16-7ed4-42c1-b4cd-9ab6d85c3698 req-f6f090de-98e9-4677-b369-e352a5c4c45a tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:32.229631 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-6f51ec16-7ed4-42c1-b4cd-9ab6d85c3698 req-f6f090de-98e9-4677-b369-e352a5c4c45a tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 946 time: 0.1217873
May 20 04:25:32.235539 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-22d586f4-6803-4d8d-bc25-ef5acfd4b1db req-79292981-e44f-42b0-8d32-340854f32f6c tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.71 "GET /v2.0/security-groups?id=e79e4ba4-358f-4b35-b5f3-7372b5116def&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0497746
May 20 04:25:32.289764 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-6f51ec16-7ed4-42c1-b4cd-9ab6d85c3698 req-e4748a69-e05c-4092-8f0d-f39234f4b1ad tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0530064
May 20 04:25:32.435812 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d8c36ff-5086-46a8-b9e4-1664717bd4e5 req-bc85dd79-ebbb-4bc4-94bd-09ab18052f6a tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:32.437390 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-5d8c36ff-5086-46a8-b9e4-1664717bd4e5 req-bc85dd79-ebbb-4bc4-94bd-09ab18052f6a tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.82 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 945 time: 0.1912875
May 20 04:25:32.440346 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b37d7a7e-b28d-44b3-a805-7fafac4320af req-78b01f19-576e-4cf9-b769-9d8a396813e2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:32.441822 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-b37d7a7e-b28d-44b3-a805-7fafac4320af req-78b01f19-576e-4cf9-b769-9d8a396813e2 service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=fdf92998-25fa-4179-ab1b-131af0ce059a&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1969533
May 20 04:25:32.546321 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:32.690828 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8610560-e6c6-463c-a16c-4f1eccd1403f req-fd185523-4637-47f4-95eb-06f09018b2e2 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:32.692365 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a8610560-e6c6-463c-a16c-4f1eccd1403f req-fd185523-4637-47f4-95eb-06f09018b2e2 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 944 time: 0.3209970
May 20 04:25:32.711660 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-a980da86-475f-4321-bb2c-9bf968fd080a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:32.722866 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-b37d7a7e-b28d-44b3-a805-7fafac4320af req-62abdf84-d3bb-4fa0-adc5-e4cebcbb4907 service neutron] 10.222.0.82 "GET /v2.0/networks/fdf92998-25fa-4179-ab1b-131af0ce059a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2727149
May 20 04:25:32.812407 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eda7d3b6-6105-4de0-9235-11881139541a req-769e86c9-ee23-4abf-b639-588a5ecced24 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:32.814558 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-eda7d3b6-6105-4de0-9235-11881139541a req-769e86c9-ee23-4abf-b639-588a5ecced24 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 945 time: 0.1575751
May 20 04:25:32.831693 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a8610560-e6c6-463c-a16c-4f1eccd1403f req-71b95b25-56d1-4348-a7f7-20553ae59688 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/security-groups?id=34e473fa-df05-422b-9abc-99aed131bade&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1005535
May 20 04:25:32.843309 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [req-5d8c36ff-5086-46a8-b9e4-1664717bd4e5 req-74b4e1cd-3141-4d28-ac16-8ae2b42a2880 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Deleting port 10fe1059-aa07-4700-a931-76bcfa45b119 {{(pid=91687) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 04:25:32.843744 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-5d8c36ff-5086-46a8-b9e4-1664717bd4e5 req-74b4e1cd-3141-4d28-ac16-8ae2b42a2880 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8782892520551'] for port, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:32.901223 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-eda7d3b6-6105-4de0-9235-11881139541a req-003b465e-de73-4a9c-b6ab-2fa681e6bd3c tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0744972
May 20 04:25:33.054458 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-b37d7a7e-b28d-44b3-a805-7fafac4320af req-a1c93810-f92b-47d3-918d-2f61ec9d4569 service neutron] 10.222.0.82 "GET /v2.0/networks/fdf92998-25fa-4179-ab1b-131af0ce059a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2974906
May 20 04:25:33.082660 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [req-5d8c36ff-5086-46a8-b9e4-1664717bd4e5 req-74b4e1cd-3141-4d28-ac16-8ae2b42a2880 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] For port 10fe1059-aa07-4700-a931-76bcfa45b119, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=10fe1059-aa07-4700-a931-76bcfa45b119,segment=NetworkSegment(9d2ee761-256d-4e66-82a3-ef6e5bd352c1),segment_id=9d2ee761-256d-4e66-82a3-ef6e5bd352c1)] {{(pid=91687) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:25:33.082926 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-5d8c36ff-5086-46a8-b9e4-1664717bd4e5 req-74b4e1cd-3141-4d28-ac16-8ae2b42a2880 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1718922'] for port, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:33.204434 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [req-5d8c36ff-5086-46a8-b9e4-1664717bd4e5 req-74b4e1cd-3141-4d28-ac16-8ae2b42a2880 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Calling delete_port for 10fe1059-aa07-4700-a931-76bcfa45b119 owned by compute:nova {{(pid=91687) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 04:25:33.328577 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-5d8c36ff-5086-46a8-b9e4-1664717bd4e5 req-74b4e1cd-3141-4d28-ac16-8ae2b42a2880 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8782892522936', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8782892108804', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4162192'] for port, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:33.330909 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ea4803bd-878f-47d5-9084-1ec41953c9db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:33.333653 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:25:33.342437 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] get_ports_and_sgs() called for port_ids ['65d523e1-f132-4819-aa42-995ded4a1ad8', '10fe1059-aa07-4700-a931-76bcfa45b119'] {{(pid=91688) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 04:25:33.459830 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74b4e1cd-3141-4d28-ac16-8ae2b42a2880 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Pushing event deleted for resources: {'Port': ['ID=10fe1059-aa07-4700-a931-76bcfa45b119,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:25:33.463116 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-74b4e1cd-3141-4d28-ac16-8ae2b42a2880 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.129s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:25:33.527462 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.l3_dvrscheduler_db [req-5d8c36ff-5086-46a8-b9e4-1664717bd4e5 req-74b4e1cd-3141-4d28-ac16-8ae2b42a2880 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] No DVR routers for this DVR port 10fe1059-aa07-4700-a931-76bcfa45b119 on host hv-cinder-79091 {{(pid=91687) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 04:25:33.532873 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-5d8c36ff-5086-46a8-b9e4-1664717bd4e5 req-74b4e1cd-3141-4d28-ac16-8ae2b42a2880 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for port, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:33.537405 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2d35fcf1-2045-41ad-8d43-0b244e5b4d20', 'name': 'network-vif-deleted', 'tag': '10fe1059-aa07-4700-a931-76bcfa45b119'}] {{(pid=91687) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:25:33.565352 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-5d8c36ff-5086-46a8-b9e4-1664717bd4e5 req-74b4e1cd-3141-4d28-ac16-8ae2b42a2880 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.82 "DELETE /v2.0/ports/10fe1059-aa07-4700-a931-76bcfa45b119 HTTP/1.1" status: 204  len: 173 time: 1.1140954
May 20 04:25:33.586310 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fc996f7-f0ab-4e52-83c2-c4c3f247e318 req-b9f8a048-1906-43c7-a2be-46836a2813f3 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:33.588506 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-1fc996f7-f0ab-4e52-83c2-c4c3f247e318 req-b9f8a048-1906-43c7-a2be-46836a2813f3 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.71 "GET /v2.0/ports?device_id=e503d184-7bd9-4052-b1a1-8cd725e700e4 HTTP/1.1" status: 200  len: 945 time: 0.2206664
May 20 04:25:33.609729 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-feee16cc-502e-425f-9922-ba48c4c70a85 req-ec206c83-06cc-45ac-9632-af191837cfd6 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:33.611461 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-feee16cc-502e-425f-9922-ba48c4c70a85 req-ec206c83-06cc-45ac-9632-af191837cfd6 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 946 time: 0.1339602
May 20 04:25:33.643337 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-1fc996f7-f0ab-4e52-83c2-c4c3f247e318 req-595af0ca-f8f7-4652-955e-e92511abfd28 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.71 "GET /v2.0/security-groups?id=e79e4ba4-358f-4b35-b5f3-7372b5116def&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0481944
May 20 04:25:33.670526 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-feee16cc-502e-425f-9922-ba48c4c70a85 req-97281b86-8c44-4e18-b333-ba850b1fc22a tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0459299
May 20 04:25:33.693971 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:33.729366 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2d35fcf1-2045-41ad-8d43-0b244e5b4d20', 'name': 'network-vif-deleted', 'tag': '10fe1059-aa07-4700-a931-76bcfa45b119', 'status': 'completed', 'code': 200}
May 20 04:25:34.109249 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-da17e79c-bd04-4e28-b606-ac2ccd8ac825 req-95834545-b72e-4b08-9de8-c1ac3c72bd32 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Synchronizing usage tracker for tenant:b7d86d894a5f420e86f4c28d7772bd22 on resource:port {{(pid=91687) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:25:34.114139 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e7c5621-7473-4e86-8bf5-02492072864e req-686b82df-e698-4404-9ced-00d07eb29e99 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:34.123461 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-8e7c5621-7473-4e86-8bf5-02492072864e req-686b82df-e698-4404-9ced-00d07eb29e99 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 944 time: 0.1044700
May 20 04:25:34.127246 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-da17e79c-bd04-4e28-b606-ac2ccd8ac825 req-95834545-b72e-4b08-9de8-c1ac3c72bd32 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Unset dirty status for tenant:b7d86d894a5f420e86f4c28d7772bd22 on resource:port {{(pid=91687) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:25:34.130103 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-da17e79c-bd04-4e28-b606-ac2ccd8ac825 req-95834545-b72e-4b08-9de8-c1ac3c72bd32 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=2d35fcf1-2045-41ad-8d43-0b244e5b4d20 HTTP/1.1" status: 200  len: 210 time: 0.0704675
May 20 04:25:34.171234 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-8e7c5621-7473-4e86-8bf5-02492072864e req-2b8d252d-dc36-4129-814d-835ee2583255 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/security-groups?id=34e473fa-df05-422b-9abc-99aed131bade&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0468941
May 20 04:25:34.895649 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7151688e-7651-4dfe-a930-4cd1b5f7bd06 req-78ee6a2f-40f1-4925-94a0-21126b213f5f tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:34.897109 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-7151688e-7651-4dfe-a930-4cd1b5f7bd06 req-78ee6a2f-40f1-4925-94a0-21126b213f5f tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 946 time: 0.1049564
May 20 04:25:34.953499 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-7151688e-7651-4dfe-a930-4cd1b5f7bd06 req-6c13ad01-2c3d-4b7d-a6fc-59a005622687 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0498343
May 20 04:25:35.188970 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f21320cc-6a25-4ec1-8a32-8b119b35fd55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:35.366465 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35278287-bc94-4d64-9a38-01e61b292f8f req-f4b7a066-5ca2-4afd-8643-784f2bf95c24 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:35.367987 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-35278287-bc94-4d64-9a38-01e61b292f8f req-f4b7a066-5ca2-4afd-8643-784f2bf95c24 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 944 time: 0.0836763
May 20 04:25:35.416860 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-35278287-bc94-4d64-9a38-01e61b292f8f req-f9ea51d2-2d19-4ece-b15d-757fe44ac40a tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/security-groups?id=34e473fa-df05-422b-9abc-99aed131bade&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0414383
May 20 04:25:35.737238 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4b0b76c-fd25-4635-b05d-6671f5647ef3 req-ea86f4af-e32b-41d2-8151-570132612d55 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:35.738832 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-c4b0b76c-fd25-4635-b05d-6671f5647ef3 req-ea86f4af-e32b-41d2-8151-570132612d55 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.1730812
May 20 04:25:35.796139 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-c4b0b76c-fd25-4635-b05d-6671f5647ef3 req-ed98a861-ed73-4e7a-a940-5e5176f6a647 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0472934
May 20 04:25:35.814156 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 9c846663-c90b-41d4-a8d1-1086882ba27e details requested by agent hyperv_hv-cinder-79091 with host hv-cinder-79091 {{(pid=91688) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 20 04:25:35.817766 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 10fe1059-aa07-4700-a931-76bcfa45b119 no longer exists at agent hyperv_hv-cinder-79091 {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 04:25:35.859207 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] No Port match for: 10fe1059-aa07-4700-a931-76bcfa45b119 {{(pid=91688) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 04:25:35.859575 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 10fe1059-aa07-4700-a931-76bcfa45b119 not bound to the agent host hv-cinder-79091 {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 04:25:36.003007 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port 9c846663-c90b-41d4-a8d1-1086882ba27e, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=9c846663-c90b-41d4-a8d1-1086882ba27e,segment=NetworkSegment(e5874c72-d111-4955-a5aa-fbad5f078a34),segment_id=e5874c72-d111-4955-a5aa-fbad5f078a34)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:25:36.018537 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Returning: {'device': '9c846663-c90b-41d4-a8d1-1086882ba27e', 'network_id': 'e31171ff-f097-446e-b691-bef7aad2fb3b', 'port_id': '9c846663-c90b-41d4-a8d1-1086882ba27e', 'mac_address': 'fa:16:3e:ee:c7:b4', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 880, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '410f59de-055d-4298-96bf-5d9a7712368d', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91688) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 20 04:25:36.078339 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:36.095579 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.notifiers.nova [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 9c846663-c90b-41d4-a8d1-1086882ba27e {{(pid=91688) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 04:25:36.115633 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port 9c846663-c90b-41d4-a8d1-1086882ba27e, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=9c846663-c90b-41d4-a8d1-1086882ba27e,segment=NetworkSegment(e5874c72-d111-4955-a5aa-fbad5f078a34),segment_id=e5874c72-d111-4955-a5aa-fbad5f078a34)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:25:36.120651 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:36.122628 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:25:36.175092 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94ab52d4-43f9-417b-876e-8600b2ab81fb req-2d1c5dc5-7222-426c-be7a-1f94ffd873a4 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:36.183276 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-94ab52d4-43f9-417b-876e-8600b2ab81fb req-2d1c5dc5-7222-426c-be7a-1f94ffd873a4 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 946 time: 0.0990701
May 20 04:25:36.202356 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Pushing event updated for resources: {'Port': ['ID=9c846663-c90b-41d4-a8d1-1086882ba27e,revision_number=4']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:25:36.206226 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:25:36.235346 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-94ab52d4-43f9-417b-876e-8600b2ab81fb req-de2472dc-888f-4706-8d79-2a87028eed32 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0511885
May 20 04:25:36.616230 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a2d87d8-8690-4464-8e4a-90348db075b0 req-aa5aeed6-09c9-4501-8f79-da9242308936 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:36.617867 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-5a2d87d8-8690-4464-8e4a-90348db075b0 req-aa5aeed6-09c9-4501-8f79-da9242308936 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 945 time: 0.0926239
May 20 04:25:36.672812 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-5a2d87d8-8690-4464-8e4a-90348db075b0 req-08e10fe8-823f-48de-913c-9a99eedcc3af tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/security-groups?id=34e473fa-df05-422b-9abc-99aed131bade&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0436242
May 20 04:25:36.723313 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] get_ports_and_sgs() called for port_ids ['9c846663-c90b-41d4-a8d1-1086882ba27e'] {{(pid=91688) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 04:25:37.085858 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-822c8ef1-cb9a-412c-b428-7d369192c405 req-566edc15-1cdc-430b-b39a-aa85f01ae9b0 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:37.087220 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-822c8ef1-cb9a-412c-b428-7d369192c405 req-566edc15-1cdc-430b-b39a-aa85f01ae9b0 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.1774597
May 20 04:25:37.140467 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-822c8ef1-cb9a-412c-b428-7d369192c405 req-b6309238-d075-41d4-acca-d844ca3a5c51 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0442159
May 20 04:25:37.435387 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b894a05f-7afb-4ec5-8665-a53bb0c864eb req-140f61ef-a3a8-46da-b58e-2bb1fad29d47 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:37.437363 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-b894a05f-7afb-4ec5-8665-a53bb0c864eb req-140f61ef-a3a8-46da-b58e-2bb1fad29d47 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 946 time: 0.0841460
May 20 04:25:37.484219 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-b894a05f-7afb-4ec5-8665-a53bb0c864eb req-a6281631-e123-4423-997d-bdc33bcc0bbb tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0406373
May 20 04:25:37.666652 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-408e8c49-a9bd-44c2-8d93-ca327bb383f9 req-79baeae5-0c09-45ea-8e11-a3e1fc9ff6a1 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:37.668175 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-408e8c49-a9bd-44c2-8d93-ca327bb383f9 req-79baeae5-0c09-45ea-8e11-a3e1fc9ff6a1 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/networks?id=20ab5e30-591a-443a-9e34-f3a1b7563f5d HTTP/1.1" status: 200  len: 815 time: 0.1565163
May 20 04:25:37.689327 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-408e8c49-a9bd-44c2-8d93-ca327bb383f9 req-18d52870-4428-49dc-b0e7-65c29911eb78 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/quotas/6484c55ce8204dc3802efc929a51c4a5 HTTP/1.1" status: 200  len: 375 time: 0.0143881
May 20 04:25:37.800102 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-408e8c49-a9bd-44c2-8d93-ca327bb383f9 req-8308e388-088c-4d5c-a049-a97b71b507c4 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?tenant_id=6484c55ce8204dc3802efc929a51c4a5&fields=id HTTP/1.1" status: 200  len: 348 time: 0.1047461
May 20 04:25:37.886501 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-489d0b70-926d-4c0d-9503-2f4590523fde req-634a49f1-b5b5-4b85-9716-0ca04d21e1a0 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:37.888025 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-489d0b70-926d-4c0d-9503-2f4590523fde req-634a49f1-b5b5-4b85-9716-0ca04d21e1a0 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 945 time: 0.0954635
May 20 04:25:37.936118 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-489d0b70-926d-4c0d-9503-2f4590523fde req-5491e09c-9583-4898-8774-c233e9a99bfa tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/security-groups?id=34e473fa-df05-422b-9abc-99aed131bade&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0417261
May 20 04:25:37.946378 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-408e8c49-a9bd-44c2-8d93-ca327bb383f9 req-0bfecb44-f988-4f88-bfd2-67771774c334 service neutron] 10.222.0.71 "GET /v2.0/networks/20ab5e30-591a-443a-9e34-f3a1b7563f5d?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1386938
May 20 04:25:38.087762 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-408e8c49-a9bd-44c2-8d93-ca327bb383f9 req-3484961d-b983-4067-9d49-316701766f8a service neutron] 10.222.0.71 "GET /v2.0/networks/20ab5e30-591a-443a-9e34-f3a1b7563f5d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1351264
May 20 04:25:38.303738 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-fd718543-47d4-4e8f-9e94-3ad5e68a9189 req-e8439112-6a87-44f2-bef1-741aa66ae97e tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=738599b3-020d-4bc8-be0e-66c28772e5ca HTTP/1.1" status: 200  len: 210 time: 0.0439765
May 20 04:25:38.372397 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c89d656f-5c12-4535-ba50-f3b0dd7c7920 req-189b199d-1cb5-4cdf-9175-122a864448bb tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:38.373885 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-c89d656f-5c12-4535-ba50-f3b0dd7c7920 req-189b199d-1cb5-4cdf-9175-122a864448bb tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.0902619
May 20 04:25:38.425418 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-c89d656f-5c12-4535-ba50-f3b0dd7c7920 req-ba264f32-af3e-4947-9221-2bfa6f99c2b3 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0431731
May 20 04:25:38.690308 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c0b61e9-3f32-4315-888f-cbeb637153e8 req-ebc7736a-0412-4638-8740-067a33d786c2 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:38.691750 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-1c0b61e9-3f32-4315-888f-cbeb637153e8 req-ebc7736a-0412-4638-8740-067a33d786c2 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 946 time: 0.0890150
May 20 04:25:38.738939 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-1c0b61e9-3f32-4315-888f-cbeb637153e8 req-4e5cc7ce-9d5a-45a8-bf2a-46c570973760 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0411749
May 20 04:25:39.132481 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efcc5907-efa6-46b8-9f17-7e30932f3b41 req-18e53d4a-2c98-4393-9e38-2f44bad76113 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:39.133905 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-efcc5907-efa6-46b8-9f17-7e30932f3b41 req-18e53d4a-2c98-4393-9e38-2f44bad76113 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 945 time: 0.0865827
May 20 04:25:39.182250 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-efcc5907-efa6-46b8-9f17-7e30932f3b41 req-79bd767c-9e66-40ca-9bef-c41e3f54df8e tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/security-groups?id=34e473fa-df05-422b-9abc-99aed131bade&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0422997
May 20 04:25:39.473034 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-ebb40692-006d-42f8-b369-da1a630bcd40 req-aaddbaeb-4faf-4f0c-8b52-4f9cb8463afb tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=738599b3-020d-4bc8-be0e-66c28772e5ca HTTP/1.1" status: 200  len: 210 time: 0.0580249
May 20 04:25:39.660652 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-408e8c49-a9bd-44c2-8d93-ca327bb383f9 req-e3fa4faf-5413-4b05-9776-c5d31cb32d6b tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:39.662235 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-408e8c49-a9bd-44c2-8d93-ca327bb383f9 req-e3fa4faf-5413-4b05-9776-c5d31cb32d6b tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.82 "GET /v2.0/networks?id=20ab5e30-591a-443a-9e34-f3a1b7563f5d HTTP/1.1" status: 200  len: 815 time: 0.2240970
May 20 04:25:39.681960 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ead2492-eff5-4564-b11a-bc7f40e4572f req-58b05544-c4ae-4f97-876c-c5deacf82d0f tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:39.683407 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-5ead2492-eff5-4564-b11a-bc7f40e4572f req-58b05544-c4ae-4f97-876c-c5deacf82d0f tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.1349719
May 20 04:25:39.691825 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [req-408e8c49-a9bd-44c2-8d93-ca327bb383f9 req-525226ef-b912-4089-8a9f-b2a5f2c1c382 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Request body: {'port': {'device_id': '738599b3-020d-4bc8-be0e-66c28772e5ca', 'network_id': '20ab5e30-591a-443a-9e34-f3a1b7563f5d', 'admin_state_up': True, 'tenant_id': '6484c55ce8204dc3802efc929a51c4a5'}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:25:39.819071 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 115e1bac-cc4d-40b5-b860-798c85c78924 details requested by agent hyperv_hv-cinder-79091 with host hv-cinder-79091 {{(pid=91688) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 20 04:25:39.822748 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 9c846663-c90b-41d4-a8d1-1086882ba27e up at agent hyperv_hv-cinder-79091 {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:25:39.830913 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-5ead2492-eff5-4564-b11a-bc7f40e4572f req-1eb0f7e7-0284-419b-b9fb-dd17f0fd5be7 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1241820
May 20 04:25:39.864081 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [req-408e8c49-a9bd-44c2-8d93-ca327bb383f9 req-525226ef-b912-4089-8a9f-b2a5f2c1c382 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:25:39.884760 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [req-408e8c49-a9bd-44c2-8d93-ca327bb383f9 req-525226ef-b912-4089-8a9f-b2a5f2c1c382 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:25:39.900777 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-408e8c49-a9bd-44c2-8d93-ca327bb383f9 req-525226ef-b912-4089-8a9f-b2a5f2c1c382 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Made reservation on behalf of 6484c55ce8204dc3802efc929a51c4a5 for: {'port': 1} {{(pid=91687) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 04:25:39.906115 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-408e8c49-a9bd-44c2-8d93-ca327bb383f9 req-525226ef-b912-4089-8a9f-b2a5f2c1c382 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:39.985295 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81f7662a-30c7-4ec6-b231-2059895d9918 req-1e4b2c18-d6ea-4de5-a714-09f5f4428413 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:39.987630 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-81f7662a-30c7-4ec6-b231-2059895d9918 req-1e4b2c18-d6ea-4de5-a714-09f5f4428413 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 946 time: 0.1168814
May 20 04:25:40.025144 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Provisioning for port 9c846663-c90b-41d4-a8d1-1086882ba27e completed by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:25:40.045650 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-81f7662a-30c7-4ec6-b231-2059895d9918 req-5ba5f579-0601-472a-ba5b-2f8a6b9f10c7 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0516217
May 20 04:25:40.064050 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Provisioning complete for port 9c846663-c90b-41d4-a8d1-1086882ba27e triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:25:40.064666 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:40.096206 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.db_base_plugin_common [req-408e8c49-a9bd-44c2-8d93-ca327bb383f9 req-525226ef-b912-4089-8a9f-b2a5f2c1c382 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Allocated IP 172.20.0.14 (20ab5e30-591a-443a-9e34-f3a1b7563f5d/2a9c681d-a9be-4897-91bb-31aeb6432254/d51370ee-559c-4eaa-8242-891121de4717) {{(pid=91687) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 04:25:40.145616 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port 115e1bac-cc4d-40b5-b860-798c85c78924, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=115e1bac-cc4d-40b5-b860-798c85c78924,segment=NetworkSegment(9521f383-6017-4b4d-9f47-cff4ed54cb57),segment_id=9521f383-6017-4b4d-9f47-cff4ed54cb57)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:25:40.165003 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Returning: {'device': '115e1bac-cc4d-40b5-b860-798c85c78924', 'network_id': '21794e86-fda7-40a6-a5a8-db117c7eeb9d', 'port_id': '115e1bac-cc4d-40b5-b860-798c85c78924', 'mac_address': 'fa:16:3e:71:24:f2', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 864, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '06f38702-3d3c-4e25-8f84-85483d1ddf28', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91688) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 20 04:25:40.263840 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:40.297075 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:40.313319 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9c846663-c90b-41d4-a8d1-1086882ba27e'}] {{(pid=91688) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:25:40.328213 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port 9c846663-c90b-41d4-a8d1-1086882ba27e, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=9c846663-c90b-41d4-a8d1-1086882ba27e,segment=NetworkSegment(e5874c72-d111-4955-a5aa-fbad5f078a34),segment_id=e5874c72-d111-4955-a5aa-fbad5f078a34)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:25:40.330335 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.notifiers.nova [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 115e1bac-cc4d-40b5-b860-798c85c78924 {{(pid=91688) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 04:25:40.346547 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:40.351454 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-68b48814-8bc9-4aba-93fd-f82daf481a5e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:25:40.370858 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-408e8c49-a9bd-44c2-8d93-ca327bb383f9 req-525226ef-b912-4089-8a9f-b2a5f2c1c382 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Notify callbacks [] for port, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:40.399022 dv-cinder-790910-4-iscsi neutron-server[91688]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9c846663-c90b-41d4-a8d1-1086882ba27e', 'code': 200}
May 20 04:25:40.408120 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port 115e1bac-cc4d-40b5-b860-798c85c78924, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=115e1bac-cc4d-40b5-b860-798c85c78924,segment=NetworkSegment(9521f383-6017-4b4d-9f47-cff4ed54cb57),segment_id=9521f383-6017-4b4d-9f47-cff4ed54cb57)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:25:40.416843 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:40.437114 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72bfe6f2-d3d5-4e06-8570-09beff5ea30e req-83bcbacd-f855-4bd7-95e3-271dbef6eff5 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:40.438745 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-72bfe6f2-d3d5-4e06-8570-09beff5ea30e req-83bcbacd-f855-4bd7-95e3-271dbef6eff5 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 946 time: 0.1264083
May 20 04:25:40.440714 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Pushing event updated for resources: {'Port': ['ID=9c846663-c90b-41d4-a8d1-1086882ba27e,revision_number=5']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:25:40.443821 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:25:40.444285 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-a7f08e44-265b-4e1a-82e1-5cc49fc7642b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.023s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:25:40.466290 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-408e8c49-a9bd-44c2-8d93-ca327bb383f9 req-525226ef-b912-4089-8a9f-b2a5f2c1c382 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8782892106231', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4162192'] for port, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:40.475640 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-e62c3a91-bce1-4504-b173-2c2616255104 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:25:40.479572 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] get_ports_and_sgs() called for port_ids ['9a903ca5-2762-405a-81bb-5c3dce3d256a', 'c84df5e2-cd07-4d01-87c9-ec3a35e2ad93', '367f8cc3-bd5c-4497-8fc5-2b73175a0939'] {{(pid=91688) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 04:25:40.555791 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-408e8c49-a9bd-44c2-8d93-ca327bb383f9 req-525226ef-b912-4089-8a9f-b2a5f2c1c382 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Network 20ab5e30-591a-443a-9e34-f3a1b7563f5d is already hosted by enough agents. {{(pid=91687) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:25:40.561566 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.base_scheduler [req-408e8c49-a9bd-44c2-8d93-ca327bb383f9 req-525226ef-b912-4089-8a9f-b2a5f2c1c382 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Resources bound (agent type, host, resource id):  {{(pid=91687) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:25:40.567099 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.l3_dvrscheduler_db [req-408e8c49-a9bd-44c2-8d93-ca327bb383f9 req-525226ef-b912-4089-8a9f-b2a5f2c1c382 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Received port after_create {{(pid=91687) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 04:25:40.567339 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Pushing event updated for resources: {'Port': ['ID=115e1bac-cc4d-40b5-b860-798c85c78924,revision_number=6']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:25:40.571732 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.127s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:25:40.602464 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] get_ports_and_sgs() called for port_ids ['115e1bac-cc4d-40b5-b860-798c85c78924'] {{(pid=91688) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 04:25:40.612312 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-72bfe6f2-d3d5-4e06-8570-09beff5ea30e req-34f78bdb-0f02-49be-99b3-26c0f7e0e372 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/security-groups?id=34e473fa-df05-422b-9abc-99aed131bade&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1645317
May 20 04:25:40.612936 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-525226ef-b912-4089-8a9f-b2a5f2c1c382 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Pushing event updated for resources: {'Port': ['ID=d51370ee-559c-4eaa-8242-891121de4717,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:25:40.615901 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-525226ef-b912-4089-8a9f-b2a5f2c1c382 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.140s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:25:40.660714 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-408e8c49-a9bd-44c2-8d93-ca327bb383f9 req-525226ef-b912-4089-8a9f-b2a5f2c1c382 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:40.661506 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-408e8c49-a9bd-44c2-8d93-ca327bb383f9 req-525226ef-b912-4089-8a9f-b2a5f2c1c382 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for port, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:40.691416 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-408e8c49-a9bd-44c2-8d93-ca327bb383f9 req-525226ef-b912-4089-8a9f-b2a5f2c1c382 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 1.0038340
May 20 04:25:40.714231 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [req-408e8c49-a9bd-44c2-8d93-ca327bb383f9 req-ab525840-f3af-42be-8a2f-9c13348fae0f service neutron] Request body: {'port': {'device_id': '738599b3-020d-4bc8-be0e-66c28772e5ca', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79091'}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:25:40.716698 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32c78eda-b0b9-4a25-b4fa-ebd73b64f869 req-c3b82dfb-2eee-4c92-874d-92652678a9fb tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:40.718539 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-32c78eda-b0b9-4a25-b4fa-ebd73b64f869 req-c3b82dfb-2eee-4c92-874d-92652678a9fb tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=738599b3-020d-4bc8-be0e-66c28772e5ca HTTP/1.1" status: 200  len: 932 time: 0.1114581
May 20 04:25:40.768906 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-32c78eda-b0b9-4a25-b4fa-ebd73b64f869 req-8a83a8a7-7da8-455f-8d0f-94eb4f436f08 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0426049
May 20 04:25:40.974479 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-408e8c49-a9bd-44c2-8d93-ca327bb383f9 req-ab525840-f3af-42be-8a2f-9c13348fae0f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:41.043877 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1684b5c7-4ff9-4ae2-a240-dd308a707ae2 req-d795c74f-9238-4b7b-b126-45b5f49c7b19 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:41.045363 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-1684b5c7-4ff9-4ae2-a240-dd308a707ae2 req-d795c74f-9238-4b7b-b126-45b5f49c7b19 service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 1099 time: 0.3010013
May 20 04:25:41.163894 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-1684b5c7-4ff9-4ae2-a240-dd308a707ae2 req-16a41b06-55f1-40ab-bb18-673b6b500820 service neutron] 10.222.0.82 "GET /v2.0/security-groups?id=34e473fa-df05-422b-9abc-99aed131bade&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0919869
May 20 04:25:41.244854 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bbf5b05-1b1c-434c-bd70-e40a9bbc7588 req-b07e9134-12c6-4aad-84e6-dd79a84db0b9 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:41.246371 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-5bbf5b05-1b1c-434c-bd70-e40a9bbc7588 req-b07e9134-12c6-4aad-84e6-dd79a84db0b9 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.2598917
May 20 04:25:41.294428 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eff9f128-118b-4f82-aab9-65d0aea50c51 req-76d33a58-955f-44b3-a6e7-1bbe447aa495 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:41.296381 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-eff9f128-118b-4f82-aab9-65d0aea50c51 req-76d33a58-955f-44b3-a6e7-1bbe447aa495 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 945 time: 0.0908422
May 20 04:25:41.354611 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-eff9f128-118b-4f82-aab9-65d0aea50c51 req-fb1d42e3-290b-4f27-9843-98cf8c01c4e3 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0484626
May 20 04:25:41.384799 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-5bbf5b05-1b1c-434c-bd70-e40a9bbc7588 req-6257d227-13d6-4d8e-8a49-abd968f7cc80 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1307821
May 20 04:25:41.503354 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.notifiers.nova [req-408e8c49-a9bd-44c2-8d93-ca327bb383f9 req-ab525840-f3af-42be-8a2f-9c13348fae0f service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d51370ee-559c-4eaa-8242-891121de4717 {{(pid=91687) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 04:25:41.511013 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-408e8c49-a9bd-44c2-8d93-ca327bb383f9 req-ab525840-f3af-42be-8a2f-9c13348fae0f service neutron] Notify callbacks [] for port, precommit_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:41.525476 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.provisioning_blocks [req-408e8c49-a9bd-44c2-8d93-ca327bb383f9 req-ab525840-f3af-42be-8a2f-9c13348fae0f service neutron] Transition to ACTIVE for port object d51370ee-559c-4eaa-8242-891121de4717 will not be triggered until provisioned by entity L2. {{(pid=91687) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:25:41.530678 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-408e8c49-a9bd-44c2-8d93-ca327bb383f9 req-ab525840-f3af-42be-8a2f-9c13348fae0f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4162185'] for port, after_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:41.534461 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-a5eec27f-4f55-4b60-92aa-299802a3c9f8 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:25:41.686404 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab525840-f3af-42be-8a2f-9c13348fae0f service neutron] Pushing event updated for resources: {'Port': ['ID=d51370ee-559c-4eaa-8242-891121de4717,revision_number=2']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:25:41.696282 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-ab525840-f3af-42be-8a2f-9c13348fae0f service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.160s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:25:41.768889 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.managers [req-408e8c49-a9bd-44c2-8d93-ca327bb383f9 req-ab525840-f3af-42be-8a2f-9c13348fae0f service neutron] Attempting to bind port d51370ee-559c-4eaa-8242-891121de4717 on host hv-cinder-79091 for vnic_type normal with profile  {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 04:25:41.769219 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.managers [req-408e8c49-a9bd-44c2-8d93-ca327bb383f9 req-ab525840-f3af-42be-8a2f-9c13348fae0f service neutron] Attempting to bind port d51370ee-559c-4eaa-8242-891121de4717 by drivers openvswitch,hyperv on host hv-cinder-79091 at level 0 using segments [{'id': '0ad1d987-000a-4092-8d15-811f90922b00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': '20ab5e30-591a-443a-9e34-f3a1b7563f5d'}] {{(pid=91687) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 04:25:41.769548 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-408e8c49-a9bd-44c2-8d93-ca327bb383f9 req-ab525840-f3af-42be-8a2f-9c13348fae0f service neutron] Attempting to bind port d51370ee-559c-4eaa-8242-891121de4717 on network 20ab5e30-591a-443a-9e34-f3a1b7563f5d {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:25:41.774231 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-408e8c49-a9bd-44c2-8d93-ca327bb383f9 req-ab525840-f3af-42be-8a2f-9c13348fae0f service neutron] Port d51370ee-559c-4eaa-8242-891121de4717 on network 20ab5e30-591a-443a-9e34-f3a1b7563f5d not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79091 {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 20 04:25:41.774520 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-408e8c49-a9bd-44c2-8d93-ca327bb383f9 req-ab525840-f3af-42be-8a2f-9c13348fae0f service neutron] Attempting to bind port d51370ee-559c-4eaa-8242-891121de4717 on network 20ab5e30-591a-443a-9e34-f3a1b7563f5d {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:25:41.780619 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-408e8c49-a9bd-44c2-8d93-ca327bb383f9 req-ab525840-f3af-42be-8a2f-9c13348fae0f service neutron] Checking agent: {'id': '7cc947fd-92eb-4d43-ad6b-ea002afff217', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79091', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 4, 19, 34), 'started_at': datetime.datetime(2021, 5, 20, 4, 19, 34), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 4, 25, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 04:25:41.780974 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-408e8c49-a9bd-44c2-8d93-ca327bb383f9 req-ab525840-f3af-42be-8a2f-9c13348fae0f service neutron] Checking segment: {'id': '0ad1d987-000a-4092-8d15-811f90922b00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': '20ab5e30-591a-443a-9e34-f3a1b7563f5d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91687) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:25:41.781542 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-408e8c49-a9bd-44c2-8d93-ca327bb383f9 req-ab525840-f3af-42be-8a2f-9c13348fae0f service neutron] Bound using segment: {'id': '0ad1d987-000a-4092-8d15-811f90922b00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': '20ab5e30-591a-443a-9e34-f3a1b7563f5d'} {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 04:25:41.781967 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.managers [req-408e8c49-a9bd-44c2-8d93-ca327bb383f9 req-ab525840-f3af-42be-8a2f-9c13348fae0f service neutron] Bound port: d51370ee-559c-4eaa-8242-891121de4717, host: hv-cinder-79091, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '0ad1d987-000a-4092-8d15-811f90922b00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': '20ab5e30-591a-443a-9e34-f3a1b7563f5d'}}] {{(pid=91687) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 04:25:41.782311 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-408e8c49-a9bd-44c2-8d93-ca327bb383f9 req-ab525840-f3af-42be-8a2f-9c13348fae0f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:41.827383 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98fd2511-d8be-4d35-9df4-3faf4e57c8a6 req-d2e79d34-22ed-4d9e-9eed-083feb101efe tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:41.829093 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-98fd2511-d8be-4d35-9df4-3faf4e57c8a6 req-d2e79d34-22ed-4d9e-9eed-083feb101efe tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 946 time: 0.0900638
May 20 04:25:41.844004 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 115e1bac-cc4d-40b5-b860-798c85c78924 up at agent hyperv_hv-cinder-79091 {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:25:41.878968 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-98fd2511-d8be-4d35-9df4-3faf4e57c8a6 req-118383f3-ee4d-4217-8e2d-bf75fc88b0bb tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/security-groups?id=34e473fa-df05-422b-9abc-99aed131bade&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0422478
May 20 04:25:41.883924 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [req-408e8c49-a9bd-44c2-8d93-ca327bb383f9 req-ab525840-f3af-42be-8a2f-9c13348fae0f service neutron] For port d51370ee-559c-4eaa-8242-891121de4717, host hv-cinder-79091, cleared binding levels {{(pid=91687) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 04:25:41.887486 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [req-408e8c49-a9bd-44c2-8d93-ca327bb383f9 req-ab525840-f3af-42be-8a2f-9c13348fae0f service neutron] For port d51370ee-559c-4eaa-8242-891121de4717, host hv-cinder-79091, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=d51370ee-559c-4eaa-8242-891121de4717,segment=NetworkSegment(0ad1d987-000a-4092-8d15-811f90922b00),segment_id=0ad1d987-000a-4092-8d15-811f90922b00)] {{(pid=91687) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 04:25:41.896179 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-408e8c49-a9bd-44c2-8d93-ca327bb383f9 req-ab525840-f3af-42be-8a2f-9c13348fae0f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4162185'] for port, after_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:41.901941 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-b0e22059-8581-460a-836d-a318ac70481c service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:25:41.940683 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Provisioning complete for port 115e1bac-cc4d-40b5-b860-798c85c78924 triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:25:41.941025 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:42.007106 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-408e8c49-a9bd-44c2-8d93-ca327bb383f9 req-ab525840-f3af-42be-8a2f-9c13348fae0f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:42.007699 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-408e8c49-a9bd-44c2-8d93-ca327bb383f9 req-ab525840-f3af-42be-8a2f-9c13348fae0f service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for port, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:42.009074 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-408e8c49-a9bd-44c2-8d93-ca327bb383f9 req-ab525840-f3af-42be-8a2f-9c13348fae0f service neutron] 10.222.0.82 "PUT /v2.0/ports/d51370ee-559c-4eaa-8242-891121de4717 HTTP/1.1" status: 200  len: 1094 time: 1.2998693
May 20 04:25:42.011082 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '738599b3-020d-4bc8-be0e-66c28772e5ca', 'tag': 'd51370ee-559c-4eaa-8242-891121de4717'}] {{(pid=91687) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:25:42.043833 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab525840-f3af-42be-8a2f-9c13348fae0f service neutron] Pushing event updated for resources: {'Port': ['ID=d51370ee-559c-4eaa-8242-891121de4717,revision_number=3']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:25:42.054705 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-ab525840-f3af-42be-8a2f-9c13348fae0f service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.154s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:25:42.076555 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:42.106073 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '738599b3-020d-4bc8-be0e-66c28772e5ca', 'tag': 'd51370ee-559c-4eaa-8242-891121de4717', 'status': 'completed', 'code': 200}
May 20 04:25:42.120995 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port 115e1bac-cc4d-40b5-b860-798c85c78924, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=115e1bac-cc4d-40b5-b860-798c85c78924,segment=NetworkSegment(9521f383-6017-4b4d-9f47-cff4ed54cb57),segment_id=9521f383-6017-4b4d-9f47-cff4ed54cb57)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:25:42.129894 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:42.132714 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:25:42.134405 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef30cca6-26bc-437e-bec3-6d76bc9ff66d req-c34203c0-dc09-4ac9-aecc-746d85fa1ad8 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:42.135014 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-ef30cca6-26bc-437e-bec3-6d76bc9ff66d req-c34203c0-dc09-4ac9-aecc-746d85fa1ad8 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Synchronizing usage tracker for tenant:6484c55ce8204dc3802efc929a51c4a5 on resource:port {{(pid=91687) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:25:42.164773 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-ef30cca6-26bc-437e-bec3-6d76bc9ff66d req-c34203c0-dc09-4ac9-aecc-746d85fa1ad8 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Unset dirty status for tenant:6484c55ce8204dc3802efc929a51c4a5 on resource:port {{(pid=91687) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:25:42.172022 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-ef30cca6-26bc-437e-bec3-6d76bc9ff66d req-c34203c0-dc09-4ac9-aecc-746d85fa1ad8 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=738599b3-020d-4bc8-be0e-66c28772e5ca HTTP/1.1" status: 200  len: 944 time: 0.2368765
May 20 04:25:42.218243 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-408e8c49-a9bd-44c2-8d93-ca327bb383f9 req-ce60dc2b-8154-4860-ac44-1940ba0181ab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:42.219894 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-408e8c49-a9bd-44c2-8d93-ca327bb383f9 req-ce60dc2b-8154-4860-ac44-1940ba0181ab service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=6484c55ce8204dc3802efc929a51c4a5&device_id=738599b3-020d-4bc8-be0e-66c28772e5ca HTTP/1.1" status: 200  len: 1097 time: 0.1526468
May 20 04:25:42.227587 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-ef30cca6-26bc-437e-bec3-6d76bc9ff66d req-01a7c63f-eb03-4dc7-9be7-a0bb88e5a82f tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0547998
May 20 04:25:42.247066 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Pushing event updated for resources: {'Port': ['ID=115e1bac-cc4d-40b5-b860-798c85c78924,revision_number=7']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:25:42.250568 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:25:42.311043 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-408e8c49-a9bd-44c2-8d93-ca327bb383f9 req-05225076-698d-47f5-8e3f-6b2458049263 service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=d51370ee-559c-4eaa-8242-891121de4717 HTTP/1.1" status: 200  len: 217 time: 0.0725346
May 20 04:25:42.377984 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-408e8c49-a9bd-44c2-8d93-ca327bb383f9 req-8e89f50d-7557-49b0-947e-c9fc3a339c90 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:42.379350 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-408e8c49-a9bd-44c2-8d93-ca327bb383f9 req-8e89f50d-7557-49b0-947e-c9fc3a339c90 service neutron] 10.222.0.82 "GET /v2.0/subnets?id=2a9c681d-a9be-4897-91bb-31aeb6432254 HTTP/1.1" status: 200  len: 855 time: 0.0615954
May 20 04:25:42.400554 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f32b55e5-d82f-4c9e-a67f-08d83c24cf4d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '115e1bac-cc4d-40b5-b860-798c85c78924'}] {{(pid=91688) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:25:42.432020 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-408e8c49-a9bd-44c2-8d93-ca327bb383f9 req-71bf4b49-8c0e-49b2-9bc0-889169dedd0c service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=20ab5e30-591a-443a-9e34-f3a1b7563f5d&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0429122
May 20 04:25:42.457843 dv-cinder-790910-4-iscsi neutron-server[91688]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f32b55e5-d82f-4c9e-a67f-08d83c24cf4d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '115e1bac-cc4d-40b5-b860-798c85c78924', 'code': 200}
May 20 04:25:42.583731 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6463efd9-4c15-402d-823c-03e0d44913a4 req-e9296e54-5535-4a07-a50f-29a969992f82 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:42.585463 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-6463efd9-4c15-402d-823c-03e0d44913a4 req-e9296e54-5535-4a07-a50f-29a969992f82 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 946 time: 0.0918977
May 20 04:25:42.635026 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-6463efd9-4c15-402d-823c-03e0d44913a4 req-487acacf-ef10-412a-a0f0-8a17f2b10eb1 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0423501
May 20 04:25:42.682433 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-408e8c49-a9bd-44c2-8d93-ca327bb383f9 req-14211f51-0a6a-4d39-8f9b-97cf6a293ee0 service neutron] 10.222.0.82 "GET /v2.0/networks/20ab5e30-591a-443a-9e34-f3a1b7563f5d?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2373788
May 20 04:25:42.823177 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa0c8207-6db9-4d63-a110-6c6411354305 req-9b3e093f-26e6-4c82-a1fb-6fa0dac515d3 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:42.824664 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-fa0c8207-6db9-4d63-a110-6c6411354305 req-9b3e093f-26e6-4c82-a1fb-6fa0dac515d3 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.2482326
May 20 04:25:42.938998 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-fa0c8207-6db9-4d63-a110-6c6411354305 req-c95f59f1-3d8d-43e8-87f3-abd86e560bca tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1076243
May 20 04:25:42.961373 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-408e8c49-a9bd-44c2-8d93-ca327bb383f9 req-4d522e9c-1a2d-476c-a066-88fdd0ba99e0 service neutron] 10.222.0.82 "GET /v2.0/networks/20ab5e30-591a-443a-9e34-f3a1b7563f5d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2643280
May 20 04:25:43.125198 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b20b0a51-cd8e-4c52-acff-e31d8a7ab049 req-7c2f83b5-86ad-4e9b-8841-bd73ee5cb97a tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:43.128607 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-b20b0a51-cd8e-4c52-acff-e31d8a7ab049 req-7c2f83b5-86ad-4e9b-8841-bd73ee5cb97a tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 946 time: 0.1288280
May 20 04:25:43.167405 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b73364e-67a1-4f3b-b954-b74a56b85521 req-9928a755-c7e8-4e6e-85fd-980c7078f4c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:43.168779 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-7b73364e-67a1-4f3b-b954-b74a56b85521 req-9928a755-c7e8-4e6e-85fd-980c7078f4c1 service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=6484c55ce8204dc3802efc929a51c4a5&device_id=738599b3-020d-4bc8-be0e-66c28772e5ca HTTP/1.1" status: 200  len: 1097 time: 0.0882432
May 20 04:25:43.179962 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-b20b0a51-cd8e-4c52-acff-e31d8a7ab049 req-5631fe7a-39fb-4212-a76c-d1faea06b074 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/security-groups?id=34e473fa-df05-422b-9abc-99aed131bade&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0443523
May 20 04:25:43.342763 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b73364e-67a1-4f3b-b954-b74a56b85521 req-e20c47b9-3618-4380-a307-c157b076281c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:43.344633 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-7b73364e-67a1-4f3b-b954-b74a56b85521 req-e20c47b9-3618-4380-a307-c157b076281c service neutron] 10.222.0.82 "GET /v2.0/networks?id=20ab5e30-591a-443a-9e34-f3a1b7563f5d HTTP/1.1" status: 200  len: 916 time: 0.1617165
May 20 04:25:43.458803 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-7b73364e-67a1-4f3b-b954-b74a56b85521 req-06df4874-89d1-4f2d-99d5-d7292de53bce service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=d51370ee-559c-4eaa-8242-891121de4717 HTTP/1.1" status: 200  len: 217 time: 0.1040506
May 20 04:25:43.542790 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b73364e-67a1-4f3b-b954-b74a56b85521 req-ab299e22-5b9a-4758-a735-c5086a2dbbd8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:43.544273 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-7b73364e-67a1-4f3b-b954-b74a56b85521 req-ab299e22-5b9a-4758-a735-c5086a2dbbd8 service neutron] 10.222.0.82 "GET /v2.0/subnets?id=2a9c681d-a9be-4897-91bb-31aeb6432254 HTTP/1.1" status: 200  len: 855 time: 0.0757008
May 20 04:25:43.557209 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfde1a3d-aa32-45d8-9156-eda0cd8e29bb req-8d827f30-3724-46f6-ae10-c3873709cb70 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:43.558735 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-dfde1a3d-aa32-45d8-9156-eda0cd8e29bb req-8d827f30-3724-46f6-ae10-c3873709cb70 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=738599b3-020d-4bc8-be0e-66c28772e5ca HTTP/1.1" status: 200  len: 944 time: 0.2061360
May 20 04:25:43.615810 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-7b73364e-67a1-4f3b-b954-b74a56b85521 req-b0e3aa42-d93a-4c82-80cb-47d4d93ebd09 service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=20ab5e30-591a-443a-9e34-f3a1b7563f5d&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0554965
May 20 04:25:43.678289 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-dfde1a3d-aa32-45d8-9156-eda0cd8e29bb req-82a44b6b-5f35-432a-8695-d69b70cc8c5b tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0878766
May 20 04:25:43.799111 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-7b73364e-67a1-4f3b-b954-b74a56b85521 req-82b32bc5-a31b-47c5-9dca-6870cdcf33b9 service neutron] 10.222.0.82 "GET /v2.0/networks/20ab5e30-591a-443a-9e34-f3a1b7563f5d?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1688972
May 20 04:25:43.851412 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5defc919-9969-4f4e-86cb-aa00491a927a req-58b87eb2-aa6d-47f1-95f1-e0a7f4ac88a0 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:43.852997 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-5defc919-9969-4f4e-86cb-aa00491a927a req-58b87eb2-aa6d-47f1-95f1-e0a7f4ac88a0 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 946 time: 0.0932016
May 20 04:25:43.908924 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-5defc919-9969-4f4e-86cb-aa00491a927a req-d831486a-de6a-4cf9-81ba-7b9dbcf21b3a tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0494592
May 20 04:25:43.960609 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-7b73364e-67a1-4f3b-b954-b74a56b85521 req-94008f40-0d38-4650-bca6-38a1d13885cd service neutron] 10.222.0.82 "GET /v2.0/networks/20ab5e30-591a-443a-9e34-f3a1b7563f5d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1511180
May 20 04:25:44.152534 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b7bd00a-899e-4211-aba8-fe693f139057 req-0cfb4e50-a03d-493e-8bb2-1a941676219d tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:44.154264 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-5b7bd00a-899e-4211-aba8-fe693f139057 req-0cfb4e50-a03d-493e-8bb2-1a941676219d tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.0851867
May 20 04:25:44.202327 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-5b7bd00a-899e-4211-aba8-fe693f139057 req-96a0a5b5-fd7b-47ac-9f6e-e6e0bcb485bc tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0407863
May 20 04:25:44.375987 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc983cbf-c10f-4acd-8db7-b395efc0ff71 req-b8311914-627f-4be6-aab7-9df3761dde37 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:44.377627 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-bc983cbf-c10f-4acd-8db7-b395efc0ff71 req-b8311914-627f-4be6-aab7-9df3761dde37 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 946 time: 0.0852966
May 20 04:25:44.425365 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-bc983cbf-c10f-4acd-8db7-b395efc0ff71 req-11f81a8a-32de-4f90-9e7b-3f3939a7e61a tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/security-groups?id=34e473fa-df05-422b-9abc-99aed131bade&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0414748
May 20 04:25:44.611826 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d552811f-e822-4300-85a7-1ca9d643b3e5 req-b2658df2-fd3c-4c1f-8d09-c544894fb475 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:44.613333 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-d552811f-e822-4300-85a7-1ca9d643b3e5 req-b2658df2-fd3c-4c1f-8d09-c544894fb475 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 946 time: 0.0843222
May 20 04:25:44.661677 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-d552811f-e822-4300-85a7-1ca9d643b3e5 req-8ce25425-0bd6-4235-8794-3e3220edd4ea tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/security-groups?id=34e473fa-df05-422b-9abc-99aed131bade&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0422769
May 20 04:25:44.689550 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 41510) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:25:45.023802 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-457ad854-a147-4f5d-b330-37545652f9c0 req-420b2604-7826-49c7-90db-bd879fb11531 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:45.025245 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-457ad854-a147-4f5d-b330-37545652f9c0 req-420b2604-7826-49c7-90db-bd879fb11531 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=738599b3-020d-4bc8-be0e-66c28772e5ca HTTP/1.1" status: 200  len: 944 time: 0.2231829
May 20 04:25:45.053372 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-92d3ce29-2498-4cf0-95c0-0e027149f97b tempest-TestShelveInstance-92892585 tempest-TestShelveInstance-92892585-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:45.054078 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-92d3ce29-2498-4cf0-95c0-0e027149f97b tempest-TestShelveInstance-92892585 tempest-TestShelveInstance-92892585-project-admin] Synchronizing usage tracker for tenant:4bcdcc410bb7407eb15e956f1cf3816f on resource:port {{(pid=91686) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:25:45.096632 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-457ad854-a147-4f5d-b330-37545652f9c0 req-e06d8075-b7c5-401a-bf61-185a75d7f4dd tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0648859
May 20 04:25:45.097734 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-92d3ce29-2498-4cf0-95c0-0e027149f97b tempest-TestShelveInstance-92892585 tempest-TestShelveInstance-92892585-project-admin] Unset dirty status for tenant:4bcdcc410bb7407eb15e956f1cf3816f on resource:port {{(pid=91686) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:25:45.099956 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-92d3ce29-2498-4cf0-95c0-0e027149f97b tempest-TestShelveInstance-92892585 tempest-TestShelveInstance-92892585-project-admin] 10.222.0.71 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 1094 time: 0.4079707
May 20 04:25:45.101992 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 41520) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:25:45.107536 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.v2.base [None req-09871fe5-a064-470b-975b-e10431460f4f tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Request body: {'floatingip': {'floating_network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'port_id': '9c846663-c90b-41d4-a8d1-1086882ba27e', 'tenant_id': 'a1319e4a0fc74f98ba4bb88d8a04086b', 'fixed_ip_address': '172.20.0.13'}} {{(pid=91686) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:25:45.113239 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-073af845-ab6c-4931-88ba-6d7365313875 req-60276623-268c-4df4-b967-76c33bd7f817 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:45.117603 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-09871fe5-a064-470b-975b-e10431460f4f tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:25:45.117797 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-073af845-ab6c-4931-88ba-6d7365313875 req-60276623-268c-4df4-b967-76c33bd7f817 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 946 time: 0.0874510
May 20 04:25:45.124930 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-09871fe5-a064-470b-975b-e10431460f4f tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Usage tracker for resource:floatingip and tenant:a1319e4a0fc74f98ba4bb88d8a04086b is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:25:45.127894 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-09871fe5-a064-470b-975b-e10431460f4f tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:25:45.134238 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-09871fe5-a064-470b-975b-e10431460f4f tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:25:45.145205 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-09871fe5-a064-470b-975b-e10431460f4f tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Notify callbacks [] for floatingip, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:45.162806 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-073af845-ab6c-4931-88ba-6d7365313875 req-3f31a222-e304-476c-b635-92f7e286256d tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0413549
May 20 04:25:45.297060 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-09871fe5-a064-470b-975b-e10431460f4f tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:45.443221 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8acdc8a9-cc1f-460f-87cd-1daee663ece9 req-bf08c356-cc7e-4482-9be8-1ec264aa2a10 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:45.444985 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-8acdc8a9-cc1f-460f-87cd-1daee663ece9 req-bf08c356-cc7e-4482-9be8-1ec264aa2a10 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.82 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.1088989
May 20 04:25:45.516993 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1580fa2-03ce-4813-baf4-25adc7dad779 req-2c49bec2-51da-4a6f-a642-9adf9dae0534 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:45.518543 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-e1580fa2-03ce-4813-baf4-25adc7dad779 req-2c49bec2-51da-4a6f-a642-9adf9dae0534 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 945 time: 0.1806357
May 20 04:25:45.519800 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.db_base_plugin_common [None req-09871fe5-a064-470b-975b-e10431460f4f tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Allocated IP 172.27.1.154 (aec557db-0c02-4008-8c9f-2efcd7462f90/217f4b55-4415-4d57-8b43-2ff4c8ac8e81/27ae22f3-8866-4345-b3d1-45c6d78ab856) {{(pid=91686) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 04:25:45.615794 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [req-8acdc8a9-cc1f-460f-87cd-1daee663ece9 req-849677f9-8984-4111-b111-891d7858294a tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Deleting port 65d523e1-f132-4819-aa42-995ded4a1ad8 {{(pid=91687) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 04:25:45.616400 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-8acdc8a9-cc1f-460f-87cd-1daee663ece9 req-849677f9-8984-4111-b111-891d7858294a tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8782892520551'] for port, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:45.657885 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-e1580fa2-03ce-4813-baf4-25adc7dad779 req-8f666e93-4245-4b27-852b-2564d3f45c7c tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/security-groups?id=8cbf810a-7c03-41fd-8b60-12a4f73202de&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1276550
May 20 04:25:45.719949 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-09871fe5-a064-470b-975b-e10431460f4f tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Notify callbacks [] for port, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:45.758629 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-09871fe5-a064-470b-975b-e10431460f4f tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8782892106231', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2145052'] for port, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:45.760423 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [req-8acdc8a9-cc1f-460f-87cd-1daee663ece9 req-849677f9-8984-4111-b111-891d7858294a tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] For port 65d523e1-f132-4819-aa42-995ded4a1ad8, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=65d523e1-f132-4819-aa42-995ded4a1ad8,segment=NetworkSegment(9d2ee761-256d-4e66-82a3-ef6e5bd352c1),segment_id=9d2ee761-256d-4e66-82a3-ef6e5bd352c1)] {{(pid=91687) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:25:45.760816 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-8acdc8a9-cc1f-460f-87cd-1daee663ece9 req-849677f9-8984-4111-b111-891d7858294a tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1718922'] for port, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:45.763817 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-f44c4d83-2f82-44be-8d25-edfdd61c6646 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:25:45.830741 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-09871fe5-a064-470b-975b-e10431460f4f tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Network aec557db-0c02-4008-8c9f-2efcd7462f90 is already hosted by enough agents. {{(pid=91686) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:25:45.834051 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.base_scheduler [None req-09871fe5-a064-470b-975b-e10431460f4f tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Resources bound (agent type, host, resource id):  {{(pid=91686) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:25:45.837352 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.l3_dvrscheduler_db [None req-09871fe5-a064-470b-975b-e10431460f4f tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Received port after_create {{(pid=91686) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 04:25:45.893600 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09871fe5-a064-470b-975b-e10431460f4f tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Pushing event updated for resources: {'Port': ['ID=27ae22f3-8866-4345-b3d1-45c6d78ab856,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:25:45.896460 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-09871fe5-a064-470b-975b-e10431460f4f tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.133s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:25:45.964580 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [req-8acdc8a9-cc1f-460f-87cd-1daee663ece9 req-849677f9-8984-4111-b111-891d7858294a tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Calling delete_port for 65d523e1-f132-4819-aa42-995ded4a1ad8 owned by compute:nova {{(pid=91687) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 04:25:46.119864 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-8acdc8a9-cc1f-460f-87cd-1daee663ece9 req-849677f9-8984-4111-b111-891d7858294a tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8782892522936', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8782892108804', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4162192'] for port, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:46.131986 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:25:46.211759 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-849677f9-8984-4111-b111-891d7858294a tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Pushing event deleted for resources: {'Port': ['ID=65d523e1-f132-4819-aa42-995ded4a1ad8,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:25:46.221003 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-849677f9-8984-4111-b111-891d7858294a tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:25:46.302369 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.l3_dvrscheduler_db [req-8acdc8a9-cc1f-460f-87cd-1daee663ece9 req-849677f9-8984-4111-b111-891d7858294a tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] No DVR routers for this DVR port 65d523e1-f132-4819-aa42-995ded4a1ad8 on host hv-cinder-79091 {{(pid=91687) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 04:25:46.309820 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-8acdc8a9-cc1f-460f-87cd-1daee663ece9 req-849677f9-8984-4111-b111-891d7858294a tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for port, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:46.318290 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7fb31908-b5c9-44dd-ab7c-bb06a577e1c8', 'name': 'network-vif-deleted', 'tag': '65d523e1-f132-4819-aa42-995ded4a1ad8'}] {{(pid=91687) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:25:46.343878 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-8acdc8a9-cc1f-460f-87cd-1daee663ece9 req-849677f9-8984-4111-b111-891d7858294a tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.82 "DELETE /v2.0/ports/65d523e1-f132-4819-aa42-995ded4a1ad8 HTTP/1.1" status: 204  len: 173 time: 0.8871415
May 20 04:25:46.372433 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1490882-b397-4241-b311-aee388a746c9 req-620f588c-adc2-44f7-af44-0649fbc96f25 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:46.374155 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-b1490882-b397-4241-b311-aee388a746c9 req-620f588c-adc2-44f7-af44-0649fbc96f25 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=738599b3-020d-4bc8-be0e-66c28772e5ca HTTP/1.1" status: 200  len: 944 time: 0.1222639
May 20 04:25:46.455640 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-b1490882-b397-4241-b311-aee388a746c9 req-e97a83eb-58c4-4b49-af36-1936bfbf4a04 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0722890
May 20 04:25:46.477101 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbdb5d41-2db2-4f56-afcd-61fe47d5f2f0 req-da849f5e-ba44-442b-89f9-770e5bbe0d29 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:46.480207 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-dbdb5d41-2db2-4f56-afcd-61fe47d5f2f0 req-da849f5e-ba44-442b-89f9-770e5bbe0d29 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 946 time: 0.1613350
May 20 04:25:46.526570 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7fb31908-b5c9-44dd-ab7c-bb06a577e1c8', 'name': 'network-vif-deleted', 'tag': '65d523e1-f132-4819-aa42-995ded4a1ad8', 'status': 'completed', 'code': 200}
May 20 04:25:46.533327 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-09871fe5-a064-470b-975b-e10431460f4f tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Notify callbacks [] for floatingip, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:46.605168 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-dbdb5d41-2db2-4f56-afcd-61fe47d5f2f0 req-9fbed2d4-4162-4d2c-9dc2-b0ae4a1ff30e tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1110582
May 20 04:25:46.718864 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-09871fe5-a064-470b-975b-e10431460f4f tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:46.873960 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-8e02e678-1598-4a51-9781-16422ffb66a2 req-afb6e938-90f5-447a-ba1a-fe427b683b29 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Synchronizing usage tracker for tenant:b7d86d894a5f420e86f4c28d7772bd22 on resource:port {{(pid=91687) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:25:46.916109 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-8e02e678-1598-4a51-9781-16422ffb66a2 req-afb6e938-90f5-447a-ba1a-fe427b683b29 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Unset dirty status for tenant:b7d86d894a5f420e86f4c28d7772bd22 on resource:port {{(pid=91687) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:25:46.917823 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-8e02e678-1598-4a51-9781-16422ffb66a2 req-afb6e938-90f5-447a-ba1a-fe427b683b29 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] 10.222.0.71 "GET /v2.0/ports?device_id=7fb31908-b5c9-44dd-ab7c-bb06a577e1c8 HTTP/1.1" status: 200  len: 210 time: 0.1186016
May 20 04:25:46.999102 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-09871fe5-a064-470b-975b-e10431460f4f tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Notify callbacks [] for port, precommit_update {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:47.005137 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-09871fe5-a064-470b-975b-e10431460f4f tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2145029'] for port, after_update {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:47.009336 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-0be043de-d532-41b2-935d-7b5c73f44b64 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:25:47.238334 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09871fe5-a064-470b-975b-e10431460f4f tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Pushing event updated for resources: {'Port': ['ID=27ae22f3-8866-4345-b3d1-45c6d78ab856,revision_number=2']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:25:47.242826 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-09871fe5-a064-470b-975b-e10431460f4f tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.233s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:25:47.262802 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-09871fe5-a064-470b-975b-e10431460f4f tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1716406'] for floatingip, after_update {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:47.579057 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.db.l3_db [None req-09871fe5-a064-470b-975b-e10431460f4f tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Floating IP e653a34a-b881-4576-9118-d5b4aa3d0533 associated. External IP: 172.27.1.154, port: 9c846663-c90b-41d4-a8d1-1086882ba27e.
May 20 04:25:47.852638 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device d51370ee-559c-4eaa-8242-891121de4717 details requested by agent hyperv_hv-cinder-79091 with host hv-cinder-79091 {{(pid=91688) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 20 04:25:47.855723 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 65d523e1-f132-4819-aa42-995ded4a1ad8 no longer exists at agent hyperv_hv-cinder-79091 {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 04:25:47.926417 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] No Port match for: 65d523e1-f132-4819-aa42-995ded4a1ad8 {{(pid=91688) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 04:25:47.927344 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 65d523e1-f132-4819-aa42-995ded4a1ad8 not bound to the agent host hv-cinder-79091 {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 04:25:47.952884 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.agents_db [None req-92d61f12-17bc-4bf9-9eab-8a69b8c6da2f None None] Agent healthcheck: found 6 active agents {{(pid=91689) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 04:25:47.972438 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9948a5e-978e-46ba-b57a-350f2afab4b9 req-8089e964-38ab-4281-80f4-dbad8003f88d tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:47.982013 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-b9948a5e-978e-46ba-b57a-350f2afab4b9 req-8089e964-38ab-4281-80f4-dbad8003f88d tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 946 time: 0.1691458
May 20 04:25:47.997704 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1a1f9d2-b6c3-432b-bc03-d501ef1f73ee req-b826c85a-cce5-439c-812e-c2482511e76c tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:48.005557 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-b1a1f9d2-b6c3-432b-bc03-d501ef1f73ee req-b826c85a-cce5-439c-812e-c2482511e76c tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=738599b3-020d-4bc8-be0e-66c28772e5ca HTTP/1.1" status: 200  len: 944 time: 0.3209260
May 20 04:25:48.032523 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-b9948a5e-978e-46ba-b57a-350f2afab4b9 req-79fbbd3a-69e5-4bc2-9f15-e010bb76a4f9 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0495970
May 20 04:25:48.088285 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port d51370ee-559c-4eaa-8242-891121de4717, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=d51370ee-559c-4eaa-8242-891121de4717,segment=NetworkSegment(0ad1d987-000a-4092-8d15-811f90922b00),segment_id=0ad1d987-000a-4092-8d15-811f90922b00)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:25:48.104166 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Returning: {'device': 'd51370ee-559c-4eaa-8242-891121de4717', 'network_id': '20ab5e30-591a-443a-9e34-f3a1b7563f5d', 'port_id': 'd51370ee-559c-4eaa-8242-891121de4717', 'mac_address': 'fa:16:3e:9b:54:ae', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 876, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2a9c681d-a9be-4897-91bb-31aeb6432254', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91688) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 20 04:25:48.193673 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:48.233545 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.notifiers.nova [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d51370ee-559c-4eaa-8242-891121de4717 {{(pid=91688) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 04:25:48.279932 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port d51370ee-559c-4eaa-8242-891121de4717, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=d51370ee-559c-4eaa-8242-891121de4717,segment=NetworkSegment(0ad1d987-000a-4092-8d15-811f90922b00),segment_id=0ad1d987-000a-4092-8d15-811f90922b00)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:25:48.288054 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:48.294052 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:25:48.327017 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-b1a1f9d2-b6c3-432b-bc03-d501ef1f73ee req-eecdeca6-38ce-4051-afc0-2f27e38a2501 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0788929
May 20 04:25:48.368146 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-09871fe5-a064-470b-975b-e10431460f4f tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Router 093b6879-26f9-4912-a2fc-dab73a0df7cb has already been hosted by L3 agent 02733fc0-fc9c-4e29-bc03-c27a792d539d {{(pid=91686) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 04:25:48.399698 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 41574) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:25:48.417086 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Pushing event updated for resources: {'Port': ['ID=d51370ee-559c-4eaa-8242-891121de4717,revision_number=4']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:25:48.421979 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.129s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:25:48.851922 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-09871fe5-a064-470b-975b-e10431460f4f tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Notify agent at l3_agent.dv-cinder-790910-4-iscsi the message routers_updated {{(pid=91686) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 04:25:48.870246 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0d8e8db2-2be6-40bc-9ce4-3165defc1695 None None] Sync routers for ids ['093b6879-26f9-4912-a2fc-dab73a0df7cb'] in dv-cinder-790910-4-iscsi {{(pid=91689) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 04:25:48.883854 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] get_ports_and_sgs() called for port_ids ['d51370ee-559c-4eaa-8242-891121de4717'] {{(pid=91688) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 04:25:48.896314 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0d8e8db2-2be6-40bc-9ce4-3165defc1695 None None] Routers {'093b6879-26f9-4912-a2fc-dab73a0df7cb'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91689) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:25:48.897109 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-0d8e8db2-2be6-40bc-9ce4-3165defc1695 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced1671520>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:25:33Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['093b6879-26f9-4912-a2fc-dab73a0df7cb'], 'active': True} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:25:48.927734 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-09871fe5-a064-470b-975b-e10431460f4f tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for floatingip, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:49.144984 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-09871fe5-a064-470b-975b-e10431460f4f tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 997 time: 4.0308559
May 20 04:25:49.144984 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18', 'tag': '9c846663-c90b-41d4-a8d1-1086882ba27e'}] {{(pid=91686) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:25:49.271005 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18', 'tag': '9c846663-c90b-41d4-a8d1-1086882ba27e', 'status': 'completed', 'code': 200}
May 20 04:25:49.286066 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvr_db [None req-0d8e8db2-2be6-40bc-9ce4-3165defc1695 None None] Set router 093b6879-26f9-4912-a2fc-dab73a0df7cb gateway port host: dv-cinder-790910-4-iscsi {{(pid=91689) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:25:49.528697 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1577264c-1ecd-4d89-b7aa-a4e25e1d47ef req-2e41be63-f52c-4e8c-bf81-52c4e96aea20 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:49.535115 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-1577264c-1ecd-4d89-b7aa-a4e25e1d47ef req-2e41be63-f52c-4e8c-bf81-52c4e96aea20 service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=a1319e4a0fc74f98ba4bb88d8a04086b&device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 1099 time: 0.2393091
May 20 04:25:49.613525 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd0d67f0-71e6-4b86-888f-5c943ded83a3 req-5d5bd0e5-723b-45e7-9d23-de0c7fcfdbcb tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:49.628344 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-dd0d67f0-71e6-4b86-888f-5c943ded83a3 req-5d5bd0e5-723b-45e7-9d23-de0c7fcfdbcb tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 946 time: 0.2272801
May 20 04:25:49.713905 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1577264c-1ecd-4d89-b7aa-a4e25e1d47ef req-96fcce1d-4096-4ab4-a2e8-7da7d21dfa7a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:49.715870 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-1577264c-1ecd-4d89-b7aa-a4e25e1d47ef req-96fcce1d-4096-4ab4-a2e8-7da7d21dfa7a service neutron] 10.222.0.82 "GET /v2.0/networks?id=e31171ff-f097-446e-b691-bef7aad2fb3b HTTP/1.1" status: 200  len: 910 time: 0.1676733
May 20 04:25:49.726937 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-dd0d67f0-71e6-4b86-888f-5c943ded83a3 req-94faeb3e-290b-48ff-92e7-83dac7d651a9 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0968668
May 20 04:25:49.870876 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-0d8e8db2-2be6-40bc-9ce4-3165defc1695 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced1671520>, [{'id': '093b6879-26f9-4912-a2fc-dab73a0df7cb', 'name': 'tempest-TestShelveInstance-1799598596-router', 'tenant_id': 'a1319e4a0fc74f98ba4bb88d8a04086b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.187'}], 'enable_snat': True}, 'gw_port_id': '283f3ebf-83f3-4e30-ae78-4ec7e8841e26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:24:02Z', 'updated_at': '2021-05-20T04:24:12Z', 'revision_number': 4, 'project_id': 'a1319e4a0fc74f98ba4bb88d8a04086b', 'gw_port': {'id': '283f3ebf-83f3-4e30-ae78-4ec7e8841e26', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:d2:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '093b6879-26f9-4912-a2fc-dab73a0df7cb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 395, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.187', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:24:03Z', 'updated_at': '2021-05-20T04:24:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_floatingips': [{'id': 'e653a34a-b881-4576-9118-d5b4aa3d0533', 'tenant_id': 'a1319e4a0fc74f98ba4bb88d8a04086b', 'floating_ip_address': '172.27.1.154', 'floating_network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'router_id': '093b6879-26f9-4912-a2fc-dab73a0df7cb', 'port_id': '9c846663-c90b-41d4-a8d1-1086882ba27e', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 463, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e31171ff-f097-446e-b691-bef7aad2fb3b', 'mac_address': 'fa:16:3e:ee:c7:b4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T04:25:46Z', 'updated_at': '2021-05-20T04:25:46Z', 'revision_number': 0, 'project_id': 'a1319e4a0fc74f98ba4bb88d8a04086b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a97d355e-c698-41a6-8ed6-aaec93b83e2a', 'name': '', 'network_id': 'e31171ff-f097-446e-b691-bef7aad2fb3b', 'tenant_id': 'a1319e4a0fc74f98ba4bb88d8a04086b', 'mac_address': 'fa:16:3e:8e:5a:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '093b6879-26f9-4912-a2fc-dab73a0df7cb', 'device_owner': 'network:router_interface', 'standard_attr_id': 401, 'fixed_ips': [{'subnet_id': '410f59de-055d-4298-96bf-5d9a7712368d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:24:11Z', 'updated_at': '2021-05-20T04:24:21Z', 'revision_number': 5, 'project_id': 'a1319e4a0fc74f98ba4bb88d8a04086b', 'subnets': [{'id': '410f59de-055d-4298-96bf-5d9a7712368d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:25:49.886736 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0d8e8db2-2be6-40bc-9ce4-3165defc1695 None None] Checking router: 093b6879-26f9-4912-a2fc-dab73a0df7cb for host: dv-cinder-790910-4-iscsi {{(pid=91689) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 04:25:49.906296 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0d8e8db2-2be6-40bc-9ce4-3165defc1695 None None] Routers {'093b6879-26f9-4912-a2fc-dab73a0df7cb'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91689) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:25:49.907771 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-0d8e8db2-2be6-40bc-9ce4-3165defc1695 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced1671520>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:25:33Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['093b6879-26f9-4912-a2fc-dab73a0df7cb'], 'active': True} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:25:50.223543 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-28a1c6c0-5165-4cbe-94a8-9cc2d8e0b4fc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1716300'] for router_interface, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:50.252113 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvr_db [None req-0d8e8db2-2be6-40bc-9ce4-3165defc1695 None None] Set router 093b6879-26f9-4912-a2fc-dab73a0df7cb gateway port host: dv-cinder-790910-4-iscsi {{(pid=91689) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:25:50.317752 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-1577264c-1ecd-4d89-b7aa-a4e25e1d47ef req-382f92b7-5588-43bf-bfe2-7bdc9cf647de service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=9c846663-c90b-41d4-a8d1-1086882ba27e HTTP/1.1" status: 200  len: 1000 time: 0.5904083
May 20 04:25:50.537911 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-830169f2-5246-42ca-8f99-3ad8a5c7c324 req-642c4004-1772-4204-8d78-c7ecfac47367 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:50.547087 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-830169f2-5246-42ca-8f99-3ad8a5c7c324 req-642c4004-1772-4204-8d78-c7ecfac47367 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=738599b3-020d-4bc8-be0e-66c28772e5ca HTTP/1.1" status: 200  len: 945 time: 0.8296645
May 20 04:25:50.670266 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1577264c-1ecd-4d89-b7aa-a4e25e1d47ef req-aefb8f28-0e35-47a5-a43e-3b9448cd9016 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:50.672124 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-1577264c-1ecd-4d89-b7aa-a4e25e1d47ef req-aefb8f28-0e35-47a5-a43e-3b9448cd9016 service neutron] 10.222.0.82 "GET /v2.0/subnets?id=410f59de-055d-4298-96bf-5d9a7712368d HTTP/1.1" status: 200  len: 848 time: 0.3339522
May 20 04:25:50.901563 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-830169f2-5246-42ca-8f99-3ad8a5c7c324 req-5d029e91-1d28-42d5-a66c-92089a45972b tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3528411
May 20 04:25:50.956317 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-0d8e8db2-2be6-40bc-9ce4-3165defc1695 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced1671520>, [{'id': '093b6879-26f9-4912-a2fc-dab73a0df7cb', 'name': 'tempest-TestShelveInstance-1799598596-router', 'tenant_id': 'a1319e4a0fc74f98ba4bb88d8a04086b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.187'}], 'enable_snat': True}, 'gw_port_id': '283f3ebf-83f3-4e30-ae78-4ec7e8841e26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:24:02Z', 'updated_at': '2021-05-20T04:24:12Z', 'revision_number': 4, 'project_id': 'a1319e4a0fc74f98ba4bb88d8a04086b', 'gw_port': {'id': '283f3ebf-83f3-4e30-ae78-4ec7e8841e26', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:d2:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '093b6879-26f9-4912-a2fc-dab73a0df7cb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 395, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.187', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:24:03Z', 'updated_at': '2021-05-20T04:24:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_floatingips': [{'id': 'e653a34a-b881-4576-9118-d5b4aa3d0533', 'tenant_id': 'a1319e4a0fc74f98ba4bb88d8a04086b', 'floating_ip_address': '172.27.1.154', 'floating_network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'router_id': '093b6879-26f9-4912-a2fc-dab73a0df7cb', 'port_id': '9c846663-c90b-41d4-a8d1-1086882ba27e', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 463, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e31171ff-f097-446e-b691-bef7aad2fb3b', 'mac_address': 'fa:16:3e:ee:c7:b4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T04:25:46Z', 'updated_at': '2021-05-20T04:25:46Z', 'revision_number': 0, 'project_id': 'a1319e4a0fc74f98ba4bb88d8a04086b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a97d355e-c698-41a6-8ed6-aaec93b83e2a', 'name': '', 'network_id': 'e31171ff-f097-446e-b691-bef7aad2fb3b', 'tenant_id': 'a1319e4a0fc74f98ba4bb88d8a04086b', 'mac_address': 'fa:16:3e:8e:5a:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '093b6879-26f9-4912-a2fc-dab73a0df7cb', 'device_owner': 'network:router_interface', 'standard_attr_id': 401, 'fixed_ips': [{'subnet_id': '410f59de-055d-4298-96bf-5d9a7712368d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:24:11Z', 'updated_at': '2021-05-20T04:24:21Z', 'revision_number': 5, 'project_id': 'a1319e4a0fc74f98ba4bb88d8a04086b', 'subnets': [{'id': '410f59de-055d-4298-96bf-5d9a7712368d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:25:50.967935 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0d8e8db2-2be6-40bc-9ce4-3165defc1695 None None] The sync data for ids ['093b6879-26f9-4912-a2fc-dab73a0df7cb'] in dv-cinder-790910-4-iscsi is: [{'id': '093b6879-26f9-4912-a2fc-dab73a0df7cb', 'name': 'tempest-TestShelveInstance-1799598596-router', 'tenant_id': 'a1319e4a0fc74f98ba4bb88d8a04086b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.187'}], 'enable_snat': True}, 'gw_port_id': '283f3ebf-83f3-4e30-ae78-4ec7e8841e26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:24:02Z', 'updated_at': '2021-05-20T04:24:12Z', 'revision_number': 4, 'project_id': 'a1319e4a0fc74f98ba4bb88d8a04086b', 'gw_port': {'id': '283f3ebf-83f3-4e30-ae78-4ec7e8841e26', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:d2:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '093b6879-26f9-4912-a2fc-dab73a0df7cb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 395, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.187', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:24:03Z', 'updated_at': '2021-05-20T04:24:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_floatingips': [{'id': 'e653a34a-b881-4576-9118-d5b4aa3d0533', 'tenant_id': 'a1319e4a0fc74f98ba4bb88d8a04086b', 'floating_ip_address': '172.27.1.154', 'floating_network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'router_id': '093b6879-26f9-4912-a2fc-dab73a0df7cb', 'port_id': '9c846663-c90b-41d4-a8d1-1086882ba27e', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 463, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e31171ff-f097-446e-b691-bef7aad2fb3b', 'mac_address': 'fa:16:3e:ee:c7:b4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T04:25:46Z', 'updated_at': '2021-05-20T04:25:46Z', 'revision_number': 0, 'project_id': 'a1319e4a0fc74f98ba4bb88d8a04086b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a97d355e-c698-41a6-8ed6-aaec93b83e2a', 'name': '', 'network_id': 'e31171ff-f097-446e-b691-bef7aad2fb3b', 'tenant_id': 'a1319e4a0fc74f98ba4bb88d8a04086b', 'mac_address': 'fa:16:3e:8e:5a:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '093b6879-26f9-4912-a2fc-dab73a0df7cb', 'device_owner': 'network:router_interface', 'standard_attr_id': 401, 'fixed_ips': [{'subnet_id': '410f59de-055d-4298-96bf-5d9a7712368d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:24:11Z', 'updated_at': '2021-05-20T04:24:21Z', 'revision_number': 5, 'project_id': 'a1319e4a0fc74f98ba4bb88d8a04086b', 'subnets': [{'id': '410f59de-055d-4298-96bf-5d9a7712368d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91689) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 04:25:51.061149 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1577264c-1ecd-4d89-b7aa-a4e25e1d47ef req-2bf9bf37-4325-4775-a927-b5d8c9f33907 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:51.063735 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-1577264c-1ecd-4d89-b7aa-a4e25e1d47ef req-2bf9bf37-4325-4775-a927-b5d8c9f33907 service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=e31171ff-f097-446e-b691-bef7aad2fb3b&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.3313811
May 20 04:25:51.069491 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30c71a27-2836-4905-88d4-41aecfd3668f req-ca868dc6-e2d0-4c3a-9579-fbe4dbcf1368 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:51.072201 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-30c71a27-2836-4905-88d4-41aecfd3668f req-ca868dc6-e2d0-4c3a-9579-fbe4dbcf1368 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 946 time: 0.1185977
May 20 04:25:51.153792 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-30c71a27-2836-4905-88d4-41aecfd3668f req-d9f8bea7-302a-4eaf-9660-097d04051d33 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0740671
May 20 04:25:51.346641 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9edfa8b5-cedd-42f4-97e0-352c0b3abd6a None None] New status for floating IP e653a34a-b881-4576-9118-d5b4aa3d0533: ACTIVE {{(pid=91688) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 20 04:25:51.610418 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-1577264c-1ecd-4d89-b7aa-a4e25e1d47ef req-3375dd9b-6d46-4649-9613-101f80ef5fd8 service neutron] 10.222.0.82 "GET /v2.0/networks/e31171ff-f097-446e-b691-bef7aad2fb3b?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.5323515
May 20 04:25:51.669937 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [None req-28a1c6c0-5165-4cbe-94a8-9cc2d8e0b4fc admin admin] Deleting port a4932092-c8bd-4cf6-88c2-2bbb4eb549b3 {{(pid=91687) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 04:25:51.670463 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-28a1c6c0-5165-4cbe-94a8-9cc2d8e0b4fc admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8782892520551'] for port, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:51.885927 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device d51370ee-559c-4eaa-8242-891121de4717 up at agent hyperv_hv-cinder-79091 {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:25:51.901016 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-1577264c-1ecd-4d89-b7aa-a4e25e1d47ef req-6d066c2f-9eb6-468b-a7f3-8ccd5714aa0b service neutron] 10.222.0.82 "GET /v2.0/networks/e31171ff-f097-446e-b691-bef7aad2fb3b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2803583
May 20 04:25:51.906650 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [None req-28a1c6c0-5165-4cbe-94a8-9cc2d8e0b4fc admin admin] For port a4932092-c8bd-4cf6-88c2-2bbb4eb549b3, host dv-cinder-790910-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=a4932092-c8bd-4cf6-88c2-2bbb4eb549b3,segment=NetworkSegment(9d2ee761-256d-4e66-82a3-ef6e5bd352c1),segment_id=9d2ee761-256d-4e66-82a3-ef6e5bd352c1)] {{(pid=91687) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:25:51.907004 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-28a1c6c0-5165-4cbe-94a8-9cc2d8e0b4fc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1718922'] for port, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:52.060504 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Provisioning for port d51370ee-559c-4eaa-8242-891121de4717 completed by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:25:52.069108 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Provisioning complete for port d51370ee-559c-4eaa-8242-891121de4717 triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:25:52.070263 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:52.125505 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [None req-28a1c6c0-5165-4cbe-94a8-9cc2d8e0b4fc admin admin] Calling delete_port for a4932092-c8bd-4cf6-88c2-2bbb4eb549b3 owned by network:router_interface {{(pid=91687) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 04:25:52.302838 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:52.422105 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '738599b3-020d-4bc8-be0e-66c28772e5ca', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd51370ee-559c-4eaa-8242-891121de4717'}] {{(pid=91688) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:25:52.452810 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port d51370ee-559c-4eaa-8242-891121de4717, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=d51370ee-559c-4eaa-8242-891121de4717,segment=NetworkSegment(0ad1d987-000a-4092-8d15-811f90922b00),segment_id=0ad1d987-000a-4092-8d15-811f90922b00)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:25:52.461218 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:52.464011 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:25:52.622409 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Pushing event updated for resources: {'Port': ['ID=d51370ee-559c-4eaa-8242-891121de4717,revision_number=5']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:25:52.639017 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.175s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:25:52.679821 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-28a1c6c0-5165-4cbe-94a8-9cc2d8e0b4fc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8782892522936', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8782892108804', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4162192'] for port, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:52.685262 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-9a6106b1-d369-4030-8139-bb68fbb31bff admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:25:52.697567 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14dc3286-b26e-427c-824c-558e866561f4 req-6341d2f9-471e-4ce7-9a6b-2f0721431ee0 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:52.700544 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-14dc3286-b26e-427c-824c-558e866561f4 req-6341d2f9-471e-4ce7-9a6b-2f0721431ee0 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 946 time: 0.2080915
May 20 04:25:52.779806 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-14dc3286-b26e-427c-824c-558e866561f4 req-d4a7bd89-7f1c-408f-b9f2-e6a246d326f5 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0723777
May 20 04:25:52.857496 dv-cinder-790910-4-iscsi neutron-server[91688]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '738599b3-020d-4bc8-be0e-66c28772e5ca', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd51370ee-559c-4eaa-8242-891121de4717', 'code': 200}
May 20 04:25:52.858627 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28a1c6c0-5165-4cbe-94a8-9cc2d8e0b4fc admin admin] Pushing event deleted for resources: {'Port': ['ID=a4932092-c8bd-4cf6-88c2-2bbb4eb549b3,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:25:52.872135 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-28a1c6c0-5165-4cbe-94a8-9cc2d8e0b4fc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.187s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:25:52.992816 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6776862d-61bd-4dea-8e40-9bb84e4cf2d2 req-1c1cb614-37ba-4422-a533-fb30d0269292 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:52.994436 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-6776862d-61bd-4dea-8e40-9bb84e4cf2d2 req-1c1cb614-37ba-4422-a533-fb30d0269292 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=738599b3-020d-4bc8-be0e-66c28772e5ca HTTP/1.1" status: 200  len: 946 time: 0.4136775
May 20 04:25:53.233908 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-6776862d-61bd-4dea-8e40-9bb84e4cf2d2 req-a482b8a4-0ce7-4ad6-b77f-beb90dc3d225 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2277656
May 20 04:25:53.238529 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-28a1c6c0-5165-4cbe-94a8-9cc2d8e0b4fc admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1781439', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1717212'] for router_interface, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:53.371596 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf88521d-0fe2-4fb0-b917-09dda9a16a4d req-25689ce3-ed97-4a9b-8a69-56d5a89cc18a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:53.373668 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-bf88521d-0fe2-4fb0-b917-09dda9a16a4d req-25689ce3-ed97-4a9b-8a69-56d5a89cc18a service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=738599b3-020d-4bc8-be0e-66c28772e5ca HTTP/1.1" status: 200  len: 1099 time: 0.2707701
May 20 04:25:53.524303 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-bf88521d-0fe2-4fb0-b917-09dda9a16a4d req-bd32e3c9-9bfa-48d2-bd6b-271f1279ea2f service neutron] 10.222.0.82 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1328080
May 20 04:25:53.801270 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-28a1c6c0-5165-4cbe-94a8-9cc2d8e0b4fc admin admin] Router 4ec3fa08-f3da-44bd-bf6b-4feab27e9b78 has already been hosted by L3 agent 02733fc0-fc9c-4e29-bc03-c27a792d539d {{(pid=91687) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 04:25:54.019754 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdd6444e-cfd0-489c-a40c-c1d4ac140dff req-a2a31ce3-c4c9-42b6-b8c9-503c1fb9df37 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:54.021487 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-bdd6444e-cfd0-489c-a40c-c1d4ac140dff req-a2a31ce3-c4c9-42b6-b8c9-503c1fb9df37 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 946 time: 0.1165473
May 20 04:25:54.049757 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-28a1c6c0-5165-4cbe-94a8-9cc2d8e0b4fc admin admin] Notify agent at l3_agent.dv-cinder-790910-4-iscsi the message routers_updated {{(pid=91687) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 04:25:54.071352 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-604fab74-d8f7-4b5f-9596-e8661abdeabf None None] Sync routers for ids ['4ec3fa08-f3da-44bd-bf6b-4feab27e9b78'] in dv-cinder-790910-4-iscsi {{(pid=91689) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 04:25:54.080818 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-28a1c6c0-5165-4cbe-94a8-9cc2d8e0b4fc admin admin] 10.222.0.71 "PUT /v2.0/routers/4ec3fa08-f3da-44bd-bf6b-4feab27e9b78/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 5.6792667
May 20 04:25:54.085272 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 41624) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:25:54.089843 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-604fab74-d8f7-4b5f-9596-e8661abdeabf None None] Routers {'4ec3fa08-f3da-44bd-bf6b-4feab27e9b78'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91689) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:25:54.090730 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-604fab74-d8f7-4b5f-9596-e8661abdeabf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced16713a0>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:25:33Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['4ec3fa08-f3da-44bd-bf6b-4feab27e9b78'], 'active': True} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:25:54.102326 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-bdd6444e-cfd0-489c-a40c-c1d4ac140dff req-802c367f-6ff4-4cb6-aa2b-03419148a9ae tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0727365
May 20 04:25:54.340690 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvr_db [None req-604fab74-d8f7-4b5f-9596-e8661abdeabf None None] Set router 4ec3fa08-f3da-44bd-bf6b-4feab27e9b78 gateway port host: dv-cinder-790910-4-iscsi {{(pid=91689) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:25:54.608852 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-72a16694-4cf4-4699-95ff-3ad51eb818ce admin admin] Notify callbacks [] for router, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:54.716205 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-def99f58-3a6d-4c3a-8ecf-4d80193fb392 req-795cd968-42e2-4087-b69b-99c8530fc655 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:54.718522 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-def99f58-3a6d-4c3a-8ecf-4d80193fb392 req-795cd968-42e2-4087-b69b-99c8530fc655 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=738599b3-020d-4bc8-be0e-66c28772e5ca HTTP/1.1" status: 200  len: 946 time: 0.2354269
May 20 04:25:54.832897 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-604fab74-d8f7-4b5f-9596-e8661abdeabf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced16713a0>, [{'id': '4ec3fa08-f3da-44bd-bf6b-4feab27e9b78', 'name': 'tempest-ServerRescueNegativeTestJSON-2060961621-router', 'tenant_id': 'b7d86d894a5f420e86f4c28d7772bd22', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.34'}], 'enable_snat': True}, 'gw_port_id': 'a51c67da-478f-4b96-ab49-4cd64c665710', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:21:09Z', 'updated_at': '2021-05-20T04:25:52Z', 'revision_number': 5, 'project_id': 'b7d86d894a5f420e86f4c28d7772bd22', 'gw_port': {'id': 'a51c67da-478f-4b96-ab49-4cd64c665710', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:d9:31:98', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4ec3fa08-f3da-44bd-bf6b-4feab27e9b78', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.34', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:21:12Z', 'updated_at': '2021-05-20T04:21:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi'}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:25:54.839330 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-604fab74-d8f7-4b5f-9596-e8661abdeabf None None] Checking router: 4ec3fa08-f3da-44bd-bf6b-4feab27e9b78 for host: dv-cinder-790910-4-iscsi {{(pid=91689) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 04:25:54.852710 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-604fab74-d8f7-4b5f-9596-e8661abdeabf None None] Routers {'4ec3fa08-f3da-44bd-bf6b-4feab27e9b78'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91689) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:25:54.853865 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-604fab74-d8f7-4b5f-9596-e8661abdeabf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced16713a0>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:25:33Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['4ec3fa08-f3da-44bd-bf6b-4feab27e9b78'], 'active': True} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:25:54.912830 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-def99f58-3a6d-4c3a-8ecf-4d80193fb392 req-d0cd2ab4-8329-4df0-9ff5-be310d87162a tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0962863
May 20 04:25:54.951938 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-72a16694-4cf4-4699-95ff-3ad51eb818ce admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:55.050143 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [None req-72a16694-4cf4-4699-95ff-3ad51eb818ce admin admin] Deleting port a51c67da-478f-4b96-ab49-4cd64c665710 {{(pid=91687) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 04:25:55.050711 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-72a16694-4cf4-4699-95ff-3ad51eb818ce admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8782892520551'] for port, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:55.095787 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvr_db [None req-604fab74-d8f7-4b5f-9596-e8661abdeabf None None] Set router 4ec3fa08-f3da-44bd-bf6b-4feab27e9b78 gateway port host: dv-cinder-790910-4-iscsi {{(pid=91689) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:25:55.254681 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [None req-72a16694-4cf4-4699-95ff-3ad51eb818ce admin admin] For port a51c67da-478f-4b96-ab49-4cd64c665710, host dv-cinder-790910-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=a51c67da-478f-4b96-ab49-4cd64c665710,segment=NetworkSegment(8df49ec5-3fb9-4715-bc9a-f4019a6b55f9),segment_id=8df49ec5-3fb9-4715-bc9a-f4019a6b55f9)] {{(pid=91687) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:25:55.255991 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-72a16694-4cf4-4699-95ff-3ad51eb818ce admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1718922'] for port, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:55.317540 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82c8785a-d990-4e83-881a-76d0b5c2238d req-25334393-ac4d-4884-b462-2ddcd2f8d8ee tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:55.326059 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-82c8785a-d990-4e83-881a-76d0b5c2238d req-25334393-ac4d-4884-b462-2ddcd2f8d8ee tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 946 time: 0.1061130
May 20 04:25:55.483165 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [None req-72a16694-4cf4-4699-95ff-3ad51eb818ce admin admin] Calling delete_port for a51c67da-478f-4b96-ab49-4cd64c665710 owned by network:router_gateway {{(pid=91687) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 04:25:55.515222 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-82c8785a-d990-4e83-881a-76d0b5c2238d req-eacf9f12-e897-4bf0-945d-1b11d1559a83 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1877208
May 20 04:25:55.609135 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-604fab74-d8f7-4b5f-9596-e8661abdeabf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced16713a0>, [{'id': '4ec3fa08-f3da-44bd-bf6b-4feab27e9b78', 'name': 'tempest-ServerRescueNegativeTestJSON-2060961621-router', 'tenant_id': 'b7d86d894a5f420e86f4c28d7772bd22', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.34'}], 'enable_snat': True}, 'gw_port_id': 'a51c67da-478f-4b96-ab49-4cd64c665710', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:21:09Z', 'updated_at': '2021-05-20T04:25:52Z', 'revision_number': 5, 'project_id': 'b7d86d894a5f420e86f4c28d7772bd22', 'gw_port': {'id': 'a51c67da-478f-4b96-ab49-4cd64c665710', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:d9:31:98', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4ec3fa08-f3da-44bd-bf6b-4feab27e9b78', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.34', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:21:12Z', 'updated_at': '2021-05-20T04:21:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi'}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:25:55.632870 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-604fab74-d8f7-4b5f-9596-e8661abdeabf None None] The sync data for ids ['4ec3fa08-f3da-44bd-bf6b-4feab27e9b78'] in dv-cinder-790910-4-iscsi is: [{'id': '4ec3fa08-f3da-44bd-bf6b-4feab27e9b78', 'name': 'tempest-ServerRescueNegativeTestJSON-2060961621-router', 'tenant_id': 'b7d86d894a5f420e86f4c28d7772bd22', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.34'}], 'enable_snat': True}, 'gw_port_id': 'a51c67da-478f-4b96-ab49-4cd64c665710', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:21:09Z', 'updated_at': '2021-05-20T04:25:52Z', 'revision_number': 5, 'project_id': 'b7d86d894a5f420e86f4c28d7772bd22', 'gw_port': {'id': 'a51c67da-478f-4b96-ab49-4cd64c665710', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:d9:31:98', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4ec3fa08-f3da-44bd-bf6b-4feab27e9b78', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.34', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:21:12Z', 'updated_at': '2021-05-20T04:21:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi'}] {{(pid=91689) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 04:25:55.723461 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-72a16694-4cf4-4699-95ff-3ad51eb818ce admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8782892522936', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8782892108804', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4162192'] for port, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:55.730507 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-65867a9c-5f82-4e56-9c24-fbca72fa9124 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:25:55.779488 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72a16694-4cf4-4699-95ff-3ad51eb818ce admin admin] Pushing event deleted for resources: {'Port': ['ID=a51c67da-478f-4b96-ab49-4cd64c665710,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:25:55.783323 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-72a16694-4cf4-4699-95ff-3ad51eb818ce admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:25:55.898841 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-72a16694-4cf4-4699-95ff-3ad51eb818ce admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1714023'] for router_gateway, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:56.142533 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-72a16694-4cf4-4699-95ff-3ad51eb818ce admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1796572', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-6237'] for router, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:56.148665 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-72a16694-4cf4-4699-95ff-3ad51eb818ce admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:56.395811 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-72a16694-4cf4-4699-95ff-3ad51eb818ce admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-1712688'] for router, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:56.396699 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-72a16694-4cf4-4699-95ff-3ad51eb818ce admin admin] Fanout notify agent at l3_agent the message router_deleted on router 4ec3fa08-f3da-44bd-bf6b-4feab27e9b78 {{(pid=91687) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 20 04:25:56.437637 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-72a16694-4cf4-4699-95ff-3ad51eb818ce admin admin] Notify callbacks [] for router, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:56.438802 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-72a16694-4cf4-4699-95ff-3ad51eb818ce admin admin] 10.222.0.71 "DELETE /v2.0/routers/4ec3fa08-f3da-44bd-bf6b-4feab27e9b78 HTTP/1.1" status: 204  len: 168 time: 2.3524756
May 20 04:25:56.443035 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 41638) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:25:56.461088 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01a11687-fce6-4003-bb49-e00a27ef1740 req-6f2ce7f8-3f15-4490-8c57-a41512d55180 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:56.469113 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-01a11687-fce6-4003-bb49-e00a27ef1740 req-6f2ce7f8-3f15-4490-8c57-a41512d55180 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=738599b3-020d-4bc8-be0e-66c28772e5ca HTTP/1.1" status: 200  len: 946 time: 0.3241966
May 20 04:25:56.530973 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-01a11687-fce6-4003-bb49-e00a27ef1740 req-f17424b0-20c7-4bd9-b4fa-6ce94e51206b tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0602999
May 20 04:25:56.550006 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.db_base_plugin_v2 [None req-b5c5c888-7964-4561-9fb2-d42040a46b97 admin admin] Deleting subnet b488dc7d-0e70-4e52-9179-7e6c3e4fb0a1 {{(pid=91686) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 20 04:25:56.556054 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-b5c5c888-7964-4561-9fb2-d42040a46b97 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:56.773144 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-b5c5c888-7964-4561-9fb2-d42040a46b97 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4081462'] for subnet, precommit_delete_associations {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:56.915180 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-b5c5c888-7964-4561-9fb2-d42040a46b97 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1504133'] for subnet, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:57.004454 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bad9aaf-1830-423f-8806-9bdb6a094bf7 req-5c486c7b-da09-45f0-9039-541a1c61ed37 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:57.013117 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-8bad9aaf-1830-423f-8806-9bdb6a094bf7 req-5c486c7b-da09-45f0-9039-541a1c61ed37 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 946 time: 0.3336146
May 20 04:25:57.221609 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device a4932092-c8bd-4cf6-88c2-2bbb4eb549b3 no longer exists at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 04:25:57.327136 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-8bad9aaf-1830-423f-8806-9bdb6a094bf7 req-91b7de67-ae38-4b9b-9c1c-be0f050bf509 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.3129542
May 20 04:25:57.392004 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] No Port match for: a4932092-c8bd-4cf6-88c2-2bbb4eb549b3 {{(pid=91688) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 04:25:57.392004 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device a4932092-c8bd-4cf6-88c2-2bbb4eb549b3 not bound to the agent host dv-cinder-790910-4-iscsi {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 04:25:57.392004 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device a51c67da-478f-4b96-ab49-4cd64c665710 no longer exists at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 04:25:57.460314 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] No Port match for: a51c67da-478f-4b96-ab49-4cd64c665710 {{(pid=91688) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 04:25:57.461382 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device a51c67da-478f-4b96-ab49-4cd64c665710 not bound to the agent host dv-cinder-790910-4-iscsi {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 04:25:57.597485 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-b5c5c888-7964-4561-9fb2-d42040a46b97 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1504178', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-255887', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2114755', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2442237'] for subnet, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:57.603119 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-295b8786-8605-44f2-8d17-d4fca7dbe11f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:25:57.646994 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-b5c5c888-7964-4561-9fb2-d42040a46b97 admin admin] Notify callbacks [] for subnet, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:57.653644 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-b5c5c888-7964-4561-9fb2-d42040a46b97 admin admin] 10.222.0.71 "DELETE /v2.0/subnets/b488dc7d-0e70-4e52-9179-7e6c3e4fb0a1 HTTP/1.1" status: 204  len: 168 time: 1.2095239
May 20 04:25:57.655233 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5c5c888-7964-4561-9fb2-d42040a46b97 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=b488dc7d-0e70-4e52-9179-7e6c3e4fb0a1,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:25:57.658490 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 41658) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:25:57.660847 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-b5c5c888-7964-4561-9fb2-d42040a46b97 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:25:57.779658 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-bd793b1c-3607-477d-9879-4fd0c2b5b734 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-593149'] for network, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:57.920382 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-bd793b1c-3607-477d-9879-4fd0c2b5b734 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1505550', 'neutron.services.segments.db._delete_segments_for_network-8782892550274'] for network, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:57.938047 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.services.segments.db [None req-bd793b1c-3607-477d-9879-4fd0c2b5b734 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fced09364c0>,) {'filters': {'network_id': ['348b2b0f-c826-45ab-ba85-8430235b9cac']}} {{(pid=91686) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:25:57.956191 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.services.segments.db [None req-bd793b1c-3607-477d-9879-4fd0c2b5b734 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fced09364c0>, '9d2ee761-256d-4e66-82a3-ef6e5bd352c1') {'for_net_delete': True} {{(pid=91686) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:25:57.956849 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.services.segments.db [None req-bd793b1c-3607-477d-9879-4fd0c2b5b734 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fced09364c0>, '9d2ee761-256d-4e66-82a3-ef6e5bd352c1') {} {{(pid=91686) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:25:57.976447 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-bd793b1c-3607-477d-9879-4fd0c2b5b734 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8782892560523', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4081441'] for segment, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:57.997494 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-bd793b1c-3607-477d-9879-4fd0c2b5b734 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1501910'] for segment, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:58.007160 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-bd793b1c-3607-477d-9879-4fd0c2b5b734 admin admin] Releasing vlan 897 on physical network physnet1 to pool {{(pid=91686) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 20 04:25:58.007764 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-bd793b1c-3607-477d-9879-4fd0c2b5b734 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1501910', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2145121'] for segment, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:58.022057 dv-cinder-790910-4-iscsi neutron-server[91686]: Traceback (most recent call last):
May 20 04:25:58.022057 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 20 04:25:58.022057 dv-cinder-790910-4-iscsi neutron-server[91686]:     timer()
May 20 04:25:58.022057 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 20 04:25:58.022057 dv-cinder-790910-4-iscsi neutron-server[91686]:     cb(*args, **kw)
May 20 04:25:58.022057 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 20 04:25:58.022057 dv-cinder-790910-4-iscsi neutron-server[91686]:     return func(*args, **kwargs)
May 20 04:25:58.022057 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 20 04:25:58.022057 dv-cinder-790910-4-iscsi neutron-server[91686]:     self._notify()
May 20 04:25:58.022057 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 20 04:25:58.022057 dv-cinder-790910-4-iscsi neutron-server[91686]:     self.callback(batched_events)
May 20 04:25:58.022057 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 20 04:25:58.022057 dv-cinder-790910-4-iscsi neutron-server[91686]:     event.method(event)
May 20 04:25:58.022057 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 20 04:25:58.022057 dv-cinder-790910-4-iscsi neutron-server[91686]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 20 04:25:58.022057 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 20 04:25:58.022057 dv-cinder-790910-4-iscsi neutron-server[91686]:     aggregate_uuid = self.p_client.list_aggregates(
May 20 04:25:58.022057 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 20 04:25:58.022057 dv-cinder-790910-4-iscsi neutron-server[91686]:     return f(self, *a, **k)
May 20 04:25:58.022057 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 20 04:25:58.022057 dv-cinder-790910-4-iscsi neutron-server[91686]:     return self._get(url).json()
May 20 04:25:58.022057 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 20 04:25:58.022057 dv-cinder-790910-4-iscsi neutron-server[91686]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 20 04:25:58.022057 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 20 04:25:58.022057 dv-cinder-790910-4-iscsi neutron-server[91686]:     return self.request(url, 'GET', **kwargs)
May 20 04:25:58.022057 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 20 04:25:58.022057 dv-cinder-790910-4-iscsi neutron-server[91686]:     base_url = self.get_endpoint(auth, allow=allow,
May 20 04:25:58.022057 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 20 04:25:58.022057 dv-cinder-790910-4-iscsi neutron-server[91686]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 20 04:25:58.022057 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 20 04:25:58.022057 dv-cinder-790910-4-iscsi neutron-server[91686]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 20 04:25:58.022057 dv-cinder-790910-4-iscsi neutron-server[91686]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 20 04:25:58.116928 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-bd793b1c-3607-477d-9879-4fd0c2b5b734 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1505543', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1590664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1781430', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1713996'] for network, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:58.121689 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:25:58.137368 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-bd793b1c-3607-477d-9879-4fd0c2b5b734 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for network, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:58.153264 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd793b1c-3607-477d-9879-4fd0c2b5b734 admin admin] Pushing event deleted for resources: {'Network': ['ID=348b2b0f-c826-45ab-ba85-8430235b9cac,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:25:58.156406 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-bd793b1c-3607-477d-9879-4fd0c2b5b734 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.035s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:25:58.159365 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-bd793b1c-3607-477d-9879-4fd0c2b5b734 admin admin] 10.222.0.71 "DELETE /v2.0/networks/348b2b0f-c826-45ab-ba85-8430235b9cac HTTP/1.1" status: 204  len: 168 time: 0.4989791
May 20 04:25:58.316383 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 41664) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:25:58.378175 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-ef3bbc52-8570-4fbd-a60d-6496fa5252d4 admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=b7d86d894a5f420e86f4c28d7772bd22&name=default HTTP/1.1" status: 200  len: 2975 time: 0.0603247
May 20 04:25:58.380631 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 41668) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:25:58.517199 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-62a8d6dc-af5a-45a4-9479-2c882085d836 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:58.610708 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-62a8d6dc-af5a-45a4-9479-2c882085d836 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:58.728540 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-62a8d6dc-af5a-45a4-9479-2c882085d836 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:58.734768 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-2f40b9d6-0b26-481c-ad81-7008d3d9a8ad admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:25:58.752040 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74789ab3-8827-40ba-a5ac-096a1f3f6353 req-05f50d1c-ebb5-4d33-8686-59cbb45ae9cc tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:25:58.754421 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62a8d6dc-af5a-45a4-9479-2c882085d836 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8cbf810a-7c03-41fd-8b60-12a4f73202de,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:25:58.758798 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-62a8d6dc-af5a-45a4-9479-2c882085d836 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:25:58.766987 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-62a8d6dc-af5a-45a4-9479-2c882085d836 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:25:58.768375 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-62a8d6dc-af5a-45a4-9479-2c882085d836 admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/8cbf810a-7c03-41fd-8b60-12a4f73202de HTTP/1.1" status: 204  len: 168 time: 0.3867815
May 20 04:25:58.784502 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-74789ab3-8827-40ba-a5ac-096a1f3f6353 req-05f50d1c-ebb5-4d33-8686-59cbb45ae9cc tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 946 time: 0.1670811
May 20 04:25:59.044511 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-74789ab3-8827-40ba-a5ac-096a1f3f6353 req-a02edabe-a3e7-447a-b07f-4185ebac4818 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.2554033
May 20 04:25:59.863671 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-0899da44-9741-4360-a697-fc2018c40aa2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:26:00.432424 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b821ac42-82ab-46db-93d8-cae29ad85884 req-f55a396e-f105-44bd-bb7d-ec3f8f629792 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:00.445437 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-b821ac42-82ab-46db-93d8-cae29ad85884 req-f55a396e-f105-44bd-bb7d-ec3f8f629792 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 946 time: 0.2066839
May 20 04:26:00.533691 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-b821ac42-82ab-46db-93d8-cae29ad85884 req-90595a16-9598-4d6a-85e6-c74f67084cf0 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0869963
May 20 04:26:01.863031 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ab564a4-ed8e-416e-a40d-378f6a19c83e req-1d3af115-bea4-4808-aaae-dff45eb5aa0e tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:01.865178 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-3ab564a4-ed8e-416e-a40d-378f6a19c83e req-1d3af115-bea4-4808-aaae-dff45eb5aa0e tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 946 time: 0.1233292
May 20 04:26:01.950449 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-3ab564a4-ed8e-416e-a40d-378f6a19c83e req-16706c46-9a0a-4942-9388-be04d361d2e4 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0741534
May 20 04:26:02.567781 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:26:02.701827 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-24178d34-842f-44a4-aeec-2da3511052f3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:26:03.297468 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de8f00c9-ddd9-4420-a047-582acabe48a8 req-a4c97857-d5db-4de0-a434-01e60604577c tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:03.306999 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-de8f00c9-ddd9-4420-a047-582acabe48a8 req-a4c97857-d5db-4de0-a434-01e60604577c tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 946 time: 0.2055900
May 20 04:26:03.336514 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ea4803bd-878f-47d5-9084-1ec41953c9db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:26:03.376416 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-de8f00c9-ddd9-4420-a047-582acabe48a8 req-47477e77-7698-4a17-9d3e-331fab505e5e tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0656443
May 20 04:26:03.695904 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:26:04.582368 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-990d42ac-f3c0-4ab9-8559-2d9edebc7e15 req-de80999f-fe42-4685-9ab9-a38e69b2d165 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:04.583896 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-990d42ac-f3c0-4ab9-8559-2d9edebc7e15 req-de80999f-fe42-4685-9ab9-a38e69b2d165 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 946 time: 0.0889776
May 20 04:26:04.633474 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-990d42ac-f3c0-4ab9-8559-2d9edebc7e15 req-636aa1fe-36e8-4d2b-866d-9d386ff5124d tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0435457
May 20 04:26:04.896016 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d59434f-2a05-4603-9e91-300581d6f46a req-668b3010-4c58-4ae1-a573-1bdc6c92e079 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:04.897876 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9d59434f-2a05-4603-9e91-300581d6f46a req-668b3010-4c58-4ae1-a573-1bdc6c92e079 service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=ef3bec4745b14484ac8e21cd16cbd11d&device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 1099 time: 0.0869534
May 20 04:26:05.067208 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d59434f-2a05-4603-9e91-300581d6f46a req-f6a8bc13-42f1-4330-83cf-efdc2065f997 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:05.068660 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9d59434f-2a05-4603-9e91-300581d6f46a req-f6a8bc13-42f1-4330-83cf-efdc2065f997 service neutron] 10.222.0.82 "GET /v2.0/networks?id=21794e86-fda7-40a6-a5a8-db117c7eeb9d HTTP/1.1" status: 200  len: 918 time: 0.1618052
May 20 04:26:05.185065 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9d59434f-2a05-4603-9e91-300581d6f46a req-664d1b9b-4834-4ca5-a92a-9707c4c19e65 service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=115e1bac-cc4d-40b5-b860-798c85c78924 HTTP/1.1" status: 200  len: 1002 time: 0.1095779
May 20 04:26:05.191340 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f21320cc-6a25-4ec1-8a32-8b119b35fd55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:26:05.254040 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d59434f-2a05-4603-9e91-300581d6f46a req-1ea095ec-cc7e-4bdc-a4c3-8a4e7aced59a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:05.255478 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9d59434f-2a05-4603-9e91-300581d6f46a req-1ea095ec-cc7e-4bdc-a4c3-8a4e7aced59a service neutron] 10.222.0.82 "GET /v2.0/subnets?id=06f38702-3d3c-4e25-8f84-85483d1ddf28 HTTP/1.1" status: 200  len: 856 time: 0.0611022
May 20 04:26:05.337872 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d59434f-2a05-4603-9e91-300581d6f46a req-d981c340-5fe5-4732-85cb-b8427fc68369 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:05.339356 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9d59434f-2a05-4603-9e91-300581d6f46a req-d981c340-5fe5-4732-85cb-b8427fc68369 service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=21794e86-fda7-40a6-a5a8-db117c7eeb9d&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0752158
May 20 04:26:05.478245 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9d59434f-2a05-4603-9e91-300581d6f46a req-07477843-99dd-409c-bd1d-4f57fc59f12e service neutron] 10.222.0.82 "GET /v2.0/networks/21794e86-fda7-40a6-a5a8-db117c7eeb9d?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1292846
May 20 04:26:05.620891 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9d59434f-2a05-4603-9e91-300581d6f46a req-659717b5-3155-4fcb-a6eb-1134b5abfaa1 service neutron] 10.222.0.82 "GET /v2.0/networks/21794e86-fda7-40a6-a5a8-db117c7eeb9d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1333840
May 20 04:26:05.832234 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f767ddf-2a69-43ac-86c5-15e1c4a6b45a req-d89250c1-f9c0-4945-8705-584f4ff40bb2 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:05.833783 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-0f767ddf-2a69-43ac-86c5-15e1c4a6b45a req-d89250c1-f9c0-4945-8705-584f4ff40bb2 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 946 time: 0.0839119
May 20 04:26:05.883050 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-0f767ddf-2a69-43ac-86c5-15e1c4a6b45a req-477c1096-e3ea-421e-b9dd-8a616959f97d tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0428822
May 20 04:26:07.084007 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e7322a5-2258-4370-a00a-fd7a4c8b9f5c req-2e07586c-1771-48c5-9e57-adbdae14d77f tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:07.085986 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-2e7322a5-2258-4370-a00a-fd7a4c8b9f5c req-2e07586c-1771-48c5-9e57-adbdae14d77f tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 946 time: 0.0858817
May 20 04:26:07.133872 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-2e7322a5-2258-4370-a00a-fd7a4c8b9f5c req-d2a6981d-858e-4da5-b653-607aa5885b10 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0406437
May 20 04:26:07.964804 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 115e1bac-cc4d-40b5-b860-798c85c78924 no longer exists at agent hyperv_hv-cinder-79091 {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 04:26:08.084712 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:26:08.113470 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f32b55e5-d82f-4c9e-a67f-08d83c24cf4d', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '115e1bac-cc4d-40b5-b860-798c85c78924'}] {{(pid=91688) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:26:08.124144 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port 115e1bac-cc4d-40b5-b860-798c85c78924, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=115e1bac-cc4d-40b5-b860-798c85c78924,segment=NetworkSegment(9521f383-6017-4b4d-9f47-cff4ed54cb57),segment_id=9521f383-6017-4b4d-9f47-cff4ed54cb57)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:26:08.130191 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:26:08.132369 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-730b0543-e5fa-4e66-85a9-3a5c52a36f8f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:26:08.175574 dv-cinder-790910-4-iscsi neutron-server[91688]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f32b55e5-d82f-4c9e-a67f-08d83c24cf4d', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '115e1bac-cc4d-40b5-b860-798c85c78924', 'code': 200}
May 20 04:26:08.212787 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Pushing event updated for resources: {'Port': ['ID=115e1bac-cc4d-40b5-b860-798c85c78924,revision_number=8']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:26:08.216339 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:26:08.345267 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ca0485c-4eab-4269-9906-f686a7f9dab8 req-c6e058af-d82f-4d0b-9ee4-a6b4e4c92eb1 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:08.349454 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-2ca0485c-4eab-4269-9906-f686a7f9dab8 req-c6e058af-d82f-4d0b-9ee4-a6b4e4c92eb1 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 944 time: 0.0995591
May 20 04:26:08.400715 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-2ca0485c-4eab-4269-9906-f686a7f9dab8 req-d106cab6-9ba1-4128-ba6d-8b88a02d3bd5 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0480459
May 20 04:26:09.443569 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21634c6d-c583-416d-967a-7377b994b667 req-3b1085ef-d70c-4b53-b2a4-781066e54b46 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:09.445329 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-21634c6d-c583-416d-967a-7377b994b667 req-3b1085ef-d70c-4b53-b2a4-781066e54b46 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 944 time: 0.0930805
May 20 04:26:09.502408 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-21634c6d-c583-416d-967a-7377b994b667 req-a2d89862-3f38-435b-a1a8-9a4a1dbb87fa tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0473239
May 20 04:26:09.901764 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 41920) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:26:10.045152 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-f955cbb1-c3b9-4f48-a8f2-ee0f5d0a69a1 req-06f8a1ef-e8e4-4fa1-92be-a043dd9c1996 service neutron] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d&fields=id&fields=resource_request HTTP/1.1" status: 200  len: 255 time: 0.1417139
May 20 04:26:10.880157 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b475c5b5-4958-4daa-ada3-eed4d321a7ab req-d5675825-a8e1-47f7-b2ef-61fdba70fdde tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:10.881697 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-b475c5b5-4958-4daa-ada3-eed4d321a7ab req-d5675825-a8e1-47f7-b2ef-61fdba70fdde tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 944 time: 0.2463915
May 20 04:26:10.930192 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-b475c5b5-4958-4daa-ada3-eed4d321a7ab req-37ba8f22-c709-4472-abc2-5b73219c9b1d tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0423093
May 20 04:26:11.371795 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 41952) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:26:11.514556 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-37028dd8-c098-4007-a72f-6724820d463e admin admin] Notify callbacks [] for security_group, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:26:11.530956 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-37028dd8-c098-4007-a72f-6724820d463e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:26:11.535305 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-37028dd8-c098-4007-a72f-6724820d463e admin admin] Usage tracker for resource:security_group_rule and tenant:4721ee8f0c384110bfe294b468e43170 is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:26:11.538897 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-37028dd8-c098-4007-a72f-6724820d463e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:26:11.545205 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-37028dd8-c098-4007-a72f-6724820d463e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:26:11.645273 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-37028dd8-c098-4007-a72f-6724820d463e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:26:11.650779 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-37028dd8-c098-4007-a72f-6724820d463e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:26:11.659388 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-606a4c83-6ed4-4bbc-aebf-1ef9d9e2b55a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:26:11.703976 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-37028dd8-c098-4007-a72f-6724820d463e admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=4721ee8f0c384110bfe294b468e43170&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3308060
May 20 04:26:11.704839 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37028dd8-c098-4007-a72f-6724820d463e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=97f44b03-6457-4e90-8242-b48dc295bf2d,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:26:11.707181 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 41958) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:26:11.708328 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-37028dd8-c098-4007-a72f-6724820d463e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:26:11.794032 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-4da51bc3-aed5-496d-a21f-a873c65c5cae admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:26:11.827748 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-4da51bc3-aed5-496d-a21f-a873c65c5cae admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:26:11.893366 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-4da51bc3-aed5-496d-a21f-a873c65c5cae admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:26:11.897557 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-82119079-54e0-41d8-ad60-f87fc2ed103f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:26:11.913131 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4da51bc3-aed5-496d-a21f-a873c65c5cae admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=97f44b03-6457-4e90-8242-b48dc295bf2d,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:26:11.915822 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-4da51bc3-aed5-496d-a21f-a873c65c5cae admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:26:11.919848 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-4da51bc3-aed5-496d-a21f-a873c65c5cae admin admin] Notify callbacks [] for security_group, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:26:11.922926 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-4da51bc3-aed5-496d-a21f-a873c65c5cae admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/97f44b03-6457-4e90-8242-b48dc295bf2d HTTP/1.1" status: 204  len: 168 time: 0.2143414
May 20 04:26:12.142376 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3b5eb98-5961-4b9b-ba53-2854a0280aa5 req-51f83e84-38a9-4bea-a684-054f91e5158e tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:12.143965 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-c3b5eb98-5961-4b9b-ba53-2854a0280aa5 req-51f83e84-38a9-4bea-a684-054f91e5158e tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 944 time: 0.0912478
May 20 04:26:12.197820 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-c3b5eb98-5961-4b9b-ba53-2854a0280aa5 req-95913678-761a-4511-a698-e4cb5df2d63d tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0459185
May 20 04:26:13.412863 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a641ec8f-181a-46ce-8002-dbb1f4d0dbff req-044ef9f2-7eeb-4a8d-8aac-50abded48d9e tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:13.414467 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-a641ec8f-181a-46ce-8002-dbb1f4d0dbff req-044ef9f2-7eeb-4a8d-8aac-50abded48d9e tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 944 time: 0.0951176
May 20 04:26:13.462706 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-a641ec8f-181a-46ce-8002-dbb1f4d0dbff req-0a062904-688a-4521-a31a-b8bfa688efeb tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0419338
May 20 04:26:13.570410 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 42022) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:26:13.709525 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-4562f8cb-3940-41c6-9ef3-62378c9a9b03 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:26:13.728335 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-4562f8cb-3940-41c6-9ef3-62378c9a9b03 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:26:13.732551 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-4562f8cb-3940-41c6-9ef3-62378c9a9b03 admin admin] Usage tracker for resource:security_group_rule and tenant:fe4c6821da3d4197b6508a51f561e09f is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:26:13.735693 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-4562f8cb-3940-41c6-9ef3-62378c9a9b03 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:26:13.741862 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-4562f8cb-3940-41c6-9ef3-62378c9a9b03 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:26:13.835750 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-4562f8cb-3940-41c6-9ef3-62378c9a9b03 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:26:13.840018 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-4562f8cb-3940-41c6-9ef3-62378c9a9b03 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:26:13.847474 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-efd3c63c-a8a2-4fb2-afe3-1d7ca57b7603 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:26:13.888564 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-4562f8cb-3940-41c6-9ef3-62378c9a9b03 admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=fe4c6821da3d4197b6508a51f561e09f&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3170550
May 20 04:26:13.889548 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4562f8cb-3940-41c6-9ef3-62378c9a9b03 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3c9654f9-936c-4f06-8a94-7b88c29e6666,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:26:13.891583 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 42028) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:26:13.892877 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-4562f8cb-3940-41c6-9ef3-62378c9a9b03 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:26:13.956704 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-a164b852-7947-416b-a56f-54e0ca624cf3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:26:13.987942 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-a164b852-7947-416b-a56f-54e0ca624cf3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:26:14.044658 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-a164b852-7947-416b-a56f-54e0ca624cf3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:26:14.050201 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-4a30bbd5-c9f6-4ad2-97d0-05bf6867da8a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:26:14.064566 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a164b852-7947-416b-a56f-54e0ca624cf3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3c9654f9-936c-4f06-8a94-7b88c29e6666,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:26:14.067005 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-a164b852-7947-416b-a56f-54e0ca624cf3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:26:14.075030 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-a164b852-7947-416b-a56f-54e0ca624cf3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:26:14.078893 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-a164b852-7947-416b-a56f-54e0ca624cf3 admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/3c9654f9-936c-4f06-8a94-7b88c29e6666 HTTP/1.1" status: 204  len: 168 time: 0.1836708
May 20 04:26:14.679155 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84c3f687-0a7c-4819-b133-7db8c3f410b8 req-864239a7-9d2b-4be9-a66c-4ebc2a757e1a tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:14.680988 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-84c3f687-0a7c-4819-b133-7db8c3f410b8 req-864239a7-9d2b-4be9-a66c-4ebc2a757e1a tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 944 time: 0.0927868
May 20 04:26:14.751930 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-84c3f687-0a7c-4819-b133-7db8c3f410b8 req-ac17c81a-5497-478c-9327-f8610637c734 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0593667
May 20 04:26:15.996551 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eead65ed-c61e-4eb4-abb5-04f79d9381e0 req-3ed7f124-24c8-412d-b27c-c09ff7b8c815 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:15.998598 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-eead65ed-c61e-4eb4-abb5-04f79d9381e0 req-3ed7f124-24c8-412d-b27c-c09ff7b8c815 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 944 time: 0.0977788
May 20 04:26:16.091800 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-eead65ed-c61e-4eb4-abb5-04f79d9381e0 req-efec3252-f666-41e8-871f-97d9f60d5eb4 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0828907
May 20 04:26:17.286486 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60ae7ea6-3aaf-4bc0-91c6-545e38276a8c req-b1a3ebdf-2ce3-4ce1-aae9-59bb6913e387 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:17.288677 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-60ae7ea6-3aaf-4bc0-91c6-545e38276a8c req-b1a3ebdf-2ce3-4ce1-aae9-59bb6913e387 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 944 time: 0.0843976
May 20 04:26:17.338190 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-60ae7ea6-3aaf-4bc0-91c6-545e38276a8c req-604c3a6e-d0f6-4638-814a-a6ce7f2ae913 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0428300
May 20 04:26:18.554587 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a7a22ba-6176-45ad-a98e-f4c78a91d941 req-3cc23dd4-58fc-4fab-b97d-2d4ae9e33031 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:18.556047 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-5a7a22ba-6176-45ad-a98e-f4c78a91d941 req-3cc23dd4-58fc-4fab-b97d-2d4ae9e33031 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 944 time: 0.0924077
May 20 04:26:18.602116 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-5a7a22ba-6176-45ad-a98e-f4c78a91d941 req-8af0acdb-dc65-4220-b435-022dd9ca56c3 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0402598
May 20 04:26:19.884719 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14f892b5-30f8-4d8e-b883-eb4c4abba6f2 req-70c624c3-5a33-40c9-8d0f-015e7770c7c9 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:19.886412 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-14f892b5-30f8-4d8e-b883-eb4c4abba6f2 req-70c624c3-5a33-40c9-8d0f-015e7770c7c9 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 944 time: 0.1651986
May 20 04:26:19.932753 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-14f892b5-30f8-4d8e-b883-eb4c4abba6f2 req-be43cb69-f0c4-496c-9213-f4f22e407dc5 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0394051
May 20 04:26:21.138336 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b360bd69-1023-461d-a512-b3ff3224ea92 req-31ccbd1f-8027-46ec-a385-dc5d330e5d83 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:21.139695 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-b360bd69-1023-461d-a512-b3ff3224ea92 req-31ccbd1f-8027-46ec-a385-dc5d330e5d83 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 944 time: 0.0863976
May 20 04:26:21.187928 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-b360bd69-1023-461d-a512-b3ff3224ea92 req-673500ee-3d18-4f86-b90f-9454c028401d tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0394676
May 20 04:26:22.401999 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd7f7375-1c56-4c02-956a-ec14a9a9863a req-288fbaec-262d-4db2-a90a-f2bbb24c04d2 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:22.403411 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-fd7f7375-1c56-4c02-956a-ec14a9a9863a req-288fbaec-262d-4db2-a90a-f2bbb24c04d2 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 944 time: 0.0887420
May 20 04:26:22.454399 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-fd7f7375-1c56-4c02-956a-ec14a9a9863a req-936e95c8-c166-42ed-8ea8-c8516c08c066 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0447226
May 20 04:26:23.666299 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b95e0bca-6f45-428b-b25a-11208d21efce req-f9fd7832-cd6b-4477-9479-9a107f506514 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:23.668175 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-b95e0bca-6f45-428b-b25a-11208d21efce req-f9fd7832-cd6b-4477-9479-9a107f506514 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 944 time: 0.0895393
May 20 04:26:23.724786 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-b95e0bca-6f45-428b-b25a-11208d21efce req-515eb852-8e8e-414c-9d25-9decfd56a26c tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0471985
May 20 04:26:24.742307 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f955cbb1-c3b9-4f48-a8f2-ee0f5d0a69a1 req-cc47d30d-8024-4776-aa6d-9faed8885014 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:24.743789 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-f955cbb1-c3b9-4f48-a8f2-ee0f5d0a69a1 req-cc47d30d-8024-4776-aa6d-9faed8885014 service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d&tenant_id=ef3bec4745b14484ac8e21cd16cbd11d HTTP/1.1" status: 200  len: 1097 time: 0.0754437
May 20 04:26:24.952430 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.agents_db [None req-92d61f12-17bc-4bf9-9eab-8a69b8c6da2f None None] Agent healthcheck: found 6 active agents {{(pid=91689) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 04:26:25.162413 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc4cb0a2-d952-42d9-bda0-acfaa0d44baa req-d2709c0c-36b3-4ab2-92bb-9068fcad10a0 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:25.163913 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-dc4cb0a2-d952-42d9-bda0-acfaa0d44baa req-d2709c0c-36b3-4ab2-92bb-9068fcad10a0 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 944 time: 0.0870895
May 20 04:26:25.217068 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-dc4cb0a2-d952-42d9-bda0-acfaa0d44baa req-b265d9ee-7e15-4299-9549-5f1a7a38d838 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0465491
May 20 04:26:26.605076 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38184b67-a23c-4f1b-9772-8d953c3a79d9 req-0be3d59c-75bb-44d8-a5a6-a709f62a89f6 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:26.608024 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-38184b67-a23c-4f1b-9772-8d953c3a79d9 req-0be3d59c-75bb-44d8-a5a6-a709f62a89f6 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 944 time: 0.1094611
May 20 04:26:26.664051 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-38184b67-a23c-4f1b-9772-8d953c3a79d9 req-838194c8-df5e-47cd-9f98-3d9d65c0252c tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0497563
May 20 04:26:27.904988 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f955cbb1-c3b9-4f48-a8f2-ee0f5d0a69a1 req-f970102d-d80c-480f-a757-ca8258ef262b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:27.906480 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-f955cbb1-c3b9-4f48-a8f2-ee0f5d0a69a1 req-f970102d-d80c-480f-a757-ca8258ef262b service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=ef3bec4745b14484ac8e21cd16cbd11d&device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 1097 time: 0.3056440
May 20 04:26:27.917405 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18a4df5f-ebe6-4d23-bfb7-a67442fae008 req-d7df1b10-5ef5-42c1-a128-c217c45856dc tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:27.918842 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-18a4df5f-ebe6-4d23-bfb7-a67442fae008 req-d7df1b10-5ef5-42c1-a128-c217c45856dc tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 944 time: 0.1120055
May 20 04:26:27.972012 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-18a4df5f-ebe6-4d23-bfb7-a67442fae008 req-8d47d48a-d53e-48fe-835a-6cbf6612b0d0 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0465193
May 20 04:26:29.178200 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40524765-a270-4b0e-af8d-75ffe9e36882 req-4115e102-c493-41ec-bd3f-ce66b59af9e6 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:29.179757 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-40524765-a270-4b0e-af8d-75ffe9e36882 req-4115e102-c493-41ec-bd3f-ce66b59af9e6 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 944 time: 0.0876350
May 20 04:26:29.193757 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f955cbb1-c3b9-4f48-a8f2-ee0f5d0a69a1 req-58709498-d437-4a48-9e4f-c9bc3a95e4a7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:29.195523 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-f955cbb1-c3b9-4f48-a8f2-ee0f5d0a69a1 req-58709498-d437-4a48-9e4f-c9bc3a95e4a7 service neutron] 10.222.0.82 "GET /v2.0/networks?id=21794e86-fda7-40a6-a5a8-db117c7eeb9d HTTP/1.1" status: 200  len: 918 time: 0.1304567
May 20 04:26:29.229574 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-40524765-a270-4b0e-af8d-75ffe9e36882 req-59045091-2353-42da-84fc-60488b80e99e tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0436742
May 20 04:26:29.309192 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-f955cbb1-c3b9-4f48-a8f2-ee0f5d0a69a1 req-9c0635b0-8536-4da3-8fb5-ef7ba9005999 service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=115e1bac-cc4d-40b5-b860-798c85c78924 HTTP/1.1" status: 200  len: 1000 time: 0.1054289
May 20 04:26:29.373378 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f955cbb1-c3b9-4f48-a8f2-ee0f5d0a69a1 req-cdf614c1-5512-4d22-b3be-fa4a5cdb3481 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:29.374914 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-f955cbb1-c3b9-4f48-a8f2-ee0f5d0a69a1 req-cdf614c1-5512-4d22-b3be-fa4a5cdb3481 service neutron] 10.222.0.82 "GET /v2.0/subnets?id=06f38702-3d3c-4e25-8f84-85483d1ddf28 HTTP/1.1" status: 200  len: 856 time: 0.0588500
May 20 04:26:29.458712 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f955cbb1-c3b9-4f48-a8f2-ee0f5d0a69a1 req-70eeece2-a609-4615-80af-a88c24375afe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:29.461023 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-f955cbb1-c3b9-4f48-a8f2-ee0f5d0a69a1 req-70eeece2-a609-4615-80af-a88c24375afe service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=21794e86-fda7-40a6-a5a8-db117c7eeb9d&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0791578
May 20 04:26:29.724360 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-f955cbb1-c3b9-4f48-a8f2-ee0f5d0a69a1 req-0aa1f6cd-9ee7-4316-9f9a-9dc24f74dcf3 service neutron] 10.222.0.82 "GET /v2.0/networks/21794e86-fda7-40a6-a5a8-db117c7eeb9d?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1374817
May 20 04:26:29.860688 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-5612a136-7cc7-4aa6-bb4f-2a1d63201e51 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:26:29.875198 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-f955cbb1-c3b9-4f48-a8f2-ee0f5d0a69a1 req-43055f5d-97bf-4c81-a07d-f21fbcfc4d68 service neutron] 10.222.0.82 "GET /v2.0/networks/21794e86-fda7-40a6-a5a8-db117c7eeb9d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1444020
May 20 04:26:30.068946 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1f74c9b-a1a5-4c46-a80e-94f15d95cf72 req-c12a84cc-6f70-4c01-b2c4-06da401c56da service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:30.070670 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-f1f74c9b-a1a5-4c46-a80e-94f15d95cf72 req-c12a84cc-6f70-4c01-b2c4-06da401c56da service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=ef3bec4745b14484ac8e21cd16cbd11d&device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 1097 time: 0.0810175
May 20 04:26:30.228483 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1f74c9b-a1a5-4c46-a80e-94f15d95cf72 req-c5c900c1-21d3-4b0c-952f-6dce62fcb126 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:30.230196 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-f1f74c9b-a1a5-4c46-a80e-94f15d95cf72 req-c5c900c1-21d3-4b0c-952f-6dce62fcb126 service neutron] 10.222.0.82 "GET /v2.0/networks?id=21794e86-fda7-40a6-a5a8-db117c7eeb9d HTTP/1.1" status: 200  len: 918 time: 0.1357615
May 20 04:26:30.335690 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-f1f74c9b-a1a5-4c46-a80e-94f15d95cf72 req-3f874506-3929-452b-8e6e-5996038d19a2 service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=115e1bac-cc4d-40b5-b860-798c85c78924 HTTP/1.1" status: 200  len: 1000 time: 0.0977924
May 20 04:26:30.427232 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4333d2d8-5682-49af-b12a-47f822561544 req-4e0f2cf3-2021-4d6a-a13e-529662f129aa tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:30.428912 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4333d2d8-5682-49af-b12a-47f822561544 req-4e0f2cf3-2021-4d6a-a13e-529662f129aa tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 944 time: 0.0855138
May 20 04:26:30.491110 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4333d2d8-5682-49af-b12a-47f822561544 req-e638c0d0-b0e6-48d2-a86f-be0799a2ae8c tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0557308
May 20 04:26:31.691721 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cecbf81-4d42-413f-a1c0-e144d9751aa6 req-641e8335-9ff7-44fe-a985-ad99fedd1435 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:31.693213 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-1cecbf81-4d42-413f-a1c0-e144d9751aa6 req-641e8335-9ff7-44fe-a985-ad99fedd1435 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 944 time: 0.0836599
May 20 04:26:31.743629 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-1cecbf81-4d42-413f-a1c0-e144d9751aa6 req-237ea65e-ef1c-4d42-82d9-6c4d5186ece0 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0441060
May 20 04:26:32.554303 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:26:32.690457 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f6a7de2a-fd9d-4c6c-b8e3-01fbadaff0b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:26:33.040914 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59c96606-f5f5-4cbb-8f8b-7b03fb867c6f req-6f483c39-4979-41fa-bfba-2570c884837a tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:33.042515 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-59c96606-f5f5-4cbb-8f8b-7b03fb867c6f req-6f483c39-4979-41fa-bfba-2570c884837a tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 944 time: 0.1714072
May 20 04:26:33.089145 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-59c96606-f5f5-4cbb-8f8b-7b03fb867c6f req-d003f158-95a5-42f1-8e47-be2540f5f5a8 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0404413
May 20 04:26:33.328630 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ea4803bd-878f-47d5-9084-1ec41953c9db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:26:33.684564 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:26:34.316003 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d29a6582-e6b8-47c4-98a8-e6ac7cd7ff59 req-07b2a4d0-54ea-4569-94a3-3ec64b1b24b0 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:34.320041 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-d29a6582-e6b8-47c4-98a8-e6ac7cd7ff59 req-07b2a4d0-54ea-4569-94a3-3ec64b1b24b0 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 944 time: 0.1063085
May 20 04:26:34.386885 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-d29a6582-e6b8-47c4-98a8-e6ac7cd7ff59 req-4de1769f-fc6b-48b4-a5dc-072bf46da642 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0588129
May 20 04:26:35.195620 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f21320cc-6a25-4ec1-8a32-8b119b35fd55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:26:35.617566 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13806ef9-38e2-42d2-8702-3a81bf787366 req-017bbaa1-3441-4155-b691-97171bd9ae0c tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:35.620111 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-13806ef9-38e2-42d2-8702-3a81bf787366 req-017bbaa1-3441-4155-b691-97171bd9ae0c tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 944 time: 0.1004043
May 20 04:26:35.677237 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-13806ef9-38e2-42d2-8702-3a81bf787366 req-cab0e2b8-bcd0-46d4-956a-a4a08ceeb8f5 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0509021
May 20 04:26:36.892050 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07e61d9f-e086-4370-b1f6-694832237220 req-5cb2af32-ec4d-4e9f-95d2-8f49666841ce tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:36.893773 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-07e61d9f-e086-4370-b1f6-694832237220 req-5cb2af32-ec4d-4e9f-95d2-8f49666841ce tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 944 time: 0.0985806
May 20 04:26:36.947509 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-07e61d9f-e086-4370-b1f6-694832237220 req-9ac857c4-a6e5-4519-891e-2d0051e5770f tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0473740
May 20 04:26:38.213505 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71357b4a-b7a7-495b-961b-e3cb1960ec0f req-4abb7186-e209-4919-a585-b0d43cbe076c tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:38.215192 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-71357b4a-b7a7-495b-961b-e3cb1960ec0f req-4abb7186-e209-4919-a585-b0d43cbe076c tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 944 time: 0.0856318
May 20 04:26:38.262914 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-71357b4a-b7a7-495b-961b-e3cb1960ec0f req-045314d0-4b1d-4375-9bd4-69669604ff16 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0416062
May 20 04:26:39.154201 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3d374a5-034d-4af2-9644-9d32f4a5ebb1 req-bb86dfba-7eb9-4c4c-b4cb-6b518feff41f tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:39.156100 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-e3d374a5-034d-4af2-9644-9d32f4a5ebb1 req-bb86dfba-7eb9-4c4c-b4cb-6b518feff41f tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=738599b3-020d-4bc8-be0e-66c28772e5ca HTTP/1.1" status: 200  len: 946 time: 0.1390452
May 20 04:26:39.213339 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-e3d374a5-034d-4af2-9644-9d32f4a5ebb1 req-abf7606b-b05a-4ba6-82bf-6898723f44c4 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0501945
May 20 04:26:39.513319 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17fd514b-a123-43f1-87fb-86c5705a2fb9 req-3794a07a-d3d4-4c8c-9815-7e88f69916b0 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:39.515123 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-17fd514b-a123-43f1-87fb-86c5705a2fb9 req-3794a07a-d3d4-4c8c-9815-7e88f69916b0 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 944 time: 0.1085370
May 20 04:26:39.583281 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-17fd514b-a123-43f1-87fb-86c5705a2fb9 req-9cb88c61-d123-47e6-8aac-7b46f3f71ea2 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0602093
May 20 04:26:40.427402 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbc8e067-8c21-4f54-9e27-591f229325e1 req-37046e65-b7cf-4d1a-ab6d-4d63acbba870 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:40.428891 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-bbc8e067-8c21-4f54-9e27-591f229325e1 req-37046e65-b7cf-4d1a-ab6d-4d63acbba870 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=738599b3-020d-4bc8-be0e-66c28772e5ca HTTP/1.1" status: 200  len: 946 time: 0.0864663
May 20 04:26:40.478263 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-bbc8e067-8c21-4f54-9e27-591f229325e1 req-73efd127-8f6f-47f5-85ad-0c9ee6ecd9d2 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0429056
May 20 04:26:40.828394 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84158dbf-2d6a-4a43-adc7-33830680c727 req-284a47f8-67f4-4c15-bee8-f7019fdf3f50 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:40.841625 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-84158dbf-2d6a-4a43-adc7-33830680c727 req-284a47f8-67f4-4c15-bee8-f7019fdf3f50 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 944 time: 0.1265218
May 20 04:26:40.900072 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-84158dbf-2d6a-4a43-adc7-33830680c727 req-15878467-8fe8-42bf-b9b8-fba2220ccac8 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0461779
May 20 04:26:41.900635 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e104297-9288-4722-9f98-d7cfd4a965d7 req-0a614dbe-8766-4bc1-b15d-22cf09566191 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:41.905660 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-7e104297-9288-4722-9f98-d7cfd4a965d7 req-0a614dbe-8766-4bc1-b15d-22cf09566191 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=738599b3-020d-4bc8-be0e-66c28772e5ca HTTP/1.1" status: 200  len: 946 time: 0.1453378
May 20 04:26:41.989831 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-7e104297-9288-4722-9f98-d7cfd4a965d7 req-444f571e-033f-4ef9-a82d-0e045376e9a9 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0721734
May 20 04:26:42.136699 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecd45829-9092-4f54-b6e0-8bbad0b51984 req-5ca5afcd-7a14-44be-848a-f2a6ac937046 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:42.138548 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-ecd45829-9092-4f54-b6e0-8bbad0b51984 req-5ca5afcd-7a14-44be-848a-f2a6ac937046 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 944 time: 0.0885437
May 20 04:26:42.202235 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-ecd45829-9092-4f54-b6e0-8bbad0b51984 req-a5303d72-326f-463e-b021-c1ae5147cb42 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0566142
May 20 04:26:43.205204 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc22e748-5686-48b5-976d-b2a8e1548824 req-b06dc4ca-8fc2-4932-80af-2cd8d6ac8576 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:43.206716 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-fc22e748-5686-48b5-976d-b2a8e1548824 req-b06dc4ca-8fc2-4932-80af-2cd8d6ac8576 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=738599b3-020d-4bc8-be0e-66c28772e5ca HTTP/1.1" status: 200  len: 946 time: 0.0899282
May 20 04:26:43.257138 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-fc22e748-5686-48b5-976d-b2a8e1548824 req-8f4c2cf2-c3f7-4f74-aaa1-323e541ccde0 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0443420
May 20 04:26:43.409451 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09185aa5-3695-49a5-9879-2c75b9b7ecae req-032155fa-2bb3-4b39-bd4e-00930877a551 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:43.411786 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-09185aa5-3695-49a5-9879-2c75b9b7ecae req-032155fa-2bb3-4b39-bd4e-00930877a551 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 944 time: 0.0920131
May 20 04:26:43.471190 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-09185aa5-3695-49a5-9879-2c75b9b7ecae req-1e1cceb7-f0b7-444a-bc9f-4811ea8c97f7 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0488236
May 20 04:26:44.538119 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97ec46a9-7fa6-40c9-825a-1152bfa82a97 req-b748a903-87e3-4c21-be01-8d245b40c51d tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:44.539723 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-97ec46a9-7fa6-40c9-825a-1152bfa82a97 req-b748a903-87e3-4c21-be01-8d245b40c51d tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=738599b3-020d-4bc8-be0e-66c28772e5ca HTTP/1.1" status: 200  len: 946 time: 0.1197588
May 20 04:26:44.592649 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-97ec46a9-7fa6-40c9-825a-1152bfa82a97 req-24cbe0f1-2ac2-4ac9-b826-4f4eec4071e1 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0465183
May 20 04:26:44.677788 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64919a39-4eba-4e55-a0ca-137689dfd85a req-0984f7fb-3010-4235-a35b-c37b0513fa78 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:44.679413 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-64919a39-4eba-4e55-a0ca-137689dfd85a req-0984f7fb-3010-4235-a35b-c37b0513fa78 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 944 time: 0.0861740
May 20 04:26:44.731251 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-64919a39-4eba-4e55-a0ca-137689dfd85a req-3d60dcb3-b72c-4c5f-858b-ad0295bd7381 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0458605
May 20 04:26:45.793235 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3989bff6-ec54-4de4-a33d-9f18b0a5d38a req-a620d8dc-403b-4e3f-a272-90f14a252b89 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:45.794749 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-3989bff6-ec54-4de4-a33d-9f18b0a5d38a req-a620d8dc-403b-4e3f-a272-90f14a252b89 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=738599b3-020d-4bc8-be0e-66c28772e5ca HTTP/1.1" status: 200  len: 946 time: 0.0894864
May 20 04:26:45.847078 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-3989bff6-ec54-4de4-a33d-9f18b0a5d38a req-b9fd9022-9c2f-4273-bae7-b9d303c04b56 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0460460
May 20 04:26:46.052598 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5ca5126-1f32-4d1c-99c5-3901e10eb0ad req-9cde85d1-a131-40dc-8c64-7a30b918a278 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:46.054095 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-c5ca5126-1f32-4d1c-99c5-3901e10eb0ad req-9cde85d1-a131-40dc-8c64-7a30b918a278 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 944 time: 0.1762655
May 20 04:26:46.101938 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-c5ca5126-1f32-4d1c-99c5-3901e10eb0ad req-cbfa379c-f8e3-4600-8feb-f983da1b2c71 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0415299
May 20 04:26:47.081165 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f2f8f14-0f40-4333-936d-37b964839342 req-b9013b60-8e64-4321-992a-13821f097c29 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:47.082566 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4f2f8f14-0f40-4333-936d-37b964839342 req-b9013b60-8e64-4321-992a-13821f097c29 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=738599b3-020d-4bc8-be0e-66c28772e5ca HTTP/1.1" status: 200  len: 946 time: 0.0934145
May 20 04:26:47.144003 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4f2f8f14-0f40-4333-936d-37b964839342 req-06dc294c-3b0b-4186-87ea-7cc3b63891bb tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0512404
May 20 04:26:47.318448 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-325af383-463d-4427-bc0d-62c23af277be req-f1de158e-edb3-4cce-a288-14de29909d7e tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:47.320776 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-325af383-463d-4427-bc0d-62c23af277be req-f1de158e-edb3-4cce-a288-14de29909d7e tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 944 time: 0.0893083
May 20 04:26:47.371674 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-325af383-463d-4427-bc0d-62c23af277be req-35db6c52-1fc0-46f6-aaba-1ef68e53546c tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0406249
May 20 04:26:48.342242 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d99c02fe-faab-4ac7-ac46-5448e7a6d19c req-c65bc293-71b3-4b47-a974-9291295fa494 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:48.343827 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-d99c02fe-faab-4ac7-ac46-5448e7a6d19c req-c65bc293-71b3-4b47-a974-9291295fa494 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=738599b3-020d-4bc8-be0e-66c28772e5ca HTTP/1.1" status: 200  len: 946 time: 0.0838060
May 20 04:26:48.394051 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-d99c02fe-faab-4ac7-ac46-5448e7a6d19c req-eec9cbbc-b14d-4693-a067-12459290fd23 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0436680
May 20 04:26:48.574696 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2dcc5153-9fd7-4105-be0d-cc162e5fe113 req-4d8b5f70-9c57-4ec5-8bad-5048c844ebfb tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:48.576156 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-2dcc5153-9fd7-4105-be0d-cc162e5fe113 req-4d8b5f70-9c57-4ec5-8bad-5048c844ebfb tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 944 time: 0.0880234
May 20 04:26:48.625108 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-2dcc5153-9fd7-4105-be0d-cc162e5fe113 req-1180c379-3efd-4f5f-affe-a9dfaa732564 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0430031
May 20 04:26:49.619959 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aed7308b-54ad-462c-bb7b-16c01221e9d4 req-6bca6c9f-b7e5-47a0-95dc-e60af17ccd2a tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:49.621507 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-aed7308b-54ad-462c-bb7b-16c01221e9d4 req-6bca6c9f-b7e5-47a0-95dc-e60af17ccd2a tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=738599b3-020d-4bc8-be0e-66c28772e5ca HTTP/1.1" status: 200  len: 946 time: 0.1007440
May 20 04:26:49.671067 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-aed7308b-54ad-462c-bb7b-16c01221e9d4 req-20eb1c99-047c-400a-b94b-44a31dde98f0 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0430138
May 20 04:26:49.782083 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 42500) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:26:49.835881 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc1a3696-64cb-4c38-8b65-528cdde9a558 req-bb3e833e-58b4-4ffa-8940-207620dcaebe tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:49.837392 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-dc1a3696-64cb-4c38-8b65-528cdde9a558 req-bb3e833e-58b4-4ffa-8940-207620dcaebe tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 944 time: 0.0869565
May 20 04:26:49.902807 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-dc1a3696-64cb-4c38-8b65-528cdde9a558 req-1a06036e-9ba1-4eaf-8337-db4f1cafc3dd tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0595911
May 20 04:26:49.947347 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-7fa267a5-0e50-4d3e-b32d-bd276519dae8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:26:49.962965 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-7fa267a5-0e50-4d3e-b32d-bd276519dae8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:26:49.967121 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-7fa267a5-0e50-4d3e-b32d-bd276519dae8 admin admin] Usage tracker for resource:security_group_rule and tenant:fa43a009c99a4a1ab55af1df7137185d is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:26:49.970320 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-7fa267a5-0e50-4d3e-b32d-bd276519dae8 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:26:49.976234 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-7fa267a5-0e50-4d3e-b32d-bd276519dae8 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:26:50.073999 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-7fa267a5-0e50-4d3e-b32d-bd276519dae8 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:26:50.080161 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-7fa267a5-0e50-4d3e-b32d-bd276519dae8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:26:50.089527 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-b18a6785-b5f3-4f4e-90d6-2f8b1bd16550 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:26:50.132896 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-7fa267a5-0e50-4d3e-b32d-bd276519dae8 admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=fa43a009c99a4a1ab55af1df7137185d&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3495564
May 20 04:26:50.134609 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fa267a5-0e50-4d3e-b32d-bd276519dae8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=27b1354c-c46b-434f-b8d1-636f80a460f8,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:26:50.135716 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 42512) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:26:50.144126 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fa267a5-0e50-4d3e-b32d-bd276519dae8 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:26:50.144126 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fa267a5-0e50-4d3e-b32d-bd276519dae8 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:26:50.144126 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fa267a5-0e50-4d3e-b32d-bd276519dae8 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:26:50.144126 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fa267a5-0e50-4d3e-b32d-bd276519dae8 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:26:50.144126 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fa267a5-0e50-4d3e-b32d-bd276519dae8 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:26:50.144126 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fa267a5-0e50-4d3e-b32d-bd276519dae8 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:26:50.144841 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fa267a5-0e50-4d3e-b32d-bd276519dae8 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:26:50.144841 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fa267a5-0e50-4d3e-b32d-bd276519dae8 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:26:50.145045 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fa267a5-0e50-4d3e-b32d-bd276519dae8 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:26:50.145280 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fa267a5-0e50-4d3e-b32d-bd276519dae8 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:26:50.145634 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fa267a5-0e50-4d3e-b32d-bd276519dae8 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:26:50.145960 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fa267a5-0e50-4d3e-b32d-bd276519dae8 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:26:50.150122 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-7fa267a5-0e50-4d3e-b32d-bd276519dae8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:26:50.198637 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-5735808b-b0ee-4622-b7c2-e642851d7269 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:26:50.238557 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-5735808b-b0ee-4622-b7c2-e642851d7269 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:26:50.299827 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-5735808b-b0ee-4622-b7c2-e642851d7269 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:26:50.303776 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-18fd85f2-b085-4191-b532-997c180257cf admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:26:50.316705 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5735808b-b0ee-4622-b7c2-e642851d7269 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=27b1354c-c46b-434f-b8d1-636f80a460f8,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:26:50.324621 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5735808b-b0ee-4622-b7c2-e642851d7269 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:26:50.324983 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5735808b-b0ee-4622-b7c2-e642851d7269 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:26:50.325352 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5735808b-b0ee-4622-b7c2-e642851d7269 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:26:50.325709 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5735808b-b0ee-4622-b7c2-e642851d7269 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:26:50.326055 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5735808b-b0ee-4622-b7c2-e642851d7269 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:26:50.326407 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5735808b-b0ee-4622-b7c2-e642851d7269 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:26:50.326754 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5735808b-b0ee-4622-b7c2-e642851d7269 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:26:50.327108 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5735808b-b0ee-4622-b7c2-e642851d7269 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:26:50.327456 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5735808b-b0ee-4622-b7c2-e642851d7269 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:26:50.327799 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5735808b-b0ee-4622-b7c2-e642851d7269 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:26:50.328141 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5735808b-b0ee-4622-b7c2-e642851d7269 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:26:50.328540 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5735808b-b0ee-4622-b7c2-e642851d7269 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:26:50.332058 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-5735808b-b0ee-4622-b7c2-e642851d7269 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:26:50.341178 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-5735808b-b0ee-4622-b7c2-e642851d7269 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:26:50.342295 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-5735808b-b0ee-4622-b7c2-e642851d7269 admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/27b1354c-c46b-434f-b8d1-636f80a460f8 HTTP/1.1" status: 204  len: 168 time: 0.2056029
May 20 04:26:50.663481 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 42520) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:26:50.682363 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-3ed7f35d-851e-473e-95c6-6ba70a90947e admin admin] Notify callbacks [] for security_group, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:26:50.701185 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-3ed7f35d-851e-473e-95c6-6ba70a90947e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:26:50.707589 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-3ed7f35d-851e-473e-95c6-6ba70a90947e admin admin] Usage tracker for resource:security_group_rule and tenant:1779efda4fcf489e93d0008af1a27a33 is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:26:50.712050 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-3ed7f35d-851e-473e-95c6-6ba70a90947e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:26:50.718474 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-3ed7f35d-851e-473e-95c6-6ba70a90947e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:26:50.848668 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-3ed7f35d-851e-473e-95c6-6ba70a90947e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:26:50.856164 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-3ed7f35d-851e-473e-95c6-6ba70a90947e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:26:50.864272 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-71983a4f-0bb3-4ea7-aff0-d1b6a4f86b5b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:26:50.917552 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ed7f35d-851e-473e-95c6-6ba70a90947e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=410ecc1c-b59a-4ecc-b5b7-092b7214631b,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:26:50.922896 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-3ed7f35d-851e-473e-95c6-6ba70a90947e admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=1779efda4fcf489e93d0008af1a27a33&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2583845
May 20 04:26:50.923826 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-3ed7f35d-851e-473e-95c6-6ba70a90947e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:26:50.925745 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 42526) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:26:50.979461 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0caca98-8552-4ef2-b690-3663773c8401 req-417dcc91-0b1b-4599-ba61-ccd65270d4b6 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:50.980785 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-f0caca98-8552-4ef2-b690-3663773c8401 req-417dcc91-0b1b-4599-ba61-ccd65270d4b6 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=738599b3-020d-4bc8-be0e-66c28772e5ca HTTP/1.1" status: 200  len: 946 time: 0.1734931
May 20 04:26:51.024095 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-776395ae-3df9-4a02-b7b1-3bfde1657b0a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:26:51.063210 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-f0caca98-8552-4ef2-b690-3663773c8401 req-c805c7cf-caaa-4be8-81e3-7a57b4058a67 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0751643
May 20 04:26:51.072234 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-776395ae-3df9-4a02-b7b1-3bfde1657b0a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:26:51.107753 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76d657b6-7aa7-4993-b5ae-134627f2a02c req-e024ccca-8d23-46d2-aba1-f8d355966330 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:51.109148 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-76d657b6-7aa7-4993-b5ae-134627f2a02c req-e024ccca-8d23-46d2-aba1-f8d355966330 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 944 time: 0.0881155
May 20 04:26:51.140755 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-776395ae-3df9-4a02-b7b1-3bfde1657b0a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:26:51.146786 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-7fa267a5-0e50-4d3e-b32d-bd276519dae8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:26:51.161790 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-776395ae-3df9-4a02-b7b1-3bfde1657b0a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=410ecc1c-b59a-4ecc-b5b7-092b7214631b,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:26:51.165500 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-776395ae-3df9-4a02-b7b1-3bfde1657b0a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:26:51.171265 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-776395ae-3df9-4a02-b7b1-3bfde1657b0a admin admin] Notify callbacks [] for security_group, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:26:51.172435 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-776395ae-3df9-4a02-b7b1-3bfde1657b0a admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/410ecc1c-b59a-4ecc-b5b7-092b7214631b HTTP/1.1" status: 204  len: 168 time: 0.2457364
May 20 04:26:51.173539 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-76d657b6-7aa7-4993-b5ae-134627f2a02c req-ddb46720-d52c-4af5-8ba3-039b7bc065ba tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0581212
May 20 04:26:52.267317 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9290447c-6822-4dee-b177-46f8fe5aa395 req-bad094c7-7eb7-4b97-9496-0b31ff90e8e6 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:52.269118 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-9290447c-6822-4dee-b177-46f8fe5aa395 req-bad094c7-7eb7-4b97-9496-0b31ff90e8e6 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=738599b3-020d-4bc8-be0e-66c28772e5ca HTTP/1.1" status: 200  len: 946 time: 0.0876954
May 20 04:26:52.317345 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-9290447c-6822-4dee-b177-46f8fe5aa395 req-a6917f64-5105-418e-9fe3-bfb9b0731844 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0409596
May 20 04:26:52.376382 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e02bb741-dcc7-4061-bf31-d80228483a9d req-111c43ae-96a9-460c-915c-2b8e1175fc90 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:52.377901 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-e02bb741-dcc7-4061-bf31-d80228483a9d req-111c43ae-96a9-460c-915c-2b8e1175fc90 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 944 time: 0.0897102
May 20 04:26:52.423621 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-e02bb741-dcc7-4061-bf31-d80228483a9d req-9761d880-200c-4280-aa8e-432c24374563 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0396883
May 20 04:26:52.738854 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1f74c9b-a1a5-4c46-a80e-94f15d95cf72 req-1cb58b6d-0ee0-4550-94a3-e2b62c092cd9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:52.740434 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-f1f74c9b-a1a5-4c46-a80e-94f15d95cf72 req-1cb58b6d-0ee0-4550-94a3-e2b62c092cd9 service neutron] 10.222.0.82 "GET /v2.0/subnets?id=06f38702-3d3c-4e25-8f84-85483d1ddf28 HTTP/1.1" status: 200  len: 856 time: 0.1131585
May 20 04:26:52.948430 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1f74c9b-a1a5-4c46-a80e-94f15d95cf72 req-1bba92c3-c619-49bf-8813-e8783bc98188 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:52.949953 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-f1f74c9b-a1a5-4c46-a80e-94f15d95cf72 req-1bba92c3-c619-49bf-8813-e8783bc98188 service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=21794e86-fda7-40a6-a5a8-db117c7eeb9d&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1941166
May 20 04:26:53.088625 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-f1f74c9b-a1a5-4c46-a80e-94f15d95cf72 req-5bcb97b5-717a-474d-98f6-b6b7949390e0 service neutron] 10.222.0.82 "GET /v2.0/networks/21794e86-fda7-40a6-a5a8-db117c7eeb9d?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1313112
May 20 04:26:53.241082 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-f1f74c9b-a1a5-4c46-a80e-94f15d95cf72 req-d700f044-9d6c-4ae6-a1cd-3065affe33c3 service neutron] 10.222.0.82 "GET /v2.0/networks/21794e86-fda7-40a6-a5a8-db117c7eeb9d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1443441
May 20 04:26:53.514475 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5e992c5-2a78-4d49-917c-3ad75685e966 req-34f0734c-9bdf-4d6e-8b9d-2c215949cd00 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:53.515943 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-a5e992c5-2a78-4d49-917c-3ad75685e966 req-34f0734c-9bdf-4d6e-8b9d-2c215949cd00 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=738599b3-020d-4bc8-be0e-66c28772e5ca HTTP/1.1" status: 200  len: 946 time: 0.0830863
May 20 04:26:53.568736 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-a5e992c5-2a78-4d49-917c-3ad75685e966 req-87c95e0d-d27d-4843-a650-0169a25965fb tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0454385
May 20 04:26:53.625820 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36d6ebe7-03a6-4975-9ee3-8b4823d0be08 req-305da30a-e4de-4c7e-a8d4-2cfba62e92eb tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:53.627187 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-36d6ebe7-03a6-4975-9ee3-8b4823d0be08 req-305da30a-e4de-4c7e-a8d4-2cfba62e92eb tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 944 time: 0.0869727
May 20 04:26:53.675428 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-36d6ebe7-03a6-4975-9ee3-8b4823d0be08 req-276b61f1-201b-4aac-9881-66c1e8fa88f9 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0423961
May 20 04:26:54.773155 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d77e416-9872-44dd-bf24-130629e0c6b3 req-a3c0971e-02e9-4e58-8bf0-1ef0355c56ea tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:54.775513 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-4d77e416-9872-44dd-bf24-130629e0c6b3 req-a3c0971e-02e9-4e58-8bf0-1ef0355c56ea tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=738599b3-020d-4bc8-be0e-66c28772e5ca HTTP/1.1" status: 200  len: 946 time: 0.0965028
May 20 04:26:54.826467 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-4d77e416-9872-44dd-bf24-130629e0c6b3 req-f36bcd86-9234-4664-ae4a-c55d120ae059 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0449741
May 20 04:26:54.904807 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4abbfd28-cafe-490e-bdd5-8dc4b601e6b6 req-998261ea-9624-4747-b79c-bc1e988b2baf tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:54.906612 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4abbfd28-cafe-490e-bdd5-8dc4b601e6b6 req-998261ea-9624-4747-b79c-bc1e988b2baf tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 944 time: 0.0990424
May 20 04:26:54.986727 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4abbfd28-cafe-490e-bdd5-8dc4b601e6b6 req-3fc9adfd-c5b5-4bb3-9fdc-7c0a342d7814 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0687463
May 20 04:26:55.296975 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f85c1e24-17a0-4808-a248-79a79d745265 req-b1f81866-4225-469a-bf39-ca0807d874f9 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:55.298443 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-f85c1e24-17a0-4808-a248-79a79d745265 req-b1f81866-4225-469a-bf39-ca0807d874f9 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.71 "GET /v2.0/ports?device_id=e503d184-7bd9-4052-b1a1-8cd725e700e4 HTTP/1.1" status: 200  len: 945 time: 0.0861099
May 20 04:26:55.348013 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-f85c1e24-17a0-4808-a248-79a79d745265 req-511d15c3-b544-48ca-9904-43bfb71ae22f tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.71 "GET /v2.0/security-groups?id=e79e4ba4-358f-4b35-b5f3-7372b5116def&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0409281
May 20 04:26:55.430567 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35079d5d-f5e1-488f-a694-3ca8923484ed req-f3652cc2-ed4d-4458-a39a-75765f9996a4 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:55.431900 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-35079d5d-f5e1-488f-a694-3ca8923484ed req-f3652cc2-ed4d-4458-a39a-75765f9996a4 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.82 "GET /v2.0/ports?device_id=738599b3-020d-4bc8-be0e-66c28772e5ca HTTP/1.1" status: 200  len: 946 time: 0.0812762
May 20 04:26:55.579210 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [req-35079d5d-f5e1-488f-a694-3ca8923484ed req-9a04924e-fbdd-4855-8cb2-2221886789b7 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Deleting port d51370ee-559c-4eaa-8242-891121de4717 {{(pid=91687) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 04:26:55.579530 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-35079d5d-f5e1-488f-a694-3ca8923484ed req-9a04924e-fbdd-4855-8cb2-2221886789b7 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8782892520551'] for port, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:26:55.717876 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [req-35079d5d-f5e1-488f-a694-3ca8923484ed req-9a04924e-fbdd-4855-8cb2-2221886789b7 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] For port d51370ee-559c-4eaa-8242-891121de4717, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=d51370ee-559c-4eaa-8242-891121de4717,segment=NetworkSegment(0ad1d987-000a-4092-8d15-811f90922b00),segment_id=0ad1d987-000a-4092-8d15-811f90922b00)] {{(pid=91687) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:26:55.718115 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-35079d5d-f5e1-488f-a694-3ca8923484ed req-9a04924e-fbdd-4855-8cb2-2221886789b7 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1718922'] for port, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:26:55.848063 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [req-35079d5d-f5e1-488f-a694-3ca8923484ed req-9a04924e-fbdd-4855-8cb2-2221886789b7 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Calling delete_port for d51370ee-559c-4eaa-8242-891121de4717 owned by compute:nova {{(pid=91687) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 04:26:56.007536 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-35079d5d-f5e1-488f-a694-3ca8923484ed req-9a04924e-fbdd-4855-8cb2-2221886789b7 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8782892522936', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8782892108804', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4162192'] for port, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:26:56.014320 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:26:56.024180 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] get_ports_and_sgs() called for port_ids ['9a903ca5-2762-405a-81bb-5c3dce3d256a', 'c84df5e2-cd07-4d01-87c9-ec3a35e2ad93', '367f8cc3-bd5c-4497-8fc5-2b73175a0939', 'd51370ee-559c-4eaa-8242-891121de4717'] {{(pid=91688) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 04:26:56.053955 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-af92c6a7-05c3-4be1-8d2a-91408d900313 req-6d3f938e-a479-4228-b2f7-aaf6df09b1a1 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=738599b3-020d-4bc8-be0e-66c28772e5ca HTTP/1.1" status: 200  len: 210 time: 0.0615377
May 20 04:26:56.085710 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a04924e-fbdd-4855-8cb2-2221886789b7 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Pushing event deleted for resources: {'Port': ['ID=d51370ee-559c-4eaa-8242-891121de4717,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:26:56.093241 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-9a04924e-fbdd-4855-8cb2-2221886789b7 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:26:56.286017 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.l3_dvrscheduler_db [req-35079d5d-f5e1-488f-a694-3ca8923484ed req-9a04924e-fbdd-4855-8cb2-2221886789b7 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] No DVR routers for this DVR port d51370ee-559c-4eaa-8242-891121de4717 on host hv-cinder-79091 {{(pid=91687) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 04:26:56.289222 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-35079d5d-f5e1-488f-a694-3ca8923484ed req-9a04924e-fbdd-4855-8cb2-2221886789b7 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for port, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:26:56.291842 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '738599b3-020d-4bc8-be0e-66c28772e5ca', 'name': 'network-vif-deleted', 'tag': 'd51370ee-559c-4eaa-8242-891121de4717'}] {{(pid=91687) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:26:56.327080 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-35079d5d-f5e1-488f-a694-3ca8923484ed req-9a04924e-fbdd-4855-8cb2-2221886789b7 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.82 "DELETE /v2.0/ports/d51370ee-559c-4eaa-8242-891121de4717 HTTP/1.1" status: 204  len: 173 time: 0.8877823
May 20 04:26:56.356833 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6b98073-0818-4311-84cd-079a311a6506 req-a7e5cbe2-b1df-417b-a894-0aa3774d4b20 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:56.358909 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-d6b98073-0818-4311-84cd-079a311a6506 req-a7e5cbe2-b1df-417b-a894-0aa3774d4b20 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 944 time: 0.1312084
May 20 04:26:56.431928 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-d6b98073-0818-4311-84cd-079a311a6506 req-7b62b14b-4174-4263-866d-bd6e3a1ddd50 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0654147
May 20 04:26:56.522255 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '738599b3-020d-4bc8-be0e-66c28772e5ca', 'name': 'network-vif-deleted', 'tag': 'd51370ee-559c-4eaa-8242-891121de4717', 'status': 'completed', 'code': 200}
May 20 04:26:56.630845 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75e788cd-90ee-450e-a6bd-a3d1bbcadeb4 req-44346efa-182b-4d08-944a-646afd48b825 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:56.632183 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-75e788cd-90ee-450e-a6bd-a3d1bbcadeb4 req-44346efa-182b-4d08-944a-646afd48b825 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.71 "GET /v2.0/ports?device_id=e503d184-7bd9-4052-b1a1-8cd725e700e4 HTTP/1.1" status: 200  len: 945 time: 0.0799689
May 20 04:26:56.678436 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-75e788cd-90ee-450e-a6bd-a3d1bbcadeb4 req-28f20896-ad9e-4a0c-9c98-140cb308f20a tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.71 "GET /v2.0/security-groups?id=e79e4ba4-358f-4b35-b5f3-7372b5116def&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0404255
May 20 04:26:57.483690 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad162c6e-a1a8-4b10-a47f-4dd095d453ca req-ec5cacc7-7969-4e40-acc9-2c27faba114a tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:57.485366 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-ad162c6e-a1a8-4b10-a47f-4dd095d453ca req-ec5cacc7-7969-4e40-acc9-2c27faba114a tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.82 "GET /v2.0/ports?device_id=e503d184-7bd9-4052-b1a1-8cd725e700e4 HTTP/1.1" status: 200  len: 945 time: 0.1804056
May 20 04:26:57.713518 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ebc3978-cae6-4a3d-bf5c-51546a3c00df req-e3fc3b2b-6755-487e-8d1a-2555bebdce1b tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:57.715247 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-7ebc3978-cae6-4a3d-bf5c-51546a3c00df req-e3fc3b2b-6755-487e-8d1a-2555bebdce1b tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 944 time: 0.1591032
May 20 04:26:57.763269 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [req-ad162c6e-a1a8-4b10-a47f-4dd095d453ca req-e0bedb9b-0310-4059-bf44-d206993a4bb0 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Deleting port 66e2d45a-eeae-4758-ad0e-fdb997dca9f5 {{(pid=91687) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 04:26:57.763610 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-ad162c6e-a1a8-4b10-a47f-4dd095d453ca req-e0bedb9b-0310-4059-bf44-d206993a4bb0 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8782892520551'] for port, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:26:57.809151 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-7ebc3978-cae6-4a3d-bf5c-51546a3c00df req-dd7dc26d-9d79-4059-b6a5-cdaced009756 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0867319
May 20 04:26:57.891418 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3a3f77b-8506-4719-a889-5ad927b07b8e req-1d07ab09-1e62-4633-b54a-5ac681ba41bd tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:57.893209 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-d3a3f77b-8506-4719-a889-5ad927b07b8e req-1d07ab09-1e62-4633-b54a-5ac681ba41bd tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.71 "GET /v2.0/ports?device_id=e503d184-7bd9-4052-b1a1-8cd725e700e4 HTTP/1.1" status: 200  len: 945 time: 0.0938978
May 20 04:26:57.938452 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [req-ad162c6e-a1a8-4b10-a47f-4dd095d453ca req-e0bedb9b-0310-4059-bf44-d206993a4bb0 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] For port 66e2d45a-eeae-4758-ad0e-fdb997dca9f5, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=66e2d45a-eeae-4758-ad0e-fdb997dca9f5,segment=NetworkSegment(3cfe6ee0-17fa-47f2-8f37-995aaef6bfdc),segment_id=3cfe6ee0-17fa-47f2-8f37-995aaef6bfdc)] {{(pid=91687) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:26:57.938863 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-ad162c6e-a1a8-4b10-a47f-4dd095d453ca req-e0bedb9b-0310-4059-bf44-d206993a4bb0 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1718922'] for port, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:26:57.944535 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-d3a3f77b-8506-4719-a889-5ad927b07b8e req-40ea8a48-485d-4933-9102-8f452f68a759 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.71 "GET /v2.0/security-groups?id=e79e4ba4-358f-4b35-b5f3-7372b5116def&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0446835
May 20 04:26:58.068746 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [req-ad162c6e-a1a8-4b10-a47f-4dd095d453ca req-e0bedb9b-0310-4059-bf44-d206993a4bb0 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Calling delete_port for 66e2d45a-eeae-4758-ad0e-fdb997dca9f5 owned by compute:nova {{(pid=91687) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 04:26:58.193544 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-ad162c6e-a1a8-4b10-a47f-4dd095d453ca req-e0bedb9b-0310-4059-bf44-d206993a4bb0 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8782892522936', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8782892108804', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4162192'] for port, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:26:58.199303 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-28a1c6c0-5165-4cbe-94a8-9cc2d8e0b4fc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:26:58.206224 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] get_ports_and_sgs() called for port_ids ['66e2d45a-eeae-4758-ad0e-fdb997dca9f5'] {{(pid=91688) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 04:26:58.248689 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0bedb9b-0310-4059-bf44-d206993a4bb0 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Pushing event deleted for resources: {'Port': ['ID=66e2d45a-eeae-4758-ad0e-fdb997dca9f5,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:26:58.252268 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-e0bedb9b-0310-4059-bf44-d206993a4bb0 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:26:58.322947 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.l3_dvrscheduler_db [req-ad162c6e-a1a8-4b10-a47f-4dd095d453ca req-e0bedb9b-0310-4059-bf44-d206993a4bb0 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] No DVR routers for this DVR port 66e2d45a-eeae-4758-ad0e-fdb997dca9f5 on host hv-cinder-79091 {{(pid=91687) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 04:26:58.325804 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-ad162c6e-a1a8-4b10-a47f-4dd095d453ca req-e0bedb9b-0310-4059-bf44-d206993a4bb0 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for port, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:26:58.341252 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-ad162c6e-a1a8-4b10-a47f-4dd095d453ca req-e0bedb9b-0310-4059-bf44-d206993a4bb0 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.82 "DELETE /v2.0/ports/66e2d45a-eeae-4758-ad0e-fdb997dca9f5 HTTP/1.1" status: 204  len: 173 time: 0.8471053
May 20 04:26:58.523649 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e503d184-7bd9-4052-b1a1-8cd725e700e4', 'name': 'network-vif-deleted', 'tag': '66e2d45a-eeae-4758-ad0e-fdb997dca9f5'}] {{(pid=91687) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:26:58.580029 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e503d184-7bd9-4052-b1a1-8cd725e700e4', 'name': 'network-vif-deleted', 'tag': '66e2d45a-eeae-4758-ad0e-fdb997dca9f5', 'status': 'completed', 'code': 200}
May 20 04:26:58.806892 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce309ffa-c7b1-420f-929a-56ebccbd24b8 req-f562816c-89e8-4711-aca7-565889f277b1 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:58.808579 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-ce309ffa-c7b1-420f-929a-56ebccbd24b8 req-f562816c-89e8-4711-aca7-565889f277b1 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=69d5fa5c-ad33-4afb-bf39-39cd00f6030c HTTP/1.1" status: 200  len: 945 time: 0.0985446
May 20 04:26:58.861217 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-ce309ffa-c7b1-420f-929a-56ebccbd24b8 req-a06713c7-5047-4a7c-8d9d-49b9ed7f5a8e tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0463786
May 20 04:26:59.039163 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0aaaf6d-4ae9-4567-b398-7e5688721ca3 req-b197a99c-1c49-4c4b-9f70-027722d15467 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:26:59.040656 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-f0aaaf6d-4ae9-4567-b398-7e5688721ca3 req-b197a99c-1c49-4c4b-9f70-027722d15467 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 944 time: 0.0960903
May 20 04:26:59.089157 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-f0aaaf6d-4ae9-4567-b398-7e5688721ca3 req-c13d6b4c-a835-4487-97a5-5820e22ec737 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0423324
May 20 04:26:59.136012 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-44313b38-620f-4462-a1aa-1ae045863482 req-47b8979b-a339-4df2-aa0b-7b3dd1489de9 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.71 "GET /v2.0/ports?device_id=e503d184-7bd9-4052-b1a1-8cd725e700e4 HTTP/1.1" status: 200  len: 210 time: 0.0447600
May 20 04:26:59.858359 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-bc76d805-d9cf-4774-96fc-b34c78f29707 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:00.050128 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3e7ade2-4017-479d-8c5a-231230a3a5d7 req-f6be9f5a-736d-44f8-ae2c-36f6868dd836 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:00.050961 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-d3e7ade2-4017-479d-8c5a-231230a3a5d7 req-f6be9f5a-736d-44f8-ae2c-36f6868dd836 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Synchronizing usage tracker for tenant:6484c55ce8204dc3802efc929a51c4a5 on resource:port {{(pid=91687) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:27:00.068493 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-d3e7ade2-4017-479d-8c5a-231230a3a5d7 req-f6be9f5a-736d-44f8-ae2c-36f6868dd836 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Unset dirty status for tenant:6484c55ce8204dc3802efc929a51c4a5 on resource:port {{(pid=91687) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:27:00.069756 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-d3e7ade2-4017-479d-8c5a-231230a3a5d7 req-f6be9f5a-736d-44f8-ae2c-36f6868dd836 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=69d5fa5c-ad33-4afb-bf39-39cd00f6030c HTTP/1.1" status: 200  len: 945 time: 0.1020403
May 20 04:27:00.120717 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-d3e7ade2-4017-479d-8c5a-231230a3a5d7 req-b481efec-bf75-40db-b9d4-fd79c086bd5b tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0448351
May 20 04:27:00.294290 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 66e2d45a-eeae-4758-ad0e-fdb997dca9f5 no longer exists at agent hyperv_hv-cinder-79091 {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 04:27:00.297123 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7de05887-05a5-4a64-a401-354b7a2d0014 req-92b5f3b2-9f2e-48e4-91c6-a7b0cf8bd70a tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:00.298677 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-7de05887-05a5-4a64-a401-354b7a2d0014 req-92b5f3b2-9f2e-48e4-91c6-a7b0cf8bd70a tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 944 time: 0.0873156
May 20 04:27:00.331586 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] No Port match for: 66e2d45a-eeae-4758-ad0e-fdb997dca9f5 {{(pid=91688) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 04:27:00.332106 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 66e2d45a-eeae-4758-ad0e-fdb997dca9f5 not bound to the agent host hv-cinder-79091 {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 04:27:00.332311 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device d51370ee-559c-4eaa-8242-891121de4717 no longer exists at agent hyperv_hv-cinder-79091 {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 04:27:00.359673 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-7de05887-05a5-4a64-a401-354b7a2d0014 req-f28651fb-0ef5-427e-a995-823a10e18ec8 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0543067
May 20 04:27:00.365881 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] No Port match for: d51370ee-559c-4eaa-8242-891121de4717 {{(pid=91688) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 04:27:00.366541 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device d51370ee-559c-4eaa-8242-891121de4717 not bound to the agent host hv-cinder-79091 {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 04:27:01.073750 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3373e4ae-94a9-42e3-8793-727a8284c07d req-1f5a3eaa-bd3a-4fe8-8d93-ca8a18c538a5 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:01.075854 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-3373e4ae-94a9-42e3-8793-727a8284c07d req-1f5a3eaa-bd3a-4fe8-8d93-ca8a18c538a5 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.82 "GET /v2.0/ports?device_id=69d5fa5c-ad33-4afb-bf39-39cd00f6030c HTTP/1.1" status: 200  len: 945 time: 0.0852799
May 20 04:27:01.225919 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [req-3373e4ae-94a9-42e3-8793-727a8284c07d req-fd692865-4767-4013-b5e7-d400e955d842 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Deleting port 367f8cc3-bd5c-4497-8fc5-2b73175a0939 {{(pid=91687) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 04:27:01.226230 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-3373e4ae-94a9-42e3-8793-727a8284c07d req-fd692865-4767-4013-b5e7-d400e955d842 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8782892520551'] for port, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:01.410066 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [req-3373e4ae-94a9-42e3-8793-727a8284c07d req-fd692865-4767-4013-b5e7-d400e955d842 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] For port 367f8cc3-bd5c-4497-8fc5-2b73175a0939, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=367f8cc3-bd5c-4497-8fc5-2b73175a0939,segment=NetworkSegment(0ad1d987-000a-4092-8d15-811f90922b00),segment_id=0ad1d987-000a-4092-8d15-811f90922b00)] {{(pid=91687) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:27:01.410421 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-3373e4ae-94a9-42e3-8793-727a8284c07d req-fd692865-4767-4013-b5e7-d400e955d842 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1718922'] for port, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:01.552330 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83763d02-e4dd-42df-95a3-6daa07da8d1a req-804e5b9a-b434-4f5f-9688-add86860325f tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:01.553994 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-83763d02-e4dd-42df-95a3-6daa07da8d1a req-804e5b9a-b434-4f5f-9688-add86860325f tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 944 time: 0.0821743
May 20 04:27:01.606325 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-83763d02-e4dd-42df-95a3-6daa07da8d1a req-2ee744a6-5fe3-4fc9-97bb-a6f63849d79e tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0460868
May 20 04:27:01.614861 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [req-3373e4ae-94a9-42e3-8793-727a8284c07d req-fd692865-4767-4013-b5e7-d400e955d842 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Calling delete_port for 367f8cc3-bd5c-4497-8fc5-2b73175a0939 owned by compute:nova {{(pid=91687) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 04:27:01.635537 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e32aaa58-6b37-4d12-994a-2c72cff8ac7f req-6f6fb529-5f61-4a1f-b5f6-1851d5a698fa tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:01.641155 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-e32aaa58-6b37-4d12-994a-2c72cff8ac7f req-6f6fb529-5f61-4a1f-b5f6-1851d5a698fa tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=69d5fa5c-ad33-4afb-bf39-39cd00f6030c HTTP/1.1" status: 200  len: 945 time: 0.3795533
May 20 04:27:01.698010 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-e32aaa58-6b37-4d12-994a-2c72cff8ac7f req-ebcc066c-be54-411d-b5c0-71bb3255261d tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0540962
May 20 04:27:01.797499 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-3373e4ae-94a9-42e3-8793-727a8284c07d req-fd692865-4767-4013-b5e7-d400e955d842 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8782892522936', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8782892108804', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4162192'] for port, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:01.804077 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-1fbdcfa0-acc0-43fd-a4f6-2b2dfaae1471 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:27:01.854117 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd692865-4767-4013-b5e7-d400e955d842 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Pushing event deleted for resources: {'Port': ['ID=367f8cc3-bd5c-4497-8fc5-2b73175a0939,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:27:01.857417 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-fd692865-4767-4013-b5e7-d400e955d842 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:27:01.934115 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.l3_dvrscheduler_db [req-3373e4ae-94a9-42e3-8793-727a8284c07d req-fd692865-4767-4013-b5e7-d400e955d842 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] No DVR routers for this DVR port 367f8cc3-bd5c-4497-8fc5-2b73175a0939 on host hv-cinder-79091 {{(pid=91687) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 04:27:01.936749 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-3373e4ae-94a9-42e3-8793-727a8284c07d req-fd692865-4767-4013-b5e7-d400e955d842 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for port, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:01.939494 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '69d5fa5c-ad33-4afb-bf39-39cd00f6030c', 'name': 'network-vif-deleted', 'tag': '367f8cc3-bd5c-4497-8fc5-2b73175a0939'}] {{(pid=91687) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:27:01.955514 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.agents_db [None req-92d61f12-17bc-4bf9-9eab-8a69b8c6da2f None None] Agent healthcheck: found 6 active agents {{(pid=91689) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 04:27:01.963291 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-3373e4ae-94a9-42e3-8793-727a8284c07d req-fd692865-4767-4013-b5e7-d400e955d842 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.82 "DELETE /v2.0/ports/367f8cc3-bd5c-4497-8fc5-2b73175a0939 HTTP/1.1" status: 204  len: 173 time: 0.8812151
May 20 04:27:01.992799 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '69d5fa5c-ad33-4afb-bf39-39cd00f6030c', 'name': 'network-vif-deleted', 'tag': '367f8cc3-bd5c-4497-8fc5-2b73175a0939', 'status': 'completed', 'code': 200}
May 20 04:27:02.551243 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:02.692895 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-9161bcd9-0f3d-45c5-93ca-eaa93aaca1d6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:02.860060 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49e4354d-cb20-4d4f-83da-a3f604b35db2 req-8654d391-88fe-42ca-b7f7-768f8c7643b0 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:02.861820 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-49e4354d-cb20-4d4f-83da-a3f604b35db2 req-8654d391-88fe-42ca-b7f7-768f8c7643b0 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 944 time: 0.1349869
May 20 04:27:02.907700 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-49e4354d-cb20-4d4f-83da-a3f604b35db2 req-e79dbaea-edce-46b8-a9ae-a5080a59bcbd tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0403004
May 20 04:27:02.908756 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-e82a26bc-ba91-4633-9ad5-10214dd44b40 req-871fc9ad-e839-4848-b187-c91a7a53991e tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=69d5fa5c-ad33-4afb-bf39-39cd00f6030c HTTP/1.1" status: 200  len: 210 time: 0.0446968
May 20 04:27:03.328529 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ea4803bd-878f-47d5-9084-1ec41953c9db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:04.066255 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-aa86b0d5-5889-4082-bc14-9fc8ed274db5 req-fe0e14f8-a225-4b84-a590-59f202d1d4f7 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=69d5fa5c-ad33-4afb-bf39-39cd00f6030c HTTP/1.1" status: 200  len: 210 time: 0.0428340
May 20 04:27:04.104866 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16b259d4-14ef-4976-85bb-031a20789520 req-63e614ec-640b-45bb-9fb6-8bf78e474474 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:04.106374 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-16b259d4-14ef-4976-85bb-031a20789520 req-63e614ec-640b-45bb-9fb6-8bf78e474474 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 944 time: 0.0851493
May 20 04:27:04.151861 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-16b259d4-14ef-4976-85bb-031a20789520 req-d57b2cbb-317f-4df3-bd44-43e27743578e tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0390878
May 20 04:27:05.196974 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f21320cc-6a25-4ec1-8a32-8b119b35fd55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:05.219286 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-2d66f9e6-4c30-4cca-92b3-71afce33c99a req-629c2d62-f8ca-4b7c-9097-a844c28c5632 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=69d5fa5c-ad33-4afb-bf39-39cd00f6030c HTTP/1.1" status: 200  len: 210 time: 0.0442169
May 20 04:27:05.352564 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18787b57-c0ac-42c8-b65c-15d106117652 req-639f1987-05ab-4feb-8b10-e1adc1a8ddae tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:05.353915 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-18787b57-c0ac-42c8-b65c-15d106117652 req-639f1987-05ab-4feb-8b10-e1adc1a8ddae tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 944 time: 0.0892131
May 20 04:27:05.403943 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-18787b57-c0ac-42c8-b65c-15d106117652 req-00bb3c02-0f33-498c-99cf-1754d6cb056b tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0440514
May 20 04:27:06.376410 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-7a93bebf-afab-4c37-9302-ccf21a5424eb req-d7064b98-dcf2-43ee-a322-f08f9c26313f tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=69d5fa5c-ad33-4afb-bf39-39cd00f6030c HTTP/1.1" status: 200  len: 210 time: 0.0502474
May 20 04:27:06.487849 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] get_ports_and_sgs() called for port_ids ['9a903ca5-2762-405a-81bb-5c3dce3d256a', 'c84df5e2-cd07-4d01-87c9-ec3a35e2ad93', '367f8cc3-bd5c-4497-8fc5-2b73175a0939'] {{(pid=91688) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 04:27:06.525323 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 115e1bac-cc4d-40b5-b860-798c85c78924 details requested by agent hyperv_hv-cinder-79091 with host hv-cinder-79091 {{(pid=91688) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 20 04:27:06.604724 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea61dbbd-5f5e-44ad-80b7-05520bef1f82 req-c3b1d0e3-c3fd-453a-995e-9cb4b59b5c9c tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:06.606299 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-ea61dbbd-5f5e-44ad-80b7-05520bef1f82 req-c3b1d0e3-c3fd-453a-995e-9cb4b59b5c9c tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 944 time: 0.0814919
May 20 04:27:06.653852 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-ea61dbbd-5f5e-44ad-80b7-05520bef1f82 req-fccda5a8-18b5-4275-9378-7369c772f496 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0410516
May 20 04:27:06.760674 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port 115e1bac-cc4d-40b5-b860-798c85c78924, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=115e1bac-cc4d-40b5-b860-798c85c78924,segment=NetworkSegment(9521f383-6017-4b4d-9f47-cff4ed54cb57),segment_id=9521f383-6017-4b4d-9f47-cff4ed54cb57)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:27:06.783758 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Returning: {'device': '115e1bac-cc4d-40b5-b860-798c85c78924', 'network_id': '21794e86-fda7-40a6-a5a8-db117c7eeb9d', 'port_id': '115e1bac-cc4d-40b5-b860-798c85c78924', 'mac_address': 'fa:16:3e:71:24:f2', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 864, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '06f38702-3d3c-4e25-8f84-85483d1ddf28', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91688) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 20 04:27:06.884305 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:06.917020 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.notifiers.nova [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 115e1bac-cc4d-40b5-b860-798c85c78924 {{(pid=91688) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 04:27:06.952285 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port 115e1bac-cc4d-40b5-b860-798c85c78924, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=115e1bac-cc4d-40b5-b860-798c85c78924,segment=NetworkSegment(9521f383-6017-4b4d-9f47-cff4ed54cb57),segment_id=9521f383-6017-4b4d-9f47-cff4ed54cb57)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:27:06.965027 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:06.967614 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:27:07.073629 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Pushing event updated for resources: {'Port': ['ID=115e1bac-cc4d-40b5-b860-798c85c78924,revision_number=9']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:27:07.083318 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:27:07.083723 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:27:07.084064 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:27:07.084395 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:27:07.084719 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:27:07.085046 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:27:07.085394 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:27:07.085712 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:27:07.086039 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:27:07.086352 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:27:07.086701 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:27:07.086996 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:27:07.093838 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.126s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:27:07.536812 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-7bd641f9-cc3a-4779-b10f-60e9d7ffd8d9 req-e9477f1f-d7ab-4cf2-9204-b7d07da6a610 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=69d5fa5c-ad33-4afb-bf39-39cd00f6030c HTTP/1.1" status: 200  len: 210 time: 0.0430534
May 20 04:27:07.859347 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-101c0f40-05f3-4cee-a23b-e55a1e8f583b req-92ab5c7a-cc42-4f79-ad4d-a28a8ee348c2 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:07.861173 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-101c0f40-05f3-4cee-a23b-e55a1e8f583b req-92ab5c7a-cc42-4f79-ad4d-a28a8ee348c2 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 945 time: 0.0908120
May 20 04:27:07.913256 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-101c0f40-05f3-4cee-a23b-e55a1e8f583b req-16db6aef-a752-42c8-bc35-84db75aaa9c8 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0457897
May 20 04:27:08.702824 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-3b9c0dbb-aa41-41ab-a5d3-f3ac02e86675 req-653ecfe8-20e5-4013-90c7-c247b03a6140 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=69d5fa5c-ad33-4afb-bf39-39cd00f6030c HTTP/1.1" status: 200  len: 210 time: 0.0442786
May 20 04:27:08.988864 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:09.133903 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ca4c0ab-0dc8-4436-95ac-8706db32278c req-4e33ea99-0e58-478a-976f-625323a2831a tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:09.136017 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-2ca4c0ab-0dc8-4436-95ac-8706db32278c req-4e33ea99-0e58-478a-976f-625323a2831a tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 945 time: 0.0862250
May 20 04:27:09.188789 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-2ca4c0ab-0dc8-4436-95ac-8706db32278c req-fdf2eeec-dbb8-47fc-bd79-abbfe010f64d tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0464716
May 20 04:27:09.637234 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] get_ports_and_sgs() called for port_ids ['115e1bac-cc4d-40b5-b860-798c85c78924'] {{(pid=91688) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 04:27:09.970382 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-6635e5f5-eda4-4041-949a-22c7671992fd req-9069d855-72c5-4d0c-bc9a-9d18a4734889 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=69d5fa5c-ad33-4afb-bf39-39cd00f6030c HTTP/1.1" status: 200  len: 210 time: 0.0561783
May 20 04:27:10.466830 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4217bd06-2bbb-4ca6-b498-0effab6b15ba req-f16c017f-d144-4573-8d72-6a3bd07c772f tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:10.468233 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4217bd06-2bbb-4ca6-b498-0effab6b15ba req-f16c017f-d144-4573-8d72-6a3bd07c772f tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 945 time: 0.0995479
May 20 04:27:10.516596 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4217bd06-2bbb-4ca6-b498-0effab6b15ba req-e05eda63-9775-4c8e-b031-e65d91019dc6 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0422387
May 20 04:27:11.660245 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-164a77b3-1cba-4ce2-818d-a9996a2e48e8 req-33317d0a-f08c-4d1c-ae0a-c43c2e2be829 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:11.661950 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-164a77b3-1cba-4ce2-818d-a9996a2e48e8 req-33317d0a-f08c-4d1c-ae0a-c43c2e2be829 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=07157b0a-98fc-4f60-bd6f-f1fd5c17dbfa HTTP/1.1" status: 200  len: 945 time: 0.2172115
May 20 04:27:11.727138 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-164a77b3-1cba-4ce2-818d-a9996a2e48e8 req-7edb8ddc-20d6-436d-8ff1-89dd710291ea tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0515282
May 20 04:27:11.828095 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5c2f685-247b-402c-a8c4-2d6c30a14169 req-66e2140d-8fe2-420c-9cdf-58b705979006 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:11.829797 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a5c2f685-247b-402c-a8c4-2d6c30a14169 req-66e2140d-8fe2-420c-9cdf-58b705979006 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 945 time: 0.0944557
May 20 04:27:11.883577 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a5c2f685-247b-402c-a8c4-2d6c30a14169 req-13778979-d15a-45ee-94db-95393056e010 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0468833
May 20 04:27:12.951525 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b89c4793-09c1-4aad-b861-03deec1bbbc8 req-2af272d6-a90a-47c7-aec7-6de4106c838d tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:12.953177 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-b89c4793-09c1-4aad-b861-03deec1bbbc8 req-2af272d6-a90a-47c7-aec7-6de4106c838d tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=07157b0a-98fc-4f60-bd6f-f1fd5c17dbfa HTTP/1.1" status: 200  len: 945 time: 0.0915518
May 20 04:27:13.010444 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-b89c4793-09c1-4aad-b861-03deec1bbbc8 req-d487bfed-569f-4141-bf91-e7e22892d951 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0462213
May 20 04:27:13.104080 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2f9c185-5a3c-43fb-9427-3f42d92876bb req-073f0f94-dde6-4558-a8e0-b5e1b993ee4d tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:13.105975 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a2f9c185-5a3c-43fb-9427-3f42d92876bb req-073f0f94-dde6-4558-a8e0-b5e1b993ee4d tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 945 time: 0.0953779
May 20 04:27:13.157826 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a2f9c185-5a3c-43fb-9427-3f42d92876bb req-184749a8-17ab-4399-85ad-b80db4200c91 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0414624
May 20 04:27:14.237765 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a5e2f32-a110-4ef4-a3a0-75cb7d4a73f2 req-b05b78f4-78ef-43c1-a781-f4f461f9f588 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:14.239244 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-4a5e2f32-a110-4ef4-a3a0-75cb7d4a73f2 req-b05b78f4-78ef-43c1-a781-f4f461f9f588 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=07157b0a-98fc-4f60-bd6f-f1fd5c17dbfa HTTP/1.1" status: 200  len: 945 time: 0.1036918
May 20 04:27:14.306740 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-4a5e2f32-a110-4ef4-a3a0-75cb7d4a73f2 req-67323ac8-7257-4c5e-b05e-64bf8e5a3942 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0616803
May 20 04:27:14.386294 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b26e529-e0aa-4a7c-a53a-d5d99fd04b6a req-2f23008f-daf0-4dcc-bf5c-cf1071687f17 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:14.387709 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-6b26e529-e0aa-4a7c-a53a-d5d99fd04b6a req-2f23008f-daf0-4dcc-bf5c-cf1071687f17 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 945 time: 0.0873189
May 20 04:27:14.447867 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-6b26e529-e0aa-4a7c-a53a-d5d99fd04b6a req-676dfcf0-6770-4bcb-b0cb-5b189a92225b tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0536485
May 20 04:27:15.504514 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06682342-45da-46f7-9c47-1b57aa757a49 req-0baf22aa-5aba-44f3-ab54-18e929822cca tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:15.506160 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-06682342-45da-46f7-9c47-1b57aa757a49 req-0baf22aa-5aba-44f3-ab54-18e929822cca tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=07157b0a-98fc-4f60-bd6f-f1fd5c17dbfa HTTP/1.1" status: 200  len: 945 time: 0.0853493
May 20 04:27:15.571655 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-06682342-45da-46f7-9c47-1b57aa757a49 req-847ea08b-1dd3-4f11-add2-d90b74c9683a tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0562356
May 20 04:27:15.653197 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bb5859c-38ca-4a96-8eb2-d96cc1131221 req-653c6626-9512-4a29-97b7-26d299a4a8fc tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:15.654732 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-5bb5859c-38ca-4a96-8eb2-d96cc1131221 req-653c6626-9512-4a29-97b7-26d299a4a8fc tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 945 time: 0.0907993
May 20 04:27:15.730295 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-5bb5859c-38ca-4a96-8eb2-d96cc1131221 req-2fbfb842-7104-494f-b758-ff3268a8acf8 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0689843
May 20 04:27:16.025555 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 115e1bac-cc4d-40b5-b860-798c85c78924 up at agent hyperv_hv-cinder-79091 {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:27:16.102732 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Provisioning complete for port 115e1bac-cc4d-40b5-b860-798c85c78924 triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:27:16.103111 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:16.227810 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:16.256255 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f32b55e5-d82f-4c9e-a67f-08d83c24cf4d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '115e1bac-cc4d-40b5-b860-798c85c78924'}] {{(pid=91688) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:27:16.266418 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port 115e1bac-cc4d-40b5-b860-798c85c78924, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=115e1bac-cc4d-40b5-b860-798c85c78924,segment=NetworkSegment(9521f383-6017-4b4d-9f47-cff4ed54cb57),segment_id=9521f383-6017-4b4d-9f47-cff4ed54cb57)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:27:16.274056 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:16.275298 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 367f8cc3-bd5c-4497-8fc5-2b73175a0939 no longer exists at agent hyperv_hv-cinder-79091 {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 04:27:16.308183 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-61ab26c4-7772-49e5-8a6f-a6c36e2b71a8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:27:16.346327 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] No Port match for: 367f8cc3-bd5c-4497-8fc5-2b73175a0939 {{(pid=91688) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 04:27:16.346677 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 367f8cc3-bd5c-4497-8fc5-2b73175a0939 not bound to the agent host hv-cinder-79091 {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 04:27:16.367144 dv-cinder-790910-4-iscsi neutron-server[91688]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f32b55e5-d82f-4c9e-a67f-08d83c24cf4d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '115e1bac-cc4d-40b5-b860-798c85c78924', 'code': 200}
May 20 04:27:16.383384 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Pushing event updated for resources: {'Port': ['ID=115e1bac-cc4d-40b5-b860-798c85c78924,revision_number=10']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:27:16.386860 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:27:16.778363 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7e4aaad-66ce-4a8d-a1b1-1163cbca0579 req-ec998637-ba01-4fc4-80bb-81d53b5cc5f6 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:16.779118 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-c7e4aaad-66ce-4a8d-a1b1-1163cbca0579 req-ec998637-ba01-4fc4-80bb-81d53b5cc5f6 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Synchronizing usage tracker for tenant:6484c55ce8204dc3802efc929a51c4a5 on resource:port {{(pid=91687) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:27:16.799924 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-c7e4aaad-66ce-4a8d-a1b1-1163cbca0579 req-ec998637-ba01-4fc4-80bb-81d53b5cc5f6 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Unset dirty status for tenant:6484c55ce8204dc3802efc929a51c4a5 on resource:port {{(pid=91687) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:27:16.804526 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-c7e4aaad-66ce-4a8d-a1b1-1163cbca0579 req-ec998637-ba01-4fc4-80bb-81d53b5cc5f6 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=07157b0a-98fc-4f60-bd6f-f1fd5c17dbfa HTTP/1.1" status: 200  len: 945 time: 0.1110179
May 20 04:27:16.863059 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-c7e4aaad-66ce-4a8d-a1b1-1163cbca0579 req-ab87f391-8767-4210-bd11-a1e2bd63077f tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0530834
May 20 04:27:16.975152 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-880ed568-406d-4b98-898d-d431909454af req-0df33363-41f0-459d-ab5e-bfc9336d0e64 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:16.976873 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-880ed568-406d-4b98-898d-d431909454af req-0df33363-41f0-459d-ab5e-bfc9336d0e64 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 947 time: 0.1030393
May 20 04:27:17.033078 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-880ed568-406d-4b98-898d-d431909454af req-ff71b9aa-7812-47f7-be0c-f9a1e119c591 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0494573
May 20 04:27:18.061641 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6cd9323-7c87-430a-ac7a-487f2dd7de67 req-4136cfc6-fa06-42f4-90ab-a61534ad0c22 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:18.063161 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-e6cd9323-7c87-430a-ac7a-487f2dd7de67 req-4136cfc6-fa06-42f4-90ab-a61534ad0c22 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=07157b0a-98fc-4f60-bd6f-f1fd5c17dbfa HTTP/1.1" status: 200  len: 945 time: 0.0840192
May 20 04:27:18.111045 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-e6cd9323-7c87-430a-ac7a-487f2dd7de67 req-ef3f55e5-fe2f-499e-a068-8421c14bfcdd tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0414159
May 20 04:27:18.229216 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e02ae27-0773-43ec-83cb-119c1a50c82c req-2a7b03f5-8b99-4823-85df-e9019d66e32c tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:18.230691 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-0e02ae27-0773-43ec-83cb-119c1a50c82c req-2a7b03f5-8b99-4823-85df-e9019d66e32c tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 947 time: 0.0814085
May 20 04:27:18.278912 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-0e02ae27-0773-43ec-83cb-119c1a50c82c req-ae0e2046-e61a-4aed-a101-9b568599f0a2 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0421054
May 20 04:27:19.192770 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c9d793b-bff0-4291-aca4-b6af10e3ec22 req-59264cd5-76c9-4143-a24e-ff4f370f7f3e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:19.194312 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-5c9d793b-bff0-4291-aca4-b6af10e3ec22 req-59264cd5-76c9-4143-a24e-ff4f370f7f3e service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 1100 time: 0.0754967
May 20 04:27:19.364504 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-5c9d793b-bff0-4291-aca4-b6af10e3ec22 req-bf04226c-934e-4879-ab36-b1e0a2d08ba7 service neutron] 10.222.0.82 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1630278
May 20 04:27:19.399124 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c751595-f5a0-4015-95fe-f036447cda10 req-78b2a6b9-83ae-4180-bdf5-6dfaf4ccf6c6 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:19.400704 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-8c751595-f5a0-4015-95fe-f036447cda10 req-78b2a6b9-83ae-4180-bdf5-6dfaf4ccf6c6 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=07157b0a-98fc-4f60-bd6f-f1fd5c17dbfa HTTP/1.1" status: 200  len: 945 time: 0.1797969
May 20 04:27:19.451799 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-8c751595-f5a0-4015-95fe-f036447cda10 req-16d66bba-2cf2-4e15-bf8b-f73c33742d11 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0433590
May 20 04:27:19.498336 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d91b195c-a11a-4571-99b5-96e4453bb1d4 req-cede2aa5-e7ce-4d97-a7d2-e3af081cd87b tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:19.500197 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-d91b195c-a11a-4571-99b5-96e4453bb1d4 req-cede2aa5-e7ce-4d97-a7d2-e3af081cd87b tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 947 time: 0.0918431
May 20 04:27:19.547267 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-d91b195c-a11a-4571-99b5-96e4453bb1d4 req-f3965a17-08a7-4eea-aa02-89da7e8281e7 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0411229
May 20 04:27:19.771988 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de305b98-19ae-4d8a-a19c-c1a85340f03d req-b762bdce-8c5f-447f-b285-5ef19b8e83db tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:19.773481 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-de305b98-19ae-4d8a-a19c-c1a85340f03d req-b762bdce-8c5f-447f-b285-5ef19b8e83db tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.71 "GET /v2.0/networks?id=c6308b4a-efff-48c2-b41d-58a08edddda1 HTTP/1.1" status: 200  len: 813 time: 0.1980107
May 20 04:27:19.785447 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29714ee2-4d4e-4b75-8ec8-2acc84b6f864 req-14ee17db-c3a3-42d6-9cbf-fc50a2850c6a tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:19.786896 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-29714ee2-4d4e-4b75-8ec8-2acc84b6f864 req-14ee17db-c3a3-42d6-9cbf-fc50a2850c6a tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.82 "GET /v2.0/ports?device_id=07157b0a-98fc-4f60-bd6f-f1fd5c17dbfa HTTP/1.1" status: 200  len: 945 time: 0.1919069
May 20 04:27:19.830636 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-de305b98-19ae-4d8a-a19c-c1a85340f03d req-f7b767b9-a18b-4d00-a868-0c5537ef995e tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.71 "GET /v2.0/quotas/8a32187e285543a88aae7f4283a9636f HTTP/1.1" status: 200  len: 375 time: 0.0427368
May 20 04:27:19.894271 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-de305b98-19ae-4d8a-a19c-c1a85340f03d req-4fd6fb2a-fe8b-48ce-a6d3-d1870b310eaf tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Synchronizing usage tracker for tenant:8a32187e285543a88aae7f4283a9636f on resource:port {{(pid=91687) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:27:19.962803 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-de305b98-19ae-4d8a-a19c-c1a85340f03d req-4fd6fb2a-fe8b-48ce-a6d3-d1870b310eaf tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Unset dirty status for tenant:8a32187e285543a88aae7f4283a9636f on resource:port {{(pid=91687) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:27:19.964122 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-de305b98-19ae-4d8a-a19c-c1a85340f03d req-4fd6fb2a-fe8b-48ce-a6d3-d1870b310eaf tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.71 "GET /v2.0/ports?tenant_id=8a32187e285543a88aae7f4283a9636f&fields=id HTTP/1.1" status: 200  len: 210 time: 0.1259785
May 20 04:27:19.993030 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [req-29714ee2-4d4e-4b75-8ec8-2acc84b6f864 req-59fc983c-239a-46cb-b1fc-5123a6b99323 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Deleting port c84df5e2-cd07-4d01-87c9-ec3a35e2ad93 {{(pid=91687) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 04:27:19.993473 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-29714ee2-4d4e-4b75-8ec8-2acc84b6f864 req-59fc983c-239a-46cb-b1fc-5123a6b99323 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8782892520551'] for port, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:20.222210 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [req-29714ee2-4d4e-4b75-8ec8-2acc84b6f864 req-59fc983c-239a-46cb-b1fc-5123a6b99323 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] For port c84df5e2-cd07-4d01-87c9-ec3a35e2ad93, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=c84df5e2-cd07-4d01-87c9-ec3a35e2ad93,segment=NetworkSegment(0ad1d987-000a-4092-8d15-811f90922b00),segment_id=0ad1d987-000a-4092-8d15-811f90922b00)] {{(pid=91687) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:27:20.223026 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-29714ee2-4d4e-4b75-8ec8-2acc84b6f864 req-59fc983c-239a-46cb-b1fc-5123a6b99323 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1718922'] for port, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:20.360152 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [req-29714ee2-4d4e-4b75-8ec8-2acc84b6f864 req-59fc983c-239a-46cb-b1fc-5123a6b99323 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Calling delete_port for c84df5e2-cd07-4d01-87c9-ec3a35e2ad93 owned by compute:nova {{(pid=91687) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 04:27:20.373176 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-de305b98-19ae-4d8a-a19c-c1a85340f03d req-08670655-5fda-48a7-a064-b5af2695cae6 service neutron] 10.222.0.71 "GET /v2.0/networks/c6308b4a-efff-48c2-b41d-58a08edddda1?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4010699
May 20 04:27:20.543553 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-de305b98-19ae-4d8a-a19c-c1a85340f03d req-d8d84ada-7b18-446e-8e2c-c2c0d970a2d3 service neutron] 10.222.0.71 "GET /v2.0/networks/c6308b4a-efff-48c2-b41d-58a08edddda1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1577580
May 20 04:27:20.638759 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-29714ee2-4d4e-4b75-8ec8-2acc84b6f864 req-59fc983c-239a-46cb-b1fc-5123a6b99323 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8782892522936', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8782892108804', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4162192'] for port, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:20.645583 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-d3ec6aea-5da8-4b00-b67d-6b2b5becaf98 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:27:20.658820 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] get_ports_and_sgs() called for port_ids ['9a903ca5-2762-405a-81bb-5c3dce3d256a', 'c84df5e2-cd07-4d01-87c9-ec3a35e2ad93'] {{(pid=91688) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 04:27:20.694346 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70856bbd-384d-4247-8a39-da0615d2b5bc req-4c4157a2-5bbe-4aa8-b1d6-90cadcaa3a4f tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:20.696275 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59fc983c-239a-46cb-b1fc-5123a6b99323 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Pushing event deleted for resources: {'Port': ['ID=c84df5e2-cd07-4d01-87c9-ec3a35e2ad93,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:27:20.700495 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-70856bbd-384d-4247-8a39-da0615d2b5bc req-4c4157a2-5bbe-4aa8-b1d6-90cadcaa3a4f tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=07157b0a-98fc-4f60-bd6f-f1fd5c17dbfa HTTP/1.1" status: 200  len: 945 time: 0.1367002
May 20 04:27:20.774176 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-59fc983c-239a-46cb-b1fc-5123a6b99323 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.129s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:27:20.812989 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-70856bbd-384d-4247-8a39-da0615d2b5bc req-c343c92a-c7fd-406a-8cc4-3f766c2d4dde tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1022089
May 20 04:27:20.873463 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.l3_dvrscheduler_db [req-29714ee2-4d4e-4b75-8ec8-2acc84b6f864 req-59fc983c-239a-46cb-b1fc-5123a6b99323 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] No DVR routers for this DVR port c84df5e2-cd07-4d01-87c9-ec3a35e2ad93 on host hv-cinder-79091 {{(pid=91687) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 04:27:20.880348 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-29714ee2-4d4e-4b75-8ec8-2acc84b6f864 req-59fc983c-239a-46cb-b1fc-5123a6b99323 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for port, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:20.884531 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '07157b0a-98fc-4f60-bd6f-f1fd5c17dbfa', 'name': 'network-vif-deleted', 'tag': 'c84df5e2-cd07-4d01-87c9-ec3a35e2ad93'}] {{(pid=91687) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:27:20.903114 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-29714ee2-4d4e-4b75-8ec8-2acc84b6f864 req-59fc983c-239a-46cb-b1fc-5123a6b99323 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.82 "DELETE /v2.0/ports/c84df5e2-cd07-4d01-87c9-ec3a35e2ad93 HTTP/1.1" status: 204  len: 173 time: 1.1088219
May 20 04:27:20.922219 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-a495b2de-39ca-4430-94a0-d7e2cdf3f081 req-a61d1191-1fd7-4449-97aa-255e81152352 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.71 "GET /v2.0/ports?device_id=0ec5c357-a1ce-4f29-a687-f059eadabd44 HTTP/1.1" status: 200  len: 210 time: 0.0576017
May 20 04:27:20.955224 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eeb3ec48-9b9d-4cf8-a010-14a9fee0e232 req-1d2db33e-dcba-466e-80d7-2c2e19d6da8f tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:20.956947 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-eeb3ec48-9b9d-4cf8-a010-14a9fee0e232 req-1d2db33e-dcba-466e-80d7-2c2e19d6da8f tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 947 time: 0.1432106
May 20 04:27:20.990185 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '07157b0a-98fc-4f60-bd6f-f1fd5c17dbfa', 'name': 'network-vif-deleted', 'tag': 'c84df5e2-cd07-4d01-87c9-ec3a35e2ad93', 'status': 'completed', 'code': 200}
May 20 04:27:21.022087 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-eeb3ec48-9b9d-4cf8-a010-14a9fee0e232 req-205b72f4-e1ed-43e2-9d2b-235709577875 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0565574
May 20 04:27:22.131269 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-40b465ea-f328-4405-88a5-2dcbdbf307f3 req-34baa62b-8297-4c49-b18c-f219ee9aca0d tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.71 "GET /v2.0/ports?device_id=0ec5c357-a1ce-4f29-a687-f059eadabd44 HTTP/1.1" status: 200  len: 210 time: 0.0823560
May 20 04:27:22.391314 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70a066f3-eee4-4e2a-9005-c233ea591b0f req-383618bb-d760-4258-b2e5-0cae64e284fe tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:22.394891 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-70a066f3-eee4-4e2a-9005-c233ea591b0f req-383618bb-d760-4258-b2e5-0cae64e284fe tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 947 time: 0.1453538
May 20 04:27:22.426838 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de305b98-19ae-4d8a-a19c-c1a85340f03d req-8d6f996e-7d82-498a-b008-0f9b2065df17 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:22.430151 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-de305b98-19ae-4d8a-a19c-c1a85340f03d req-8d6f996e-7d82-498a-b008-0f9b2065df17 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.82 "GET /v2.0/networks?id=c6308b4a-efff-48c2-b41d-58a08edddda1 HTTP/1.1" status: 200  len: 813 time: 0.2866249
May 20 04:27:22.445507 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [req-de305b98-19ae-4d8a-a19c-c1a85340f03d req-0be9b540-e823-4bf9-8211-4435cf51cab5 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Request body: {'port': {'device_id': '0ec5c357-a1ce-4f29-a687-f059eadabd44', 'network_id': 'c6308b4a-efff-48c2-b41d-58a08edddda1', 'admin_state_up': True, 'tenant_id': '8a32187e285543a88aae7f4283a9636f'}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:27:22.482213 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-70a066f3-eee4-4e2a-9005-c233ea591b0f req-5d19a5ca-8e80-4859-9561-562c2d076772 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0802524
May 20 04:27:22.616757 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [req-de305b98-19ae-4d8a-a19c-c1a85340f03d req-0be9b540-e823-4bf9-8211-4435cf51cab5 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:27:22.627975 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [req-de305b98-19ae-4d8a-a19c-c1a85340f03d req-0be9b540-e823-4bf9-8211-4435cf51cab5 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:27:22.644437 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-de305b98-19ae-4d8a-a19c-c1a85340f03d req-0be9b540-e823-4bf9-8211-4435cf51cab5 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Made reservation on behalf of 8a32187e285543a88aae7f4283a9636f for: {'port': 1} {{(pid=91687) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 04:27:22.648332 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-de305b98-19ae-4d8a-a19c-c1a85340f03d req-0be9b540-e823-4bf9-8211-4435cf51cab5 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:22.839372 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.db_base_plugin_common [req-de305b98-19ae-4d8a-a19c-c1a85340f03d req-0be9b540-e823-4bf9-8211-4435cf51cab5 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Allocated IP 172.20.0.6 (c6308b4a-efff-48c2-b41d-58a08edddda1/2dceece0-8bc3-4f29-a183-108f8744d094/576807fb-2ca4-4b24-9f9f-348539f6ff95) {{(pid=91687) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 04:27:23.069483 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-de305b98-19ae-4d8a-a19c-c1a85340f03d req-0be9b540-e823-4bf9-8211-4435cf51cab5 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Notify callbacks [] for port, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:23.100459 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-de305b98-19ae-4d8a-a19c-c1a85340f03d req-0be9b540-e823-4bf9-8211-4435cf51cab5 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8782892106231', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4162192'] for port, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:23.107777 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-74b4e1cd-3141-4d28-ac16-8ae2b42a2880 tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:27:23.176783 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-de305b98-19ae-4d8a-a19c-c1a85340f03d req-0be9b540-e823-4bf9-8211-4435cf51cab5 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Network c6308b4a-efff-48c2-b41d-58a08edddda1 is already hosted by enough agents. {{(pid=91687) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:27:23.181016 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.base_scheduler [req-de305b98-19ae-4d8a-a19c-c1a85340f03d req-0be9b540-e823-4bf9-8211-4435cf51cab5 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Resources bound (agent type, host, resource id):  {{(pid=91687) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:27:23.184147 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.l3_dvrscheduler_db [req-de305b98-19ae-4d8a-a19c-c1a85340f03d req-0be9b540-e823-4bf9-8211-4435cf51cab5 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Received port after_create {{(pid=91687) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 04:27:23.227611 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0be9b540-e823-4bf9-8211-4435cf51cab5 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Pushing event updated for resources: {'Port': ['ID=576807fb-2ca4-4b24-9f9f-348539f6ff95,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:27:23.237813 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-0be9b540-e823-4bf9-8211-4435cf51cab5 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.130s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:27:23.305555 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de305b98-19ae-4d8a-a19c-c1a85340f03d req-0be9b540-e823-4bf9-8211-4435cf51cab5 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:23.306212 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-de305b98-19ae-4d8a-a19c-c1a85340f03d req-0be9b540-e823-4bf9-8211-4435cf51cab5 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for port, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:23.352814 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-de305b98-19ae-4d8a-a19c-c1a85340f03d req-0be9b540-e823-4bf9-8211-4435cf51cab5 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 0.9139762
May 20 04:27:23.365478 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [req-de305b98-19ae-4d8a-a19c-c1a85340f03d req-34d40daa-7289-4965-8f90-fdde9b6f3d56 service neutron] Request body: {'port': {'device_id': '0ec5c357-a1ce-4f29-a687-f059eadabd44', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79091'}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:27:23.402334 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd2f6418-1f02-48e7-80b8-a19b51f52378 req-704b4c60-4e33-43fa-9df3-64346a81301c tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:23.403082 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-cd2f6418-1f02-48e7-80b8-a19b51f52378 req-704b4c60-4e33-43fa-9df3-64346a81301c tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Synchronizing usage tracker for tenant:8a32187e285543a88aae7f4283a9636f on resource:port {{(pid=91687) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:27:23.466304 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-cd2f6418-1f02-48e7-80b8-a19b51f52378 req-704b4c60-4e33-43fa-9df3-64346a81301c tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Unset dirty status for tenant:8a32187e285543a88aae7f4283a9636f on resource:port {{(pid=91687) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:27:23.467537 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-cd2f6418-1f02-48e7-80b8-a19b51f52378 req-704b4c60-4e33-43fa-9df3-64346a81301c tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.71 "GET /v2.0/ports?device_id=0ec5c357-a1ce-4f29-a687-f059eadabd44 HTTP/1.1" status: 200  len: 931 time: 0.2226324
May 20 04:27:23.534743 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-de305b98-19ae-4d8a-a19c-c1a85340f03d req-34d40daa-7289-4965-8f90-fdde9b6f3d56 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:23.568569 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-cd2f6418-1f02-48e7-80b8-a19b51f52378 req-be0084d0-d6fc-477e-98fb-ce0aeb02218b tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.71 "GET /v2.0/security-groups?id=e79e4ba4-358f-4b35-b5f3-7372b5116def&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0875044
May 20 04:27:23.736804 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05e5b136-56c3-4df0-a2ec-dd6b6ba2f0a1 req-4e5bf593-b551-42a8-9b10-3341f0a4ffe9 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:23.738483 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-05e5b136-56c3-4df0-a2ec-dd6b6ba2f0a1 req-4e5bf593-b551-42a8-9b10-3341f0a4ffe9 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 947 time: 0.0864310
May 20 04:27:23.792757 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-05e5b136-56c3-4df0-a2ec-dd6b6ba2f0a1 req-21e02f71-1076-4abb-8422-4195fb43a33e tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0424228
May 20 04:27:23.929732 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c7927bd-f871-4068-a83b-eafb84408a38 req-4c924894-7a48-4212-9189-a3178069c92f tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:23.930762 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-0c7927bd-f871-4068-a83b-eafb84408a38 req-4c924894-7a48-4212-9189-a3178069c92f tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Synchronizing usage tracker for tenant:6484c55ce8204dc3802efc929a51c4a5 on resource:port {{(pid=91687) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:27:23.962263 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-0c7927bd-f871-4068-a83b-eafb84408a38 req-4c924894-7a48-4212-9189-a3178069c92f tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Unset dirty status for tenant:6484c55ce8204dc3802efc929a51c4a5 on resource:port {{(pid=91687) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:27:23.963441 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-0c7927bd-f871-4068-a83b-eafb84408a38 req-4c924894-7a48-4212-9189-a3178069c92f tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=67a5d1ca-6a84-4a8b-8aeb-83c49965926d HTTP/1.1" status: 200  len: 946 time: 0.2375398
May 20 04:27:24.046789 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device c84df5e2-cd07-4d01-87c9-ec3a35e2ad93 no longer exists at agent hyperv_hv-cinder-79091 {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 04:27:24.059425 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.notifiers.nova [req-de305b98-19ae-4d8a-a19c-c1a85340f03d req-34d40daa-7289-4965-8f90-fdde9b6f3d56 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 576807fb-2ca4-4b24-9f9f-348539f6ff95 {{(pid=91687) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 04:27:24.070667 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-de305b98-19ae-4d8a-a19c-c1a85340f03d req-34d40daa-7289-4965-8f90-fdde9b6f3d56 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:24.076134 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-0c7927bd-f871-4068-a83b-eafb84408a38 req-ffc850fc-477a-4524-9c01-1f4c83efcb3c tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1037283
May 20 04:27:24.084940 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] No Port match for: c84df5e2-cd07-4d01-87c9-ec3a35e2ad93 {{(pid=91688) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 04:27:24.085322 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device c84df5e2-cd07-4d01-87c9-ec3a35e2ad93 not bound to the agent host hv-cinder-79091 {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 04:27:24.091833 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.provisioning_blocks [req-de305b98-19ae-4d8a-a19c-c1a85340f03d req-34d40daa-7289-4965-8f90-fdde9b6f3d56 service neutron] Transition to ACTIVE for port object 576807fb-2ca4-4b24-9f9f-348539f6ff95 will not be triggered until provisioned by entity L2. {{(pid=91687) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:27:24.097934 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-de305b98-19ae-4d8a-a19c-c1a85340f03d req-34d40daa-7289-4965-8f90-fdde9b6f3d56 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4162185'] for port, after_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:24.102218 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-65867a9c-5f82-4e56-9c24-fbca72fa9124 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:27:24.227694 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34d40daa-7289-4965-8f90-fdde9b6f3d56 service neutron] Pushing event updated for resources: {'Port': ['ID=576807fb-2ca4-4b24-9f9f-348539f6ff95,revision_number=2']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:27:24.254287 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-34d40daa-7289-4965-8f90-fdde9b6f3d56 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.152s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:27:24.331187 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.managers [req-de305b98-19ae-4d8a-a19c-c1a85340f03d req-34d40daa-7289-4965-8f90-fdde9b6f3d56 service neutron] Attempting to bind port 576807fb-2ca4-4b24-9f9f-348539f6ff95 on host hv-cinder-79091 for vnic_type normal with profile  {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 04:27:24.331515 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.managers [req-de305b98-19ae-4d8a-a19c-c1a85340f03d req-34d40daa-7289-4965-8f90-fdde9b6f3d56 service neutron] Attempting to bind port 576807fb-2ca4-4b24-9f9f-348539f6ff95 by drivers openvswitch,hyperv on host hv-cinder-79091 at level 0 using segments [{'id': '3cfe6ee0-17fa-47f2-8f37-995aaef6bfdc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 899, 'network_id': 'c6308b4a-efff-48c2-b41d-58a08edddda1'}] {{(pid=91687) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 04:27:24.331842 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-de305b98-19ae-4d8a-a19c-c1a85340f03d req-34d40daa-7289-4965-8f90-fdde9b6f3d56 service neutron] Attempting to bind port 576807fb-2ca4-4b24-9f9f-348539f6ff95 on network c6308b4a-efff-48c2-b41d-58a08edddda1 {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:27:24.337116 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-de305b98-19ae-4d8a-a19c-c1a85340f03d req-34d40daa-7289-4965-8f90-fdde9b6f3d56 service neutron] Port 576807fb-2ca4-4b24-9f9f-348539f6ff95 on network c6308b4a-efff-48c2-b41d-58a08edddda1 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79091 {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 20 04:27:24.337438 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-de305b98-19ae-4d8a-a19c-c1a85340f03d req-34d40daa-7289-4965-8f90-fdde9b6f3d56 service neutron] Attempting to bind port 576807fb-2ca4-4b24-9f9f-348539f6ff95 on network c6308b4a-efff-48c2-b41d-58a08edddda1 {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:27:24.342873 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-de305b98-19ae-4d8a-a19c-c1a85340f03d req-34d40daa-7289-4965-8f90-fdde9b6f3d56 service neutron] Checking agent: {'id': '7cc947fd-92eb-4d43-ad6b-ea002afff217', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79091', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 4, 19, 34), 'started_at': datetime.datetime(2021, 5, 20, 4, 19, 34), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 4, 27, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 04:27:24.343204 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-de305b98-19ae-4d8a-a19c-c1a85340f03d req-34d40daa-7289-4965-8f90-fdde9b6f3d56 service neutron] Checking segment: {'id': '3cfe6ee0-17fa-47f2-8f37-995aaef6bfdc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 899, 'network_id': 'c6308b4a-efff-48c2-b41d-58a08edddda1'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91687) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:27:24.343588 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-de305b98-19ae-4d8a-a19c-c1a85340f03d req-34d40daa-7289-4965-8f90-fdde9b6f3d56 service neutron] Bound using segment: {'id': '3cfe6ee0-17fa-47f2-8f37-995aaef6bfdc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 899, 'network_id': 'c6308b4a-efff-48c2-b41d-58a08edddda1'} {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 04:27:24.344016 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.managers [req-de305b98-19ae-4d8a-a19c-c1a85340f03d req-34d40daa-7289-4965-8f90-fdde9b6f3d56 service neutron] Bound port: 576807fb-2ca4-4b24-9f9f-348539f6ff95, host: hv-cinder-79091, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '3cfe6ee0-17fa-47f2-8f37-995aaef6bfdc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 899, 'network_id': 'c6308b4a-efff-48c2-b41d-58a08edddda1'}}] {{(pid=91687) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 04:27:24.344364 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-de305b98-19ae-4d8a-a19c-c1a85340f03d req-34d40daa-7289-4965-8f90-fdde9b6f3d56 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:24.532151 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [req-de305b98-19ae-4d8a-a19c-c1a85340f03d req-34d40daa-7289-4965-8f90-fdde9b6f3d56 service neutron] For port 576807fb-2ca4-4b24-9f9f-348539f6ff95, host hv-cinder-79091, cleared binding levels {{(pid=91687) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 04:27:24.535986 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [req-de305b98-19ae-4d8a-a19c-c1a85340f03d req-34d40daa-7289-4965-8f90-fdde9b6f3d56 service neutron] For port 576807fb-2ca4-4b24-9f9f-348539f6ff95, host hv-cinder-79091, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=576807fb-2ca4-4b24-9f9f-348539f6ff95,segment=NetworkSegment(3cfe6ee0-17fa-47f2-8f37-995aaef6bfdc),segment_id=3cfe6ee0-17fa-47f2-8f37-995aaef6bfdc)] {{(pid=91687) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 04:27:24.541258 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-de305b98-19ae-4d8a-a19c-c1a85340f03d req-34d40daa-7289-4965-8f90-fdde9b6f3d56 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4162185'] for port, after_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:24.545245 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-e0bedb9b-0310-4059-bf44-d206993a4bb0 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:27:24.609169 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de305b98-19ae-4d8a-a19c-c1a85340f03d req-34d40daa-7289-4965-8f90-fdde9b6f3d56 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:24.609875 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-de305b98-19ae-4d8a-a19c-c1a85340f03d req-34d40daa-7289-4965-8f90-fdde9b6f3d56 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for port, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:24.611376 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-de305b98-19ae-4d8a-a19c-c1a85340f03d req-34d40daa-7289-4965-8f90-fdde9b6f3d56 service neutron] 10.222.0.82 "PUT /v2.0/ports/576807fb-2ca4-4b24-9f9f-348539f6ff95 HTTP/1.1" status: 200  len: 1093 time: 1.2503862
May 20 04:27:24.611953 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0ec5c357-a1ce-4f29-a687-f059eadabd44', 'tag': '576807fb-2ca4-4b24-9f9f-348539f6ff95'}] {{(pid=91687) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:27:24.635371 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34d40daa-7289-4965-8f90-fdde9b6f3d56 service neutron] Pushing event updated for resources: {'Port': ['ID=576807fb-2ca4-4b24-9f9f-348539f6ff95,revision_number=3']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:27:24.638680 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-34d40daa-7289-4965-8f90-fdde9b6f3d56 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:27:24.700577 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0ec5c357-a1ce-4f29-a687-f059eadabd44', 'tag': '576807fb-2ca4-4b24-9f9f-348539f6ff95', 'status': 'completed', 'code': 200}
May 20 04:27:24.744774 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de305b98-19ae-4d8a-a19c-c1a85340f03d req-f7ed5a6d-84cd-426c-8d5e-3f2079846f15 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:24.746348 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-de305b98-19ae-4d8a-a19c-c1a85340f03d req-f7ed5a6d-84cd-426c-8d5e-3f2079846f15 service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=8a32187e285543a88aae7f4283a9636f&device_id=0ec5c357-a1ce-4f29-a687-f059eadabd44 HTTP/1.1" status: 200  len: 1096 time: 0.0787878
May 20 04:27:24.786878 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8245b6b8-037a-412e-8f91-88f438a0b34d req-69ed244a-6065-4a61-adb4-d1c7e354252a tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:24.788598 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-8245b6b8-037a-412e-8f91-88f438a0b34d req-69ed244a-6065-4a61-adb4-d1c7e354252a tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.71 "GET /v2.0/ports?device_id=0ec5c357-a1ce-4f29-a687-f059eadabd44 HTTP/1.1" status: 200  len: 943 time: 0.0885811
May 20 04:27:24.819319 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-de305b98-19ae-4d8a-a19c-c1a85340f03d req-4e334044-afc7-4753-8c26-d1b58bc7dd4a service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=576807fb-2ca4-4b24-9f9f-348539f6ff95 HTTP/1.1" status: 200  len: 217 time: 0.0652897
May 20 04:27:24.841081 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-8245b6b8-037a-412e-8f91-88f438a0b34d req-6103d645-5548-4960-a3ef-87ecf9149fb4 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.71 "GET /v2.0/security-groups?id=e79e4ba4-358f-4b35-b5f3-7372b5116def&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0465298
May 20 04:27:24.887570 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de305b98-19ae-4d8a-a19c-c1a85340f03d req-d416d7f5-0961-4b31-a6dc-d23d1e5376b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:24.889035 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-de305b98-19ae-4d8a-a19c-c1a85340f03d req-d416d7f5-0961-4b31-a6dc-d23d1e5376b8 service neutron] 10.222.0.82 "GET /v2.0/subnets?id=2dceece0-8bc3-4f29-a183-108f8744d094 HTTP/1.1" status: 200  len: 853 time: 0.0617492
May 20 04:27:24.939374 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-de305b98-19ae-4d8a-a19c-c1a85340f03d req-09213edb-5ca8-4bbf-b5d7-40f5fe76498f service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=c6308b4a-efff-48c2-b41d-58a08edddda1&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0424740
May 20 04:27:25.090378 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-de305b98-19ae-4d8a-a19c-c1a85340f03d req-68803544-42fb-4c68-b860-7d5dbd7e9418 service neutron] 10.222.0.82 "GET /v2.0/networks/c6308b4a-efff-48c2-b41d-58a08edddda1?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1430266
May 20 04:27:25.241009 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-de305b98-19ae-4d8a-a19c-c1a85340f03d req-61fe103a-85b7-47b0-a511-a90831ae333d service neutron] 10.222.0.82 "GET /v2.0/networks/c6308b4a-efff-48c2-b41d-58a08edddda1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1431417
May 20 04:27:25.425324 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f77b5e68-4c56-4c3f-91b1-612b292cb8c1 req-7660f5be-2841-4d3d-8ecb-ff94e7ee37c4 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:25.426899 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-f77b5e68-4c56-4c3f-91b1-612b292cb8c1 req-7660f5be-2841-4d3d-8ecb-ff94e7ee37c4 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=67a5d1ca-6a84-4a8b-8aeb-83c49965926d HTTP/1.1" status: 200  len: 946 time: 0.1461635
May 20 04:27:25.429928 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b59fba3-5584-45d0-b06f-ce5b960e49e8 req-06176e72-d7ee-43c9-b915-5aa24a0b9fdd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:25.431328 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4b59fba3-5584-45d0-b06f-ce5b960e49e8 req-06176e72-d7ee-43c9-b915-5aa24a0b9fdd service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=8a32187e285543a88aae7f4283a9636f&device_id=0ec5c357-a1ce-4f29-a687-f059eadabd44 HTTP/1.1" status: 200  len: 1096 time: 0.1088703
May 20 04:27:25.564722 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-f77b5e68-4c56-4c3f-91b1-612b292cb8c1 req-7e906e09-773b-4726-bb97-4d3e6ec27fe7 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1294150
May 20 04:27:25.630607 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b59fba3-5584-45d0-b06f-ce5b960e49e8 req-7bdd918e-b052-4c38-bb64-45231004bc31 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:25.633188 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4b59fba3-5584-45d0-b06f-ce5b960e49e8 req-7bdd918e-b052-4c38-bb64-45231004bc31 service neutron] 10.222.0.82 "GET /v2.0/networks?id=c6308b4a-efff-48c2-b41d-58a08edddda1 HTTP/1.1" status: 200  len: 914 time: 0.1825743
May 20 04:27:25.711848 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4b59fba3-5584-45d0-b06f-ce5b960e49e8 req-7ceefe18-d61f-42f1-a05e-2c6a5dd08550 service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=576807fb-2ca4-4b24-9f9f-348539f6ff95 HTTP/1.1" status: 200  len: 217 time: 0.0714376
May 20 04:27:25.791590 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b59fba3-5584-45d0-b06f-ce5b960e49e8 req-3b3ce245-1654-4e13-b74e-7413b24f1320 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:25.793185 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4b59fba3-5584-45d0-b06f-ce5b960e49e8 req-3b3ce245-1654-4e13-b74e-7413b24f1320 service neutron] 10.222.0.82 "GET /v2.0/subnets?id=2dceece0-8bc3-4f29-a183-108f8744d094 HTTP/1.1" status: 200  len: 853 time: 0.0747390
May 20 04:27:25.843233 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4b59fba3-5584-45d0-b06f-ce5b960e49e8 req-ec44b8e3-3f45-4b27-be1f-e349afa2cfd8 service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=c6308b4a-efff-48c2-b41d-58a08edddda1&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0421312
May 20 04:27:26.026392 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4b59fba3-5584-45d0-b06f-ce5b960e49e8 req-bdb96436-84ff-4927-b004-ee5e2eb9c589 service neutron] 10.222.0.82 "GET /v2.0/networks/c6308b4a-efff-48c2-b41d-58a08edddda1?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1748629
May 20 04:27:26.059343 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49b7496e-f0b8-490a-933a-101aabb5bdc1 req-fa0c9e56-2a4e-4a8f-967b-00b4d12ced8a tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:26.061200 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-49b7496e-f0b8-490a-933a-101aabb5bdc1 req-fa0c9e56-2a4e-4a8f-967b-00b4d12ced8a tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.71 "GET /v2.0/ports?device_id=0ec5c357-a1ce-4f29-a687-f059eadabd44 HTTP/1.1" status: 200  len: 943 time: 0.1021740
May 20 04:27:26.110708 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-49b7496e-f0b8-490a-933a-101aabb5bdc1 req-8f1f682c-59b4-4ca9-a637-4f4d8139a127 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.71 "GET /v2.0/security-groups?id=e79e4ba4-358f-4b35-b5f3-7372b5116def&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0430417
May 20 04:27:26.172262 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05b085d2-c2e6-4a95-9629-69c176a8348e req-61514ff1-a72c-4a55-b637-3afd34277e52 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:26.173783 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-05b085d2-c2e6-4a95-9629-69c176a8348e req-61514ff1-a72c-4a55-b637-3afd34277e52 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.82 "GET /v2.0/ports?device_id=67a5d1ca-6a84-4a8b-8aeb-83c49965926d HTTP/1.1" status: 200  len: 946 time: 0.1917624
May 20 04:27:26.315088 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4b59fba3-5584-45d0-b06f-ce5b960e49e8 req-59e70946-000f-497c-bcb5-c4f93430542c service neutron] 10.222.0.82 "GET /v2.0/networks/c6308b4a-efff-48c2-b41d-58a08edddda1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2769575
May 20 04:27:26.401233 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [req-05b085d2-c2e6-4a95-9629-69c176a8348e req-6131d811-cd30-44c5-9d04-3d1140f0ca21 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Deleting port 9a903ca5-2762-405a-81bb-5c3dce3d256a {{(pid=91687) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 04:27:26.401473 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-05b085d2-c2e6-4a95-9629-69c176a8348e req-6131d811-cd30-44c5-9d04-3d1140f0ca21 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8782892520551'] for port, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:26.544623 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [req-05b085d2-c2e6-4a95-9629-69c176a8348e req-6131d811-cd30-44c5-9d04-3d1140f0ca21 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] For port 9a903ca5-2762-405a-81bb-5c3dce3d256a, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=9a903ca5-2762-405a-81bb-5c3dce3d256a,segment=NetworkSegment(0ad1d987-000a-4092-8d15-811f90922b00),segment_id=0ad1d987-000a-4092-8d15-811f90922b00)] {{(pid=91687) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:27:26.545050 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-05b085d2-c2e6-4a95-9629-69c176a8348e req-6131d811-cd30-44c5-9d04-3d1140f0ca21 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1718922'] for port, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:26.700686 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [req-05b085d2-c2e6-4a95-9629-69c176a8348e req-6131d811-cd30-44c5-9d04-3d1140f0ca21 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Calling delete_port for 9a903ca5-2762-405a-81bb-5c3dce3d256a owned by compute:nova {{(pid=91687) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 04:27:26.810958 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b6649fa-4999-435a-90a9-abb9942760ff req-b291277a-f65a-49ac-8d95-a37381b7aaf1 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:26.812544 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-8b6649fa-4999-435a-90a9-abb9942760ff req-b291277a-f65a-49ac-8d95-a37381b7aaf1 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/ports?device_id=67a5d1ca-6a84-4a8b-8aeb-83c49965926d HTTP/1.1" status: 200  len: 946 time: 0.1198983
May 20 04:27:26.919158 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-8b6649fa-4999-435a-90a9-abb9942760ff req-438a638b-8ec0-4187-aa15-082a8c6c81ba tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.71 "GET /v2.0/security-groups?id=bfbed793-323e-4182-8252-80af79e38321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0975552
May 20 04:27:26.932228 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-05b085d2-c2e6-4a95-9629-69c176a8348e req-6131d811-cd30-44c5-9d04-3d1140f0ca21 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8782892522936', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8782892108804', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4162192'] for port, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:26.940648 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-3c70f0e8-8ed6-4fc4-9746-0153ff435fe4 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:27:26.945785 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] get_ports_and_sgs() called for port_ids ['9a903ca5-2762-405a-81bb-5c3dce3d256a'] {{(pid=91688) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 04:27:26.991214 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6131d811-cd30-44c5-9d04-3d1140f0ca21 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Pushing event deleted for resources: {'Port': ['ID=9a903ca5-2762-405a-81bb-5c3dce3d256a,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:27:26.993817 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-6131d811-cd30-44c5-9d04-3d1140f0ca21 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:27:27.081070 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.l3_dvrscheduler_db [req-05b085d2-c2e6-4a95-9629-69c176a8348e req-6131d811-cd30-44c5-9d04-3d1140f0ca21 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] No DVR routers for this DVR port 9a903ca5-2762-405a-81bb-5c3dce3d256a on host hv-cinder-79091 {{(pid=91687) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 04:27:27.084425 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-05b085d2-c2e6-4a95-9629-69c176a8348e req-6131d811-cd30-44c5-9d04-3d1140f0ca21 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for port, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:27.088618 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '67a5d1ca-6a84-4a8b-8aeb-83c49965926d', 'name': 'network-vif-deleted', 'tag': '9a903ca5-2762-405a-81bb-5c3dce3d256a'}] {{(pid=91687) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:27:27.105305 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-05b085d2-c2e6-4a95-9629-69c176a8348e req-6131d811-cd30-44c5-9d04-3d1140f0ca21 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] 10.222.0.82 "DELETE /v2.0/ports/9a903ca5-2762-405a-81bb-5c3dce3d256a HTTP/1.1" status: 204  len: 173 time: 0.9226692
May 20 04:27:27.190743 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '67a5d1ca-6a84-4a8b-8aeb-83c49965926d', 'name': 'network-vif-deleted', 'tag': '9a903ca5-2762-405a-81bb-5c3dce3d256a', 'status': 'completed', 'code': 200}
May 20 04:27:27.295691 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 43014) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:27:27.383613 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f6c872e-276f-4ddd-9da5-044f656a153f req-32182179-9d58-42e7-b3b2-7d02a84a5cbf tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:27.385396 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-8f6c872e-276f-4ddd-9da5-044f656a153f req-32182179-9d58-42e7-b3b2-7d02a84a5cbf tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.71 "GET /v2.0/ports?device_id=0ec5c357-a1ce-4f29-a687-f059eadabd44 HTTP/1.1" status: 200  len: 943 time: 0.1266112
May 20 04:27:27.439340 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-8f6c872e-276f-4ddd-9da5-044f656a153f req-4a8a48ca-01a0-4ae2-9a5d-e48e989013bd tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.71 "GET /v2.0/security-groups?id=e79e4ba4-358f-4b35-b5f3-7372b5116def&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0478950
May 20 04:27:27.454191 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-2017ee4c-d2b8-499a-abd3-348be15c49f2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:27.471883 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-2017ee4c-d2b8-499a-abd3-348be15c49f2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:27:27.476082 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-2017ee4c-d2b8-499a-abd3-348be15c49f2 admin admin] Usage tracker for resource:security_group_rule and tenant:ea91b2f7008d432296be48b371ca7817 is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:27:27.479497 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-2017ee4c-d2b8-499a-abd3-348be15c49f2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:27:27.486331 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-2017ee4c-d2b8-499a-abd3-348be15c49f2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:27:27.584045 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-2017ee4c-d2b8-499a-abd3-348be15c49f2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:27.588859 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-2017ee4c-d2b8-499a-abd3-348be15c49f2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:27.597445 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-16c63a3b-e040-4862-9cf0-fb4a4ed9ddfe admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:27:27.640415 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-2017ee4c-d2b8-499a-abd3-348be15c49f2 admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=ea91b2f7008d432296be48b371ca7817&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3432364
May 20 04:27:27.641397 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2017ee4c-d2b8-499a-abd3-348be15c49f2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=90b4b53b-9fd7-42d6-866c-1ba823d65fe1,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:27:27.643954 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 43020) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:27:27.647014 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-2017ee4c-d2b8-499a-abd3-348be15c49f2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:27:27.713405 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-55712edb-9ee6-4b04-8721-d7ef68cd3b24 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:27.741331 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-55712edb-9ee6-4b04-8721-d7ef68cd3b24 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:27.829289 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-55712edb-9ee6-4b04-8721-d7ef68cd3b24 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:27.835075 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-af0e688a-e66e-4f2a-8604-0a27155ccb28 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:27:27.847983 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55712edb-9ee6-4b04-8721-d7ef68cd3b24 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=90b4b53b-9fd7-42d6-866c-1ba823d65fe1,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:27:27.851332 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-55712edb-9ee6-4b04-8721-d7ef68cd3b24 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:27:27.853662 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-55712edb-9ee6-4b04-8721-d7ef68cd3b24 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:27.854980 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-55712edb-9ee6-4b04-8721-d7ef68cd3b24 admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/90b4b53b-9fd7-42d6-866c-1ba823d65fe1 HTTP/1.1" status: 204  len: 168 time: 0.2097611
May 20 04:27:28.034609 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 43030) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:27:28.041777 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 576807fb-2ca4-4b24-9f9f-348539f6ff95 details requested by agent hyperv_hv-cinder-79091 with host hv-cinder-79091 {{(pid=91688) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 20 04:27:28.097895 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.db_base_plugin_v2 [None req-73c6798d-a3b5-4f99-b239-3d7192c73e7c admin admin] Deleting subnet 2a9c681d-a9be-4897-91bb-31aeb6432254 {{(pid=91686) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 20 04:27:28.102474 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-73c6798d-a3b5-4f99-b239-3d7192c73e7c admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:28.152693 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-73c6798d-a3b5-4f99-b239-3d7192c73e7c admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4081462'] for subnet, precommit_delete_associations {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:28.194635 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port 576807fb-2ca4-4b24-9f9f-348539f6ff95, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=576807fb-2ca4-4b24-9f9f-348539f6ff95,segment=NetworkSegment(3cfe6ee0-17fa-47f2-8f37-995aaef6bfdc),segment_id=3cfe6ee0-17fa-47f2-8f37-995aaef6bfdc)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:27:28.209256 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Returning: {'device': '576807fb-2ca4-4b24-9f9f-348539f6ff95', 'network_id': 'c6308b4a-efff-48c2-b41d-58a08edddda1', 'port_id': '576807fb-2ca4-4b24-9f9f-348539f6ff95', 'mac_address': 'fa:16:3e:b7:e2:f5', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 899, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2dceece0-8bc3-4f29-a183-108f8744d094', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91688) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 20 04:27:28.218340 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-73c6798d-a3b5-4f99-b239-3d7192c73e7c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1504133'] for subnet, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:28.271059 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:28.292599 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.notifiers.nova [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 576807fb-2ca4-4b24-9f9f-348539f6ff95 {{(pid=91688) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 04:27:28.310148 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port 576807fb-2ca4-4b24-9f9f-348539f6ff95, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=576807fb-2ca4-4b24-9f9f-348539f6ff95,segment=NetworkSegment(3cfe6ee0-17fa-47f2-8f37-995aaef6bfdc),segment_id=3cfe6ee0-17fa-47f2-8f37-995aaef6bfdc)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:27:28.314919 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:28.318203 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:27:28.408166 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Pushing event updated for resources: {'Port': ['ID=576807fb-2ca4-4b24-9f9f-348539f6ff95,revision_number=4']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:27:28.412405 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:27:28.627719 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-73c6798d-a3b5-4f99-b239-3d7192c73e7c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1504178', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-255887', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2114755', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2442237'] for subnet, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:28.633171 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:27:28.636420 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28334a44-c92d-4930-b59b-a96c87bb5765 req-b03aaca9-e219-483e-8cd9-807761401357 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:28.638004 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-28334a44-c92d-4930-b59b-a96c87bb5765 req-b03aaca9-e219-483e-8cd9-807761401357 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.71 "GET /v2.0/ports?device_id=0ec5c357-a1ce-4f29-a687-f059eadabd44 HTTP/1.1" status: 200  len: 944 time: 0.0869389
May 20 04:27:28.670346 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-73c6798d-a3b5-4f99-b239-3d7192c73e7c admin admin] Notify callbacks [] for subnet, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:28.676861 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-73c6798d-a3b5-4f99-b239-3d7192c73e7c admin admin] 10.222.0.71 "DELETE /v2.0/subnets/2a9c681d-a9be-4897-91bb-31aeb6432254 HTTP/1.1" status: 204  len: 168 time: 0.6411059
May 20 04:27:28.677789 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73c6798d-a3b5-4f99-b239-3d7192c73e7c admin admin] Pushing event deleted for resources: {'Subnet': ['ID=2a9c681d-a9be-4897-91bb-31aeb6432254,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:27:28.679435 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 43052) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:27:28.680395 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-73c6798d-a3b5-4f99-b239-3d7192c73e7c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:27:28.687188 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] get_ports_and_sgs() called for port_ids ['576807fb-2ca4-4b24-9f9f-348539f6ff95'] {{(pid=91688) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 04:27:28.724400 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-28334a44-c92d-4930-b59b-a96c87bb5765 req-9dd24ce6-a260-460d-9386-b61b6046f9ba tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.71 "GET /v2.0/security-groups?id=e79e4ba4-358f-4b35-b5f3-7372b5116def&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0800717
May 20 04:27:28.803020 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-59487d47-2e70-405a-a7ac-5cb753cf58c0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-593149'] for network, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:28.947342 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-59487d47-2e70-405a-a7ac-5cb753cf58c0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1505550', 'neutron.services.segments.db._delete_segments_for_network-8782892550274'] for network, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:28.962794 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.services.segments.db [None req-59487d47-2e70-405a-a7ac-5cb753cf58c0 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fced13aa730>,) {'filters': {'network_id': ['20ab5e30-591a-443a-9e34-f3a1b7563f5d']}} {{(pid=91687) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:27:28.977282 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.services.segments.db [None req-59487d47-2e70-405a-a7ac-5cb753cf58c0 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fced13aa730>, '0ad1d987-000a-4092-8d15-811f90922b00') {'for_net_delete': True} {{(pid=91687) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:27:28.977657 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.services.segments.db [None req-59487d47-2e70-405a-a7ac-5cb753cf58c0 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fced13aa730>, '0ad1d987-000a-4092-8d15-811f90922b00') {} {{(pid=91687) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:27:28.991834 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-59487d47-2e70-405a-a7ac-5cb753cf58c0 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8782892560523', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-936621'] for segment, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:29.009609 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-59487d47-2e70-405a-a7ac-5cb753cf58c0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1501910'] for segment, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:29.016540 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-59487d47-2e70-405a-a7ac-5cb753cf58c0 admin admin] Releasing vlan 876 on physical network physnet1 to pool {{(pid=91687) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 20 04:27:29.016940 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-59487d47-2e70-405a-a7ac-5cb753cf58c0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1501910', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-4162285'] for segment, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:29.030766 dv-cinder-790910-4-iscsi neutron-server[91687]: Traceback (most recent call last):
May 20 04:27:29.030766 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 20 04:27:29.030766 dv-cinder-790910-4-iscsi neutron-server[91687]:     timer()
May 20 04:27:29.030766 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 20 04:27:29.030766 dv-cinder-790910-4-iscsi neutron-server[91687]:     cb(*args, **kw)
May 20 04:27:29.030766 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 20 04:27:29.030766 dv-cinder-790910-4-iscsi neutron-server[91687]:     return func(*args, **kwargs)
May 20 04:27:29.030766 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 20 04:27:29.030766 dv-cinder-790910-4-iscsi neutron-server[91687]:     self._notify()
May 20 04:27:29.030766 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 20 04:27:29.030766 dv-cinder-790910-4-iscsi neutron-server[91687]:     self.callback(batched_events)
May 20 04:27:29.030766 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 20 04:27:29.030766 dv-cinder-790910-4-iscsi neutron-server[91687]:     event.method(event)
May 20 04:27:29.030766 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 20 04:27:29.030766 dv-cinder-790910-4-iscsi neutron-server[91687]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 20 04:27:29.030766 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 20 04:27:29.030766 dv-cinder-790910-4-iscsi neutron-server[91687]:     aggregate_uuid = self.p_client.list_aggregates(
May 20 04:27:29.030766 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 20 04:27:29.030766 dv-cinder-790910-4-iscsi neutron-server[91687]:     return f(self, *a, **k)
May 20 04:27:29.030766 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 20 04:27:29.030766 dv-cinder-790910-4-iscsi neutron-server[91687]:     return self._get(url).json()
May 20 04:27:29.030766 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 20 04:27:29.030766 dv-cinder-790910-4-iscsi neutron-server[91687]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 20 04:27:29.030766 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 20 04:27:29.030766 dv-cinder-790910-4-iscsi neutron-server[91687]:     return self.request(url, 'GET', **kwargs)
May 20 04:27:29.030766 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 20 04:27:29.030766 dv-cinder-790910-4-iscsi neutron-server[91687]:     base_url = self.get_endpoint(auth, allow=allow,
May 20 04:27:29.030766 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 20 04:27:29.030766 dv-cinder-790910-4-iscsi neutron-server[91687]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 20 04:27:29.030766 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 20 04:27:29.030766 dv-cinder-790910-4-iscsi neutron-server[91687]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 20 04:27:29.030766 dv-cinder-790910-4-iscsi neutron-server[91687]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 20 04:27:29.117832 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-59487d47-2e70-405a-a7ac-5cb753cf58c0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1505543', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1590664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1781430', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1713996'] for network, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:29.127546 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-e765311a-9423-4b14-82bd-260cf53842c7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:27:29.145603 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-59487d47-2e70-405a-a7ac-5cb753cf58c0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for network, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:29.154754 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59487d47-2e70-405a-a7ac-5cb753cf58c0 admin admin] Pushing event deleted for resources: {'Network': ['ID=20ab5e30-591a-443a-9e34-f3a1b7563f5d,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:27:29.163142 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-59487d47-2e70-405a-a7ac-5cb753cf58c0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:27:29.175266 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-59487d47-2e70-405a-a7ac-5cb753cf58c0 admin admin] 10.222.0.71 "DELETE /v2.0/networks/20ab5e30-591a-443a-9e34-f3a1b7563f5d HTTP/1.1" status: 204  len: 168 time: 0.4946718
May 20 04:27:29.229202 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 43066) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:27:29.355654 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-304a7bf5-24fb-47a6-98f4-ffbd2dfe5a92 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:29.370962 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-304a7bf5-24fb-47a6-98f4-ffbd2dfe5a92 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:27:29.375880 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-304a7bf5-24fb-47a6-98f4-ffbd2dfe5a92 admin admin] Usage tracker for resource:security_group_rule and tenant:9684c0296fd44197b30b9708eb78a5c8 is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:27:29.378861 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-304a7bf5-24fb-47a6-98f4-ffbd2dfe5a92 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:27:29.385188 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-304a7bf5-24fb-47a6-98f4-ffbd2dfe5a92 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:27:29.386817 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 43072) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:27:29.444467 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-ea7aa25c-14ba-4311-a8a0-0ef1637c8e1d admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=6484c55ce8204dc3802efc929a51c4a5&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0561593
May 20 04:27:29.447815 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 43076) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:27:29.486180 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-304a7bf5-24fb-47a6-98f4-ffbd2dfe5a92 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:29.491725 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-304a7bf5-24fb-47a6-98f4-ffbd2dfe5a92 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:29.501899 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-9af795ca-9add-4c3a-a307-79af1358f1c1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:27:29.520676 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-8933fcdf-0cd7-4a84-8409-4d60fff0e9c4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:29.545333 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-304a7bf5-24fb-47a6-98f4-ffbd2dfe5a92 admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=9684c0296fd44197b30b9708eb78a5c8&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3147373
May 20 04:27:29.547211 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-304a7bf5-24fb-47a6-98f4-ffbd2dfe5a92 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7d2774c7-cca7-44e8-ac45-19b63db1c698,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:27:29.549674 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 43080) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:27:29.550416 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-304a7bf5-24fb-47a6-98f4-ffbd2dfe5a92 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:27:29.554758 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-8933fcdf-0cd7-4a84-8409-4d60fff0e9c4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:29.651391 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-be853623-7992-45c6-a175-fb5a026a89e8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:29.673524 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-8933fcdf-0cd7-4a84-8409-4d60fff0e9c4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:29.681772 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-58b24cad-b3bf-4461-b7e1-730717022e64 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:27:29.698295 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-be853623-7992-45c6-a175-fb5a026a89e8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:29.705330 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8933fcdf-0cd7-4a84-8409-4d60fff0e9c4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bfbed793-323e-4182-8252-80af79e38321,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:27:29.710948 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-8933fcdf-0cd7-4a84-8409-4d60fff0e9c4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:27:29.742999 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-8933fcdf-0cd7-4a84-8409-4d60fff0e9c4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:29.744143 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-8933fcdf-0cd7-4a84-8409-4d60fff0e9c4 admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/bfbed793-323e-4182-8252-80af79e38321 HTTP/1.1" status: 204  len: 168 time: 0.2948453
May 20 04:27:29.774194 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-be853623-7992-45c6-a175-fb5a026a89e8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:29.779508 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-4562f8cb-3940-41c6-9ef3-62378c9a9b03 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:27:29.793769 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be853623-7992-45c6-a175-fb5a026a89e8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7d2774c7-cca7-44e8-ac45-19b63db1c698,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:27:29.796109 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-be853623-7992-45c6-a175-fb5a026a89e8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:27:29.798994 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-be853623-7992-45c6-a175-fb5a026a89e8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:29.800104 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-be853623-7992-45c6-a175-fb5a026a89e8 admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/7d2774c7-cca7-44e8-ac45-19b63db1c698 HTTP/1.1" status: 204  len: 168 time: 0.2487624
May 20 04:27:29.858888 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-6dba8aa9-a714-4d68-89fc-9c5581bd756c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:29.946293 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22950e26-4b7d-4930-b49f-be0438afeb23 req-3214c754-0197-4974-b5bc-244b4296f3c8 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:29.948003 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-22950e26-4b7d-4930-b49f-be0438afeb23 req-3214c754-0197-4974-b5bc-244b4296f3c8 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.71 "GET /v2.0/ports?device_id=0ec5c357-a1ce-4f29-a687-f059eadabd44 HTTP/1.1" status: 200  len: 944 time: 0.1032903
May 20 04:27:30.005740 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-22950e26-4b7d-4930-b49f-be0438afeb23 req-43b43bb7-3bf0-4cd3-8ceb-fa846f4ea4bf tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.71 "GET /v2.0/security-groups?id=e79e4ba4-358f-4b35-b5f3-7372b5116def&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0505173
May 20 04:27:30.062324 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 576807fb-2ca4-4b24-9f9f-348539f6ff95 up at agent hyperv_hv-cinder-79091 {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:27:30.137110 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Provisioning for port 576807fb-2ca4-4b24-9f9f-348539f6ff95 completed by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:27:30.142805 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Provisioning complete for port 576807fb-2ca4-4b24-9f9f-348539f6ff95 triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:27:30.143362 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:30.349813 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:30.384189 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0ec5c357-a1ce-4f29-a687-f059eadabd44', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '576807fb-2ca4-4b24-9f9f-348539f6ff95'}] {{(pid=91688) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:27:30.410755 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port 576807fb-2ca4-4b24-9f9f-348539f6ff95, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=576807fb-2ca4-4b24-9f9f-348539f6ff95,segment=NetworkSegment(3cfe6ee0-17fa-47f2-8f37-995aaef6bfdc),segment_id=3cfe6ee0-17fa-47f2-8f37-995aaef6bfdc)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:27:30.418977 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:30.420145 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 9a903ca5-2762-405a-81bb-5c3dce3d256a no longer exists at agent hyperv_hv-cinder-79091 {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 04:27:30.468475 dv-cinder-790910-4-iscsi neutron-server[91688]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0ec5c357-a1ce-4f29-a687-f059eadabd44', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '576807fb-2ca4-4b24-9f9f-348539f6ff95', 'code': 200}
May 20 04:27:30.474093 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:27:30.529212 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] No Port match for: 9a903ca5-2762-405a-81bb-5c3dce3d256a {{(pid=91688) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 04:27:30.529868 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 9a903ca5-2762-405a-81bb-5c3dce3d256a not bound to the agent host hv-cinder-79091 {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 04:27:30.571255 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Pushing event updated for resources: {'Port': ['ID=576807fb-2ca4-4b24-9f9f-348539f6ff95,revision_number=5']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:27:30.575699 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:27:30.740392 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f87ca06e-4e6f-49ff-8bbd-84740fb7baa5 req-c4b74f76-8e94-48dc-aa31-d3b021f3215f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:30.742640 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-f87ca06e-4e6f-49ff-8bbd-84740fb7baa5 req-c4b74f76-8e94-48dc-aa31-d3b021f3215f service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=0ec5c357-a1ce-4f29-a687-f059eadabd44 HTTP/1.1" status: 200  len: 1098 time: 0.0818949
May 20 04:27:30.794196 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-f87ca06e-4e6f-49ff-8bbd-84740fb7baa5 req-33a2371f-f29f-4fa8-9736-974cb88f599f service neutron] 10.222.0.82 "GET /v2.0/security-groups?id=e79e4ba4-358f-4b35-b5f3-7372b5116def&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0435450
May 20 04:27:31.200273 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73e9c7ed-1fef-4d5d-8476-b9117fd61c5e req-868c6d00-403f-4d40-8e88-540694e42b6c tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:31.201840 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-73e9c7ed-1fef-4d5d-8476-b9117fd61c5e req-868c6d00-403f-4d40-8e88-540694e42b6c tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.71 "GET /v2.0/ports?device_id=0ec5c357-a1ce-4f29-a687-f059eadabd44 HTTP/1.1" status: 200  len: 945 time: 0.0861101
May 20 04:27:31.284351 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-73e9c7ed-1fef-4d5d-8476-b9117fd61c5e req-5c76f1da-0e69-48bd-b36f-810b38eafda4 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.71 "GET /v2.0/security-groups?id=e79e4ba4-358f-4b35-b5f3-7372b5116def&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0729332
May 20 04:27:32.553433 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:32.571205 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cce80b00-3ab2-4c9e-9c8d-e2021727d452 req-a3dff10c-5712-4f52-aef3-c46d96f0e848 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:32.572651 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-cce80b00-3ab2-4c9e-9c8d-e2021727d452 req-a3dff10c-5712-4f52-aef3-c46d96f0e848 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.71 "GET /v2.0/ports?device_id=0ec5c357-a1ce-4f29-a687-f059eadabd44 HTTP/1.1" status: 200  len: 945 time: 0.1774352
May 20 04:27:32.619968 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-cce80b00-3ab2-4c9e-9c8d-e2021727d452 req-00599189-a7b2-4cd6-954b-970025782cc0 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.71 "GET /v2.0/security-groups?id=e79e4ba4-358f-4b35-b5f3-7372b5116def&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0412006
May 20 04:27:32.691344 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-32d9264b-fe5a-401a-a0ab-62fbc785abf3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:32.869865 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9e0e91fe-85e9-4017-ac42-8deee097ff48 req-709d5ed7-7e2f-44bd-ad68-9d5a463ab4a1 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] 10.222.0.71 "GET /v2.0/networks?tenant_id=d1926a94d80b41c39bbbe68e9f355bad&shared=False HTTP/1.1" status: 200  len: 213 time: 0.0278349
May 20 04:27:33.041745 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e0e91fe-85e9-4017-ac42-8deee097ff48 req-d2920dbd-89d2-493e-a495-097087f65994 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:33.043071 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9e0e91fe-85e9-4017-ac42-8deee097ff48 req-d2920dbd-89d2-493e-a495-097087f65994 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] 10.222.0.71 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 769 time: 0.1713452
May 20 04:27:33.059280 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9e0e91fe-85e9-4017-ac42-8deee097ff48 req-750375d0-bf29-46ab-8e0a-7cf1f631aa16 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] 10.222.0.71 "GET /v2.0/quotas/d1926a94d80b41c39bbbe68e9f355bad HTTP/1.1" status: 200  len: 375 time: 0.0101879
May 20 04:27:33.122954 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9e0e91fe-85e9-4017-ac42-8deee097ff48 req-091aec49-8f9f-4dd6-be50-92517ff3085f tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] 10.222.0.71 "GET /v2.0/ports?tenant_id=d1926a94d80b41c39bbbe68e9f355bad&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0525460
May 20 04:27:33.335365 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ea4803bd-878f-47d5-9084-1ec41953c9db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:33.407106 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-5084fccf-4d75-4602-9392-3396aa246895 req-f5a16f26-a92f-44e8-98d3-e0a9624cfa64 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] 10.222.0.71 "GET /v2.0/ports?device_id=3836caa9-25d3-4def-82ca-4fb4e1feb7bd HTTP/1.1" status: 200  len: 210 time: 0.0520644
May 20 04:27:34.502707 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9e0e91fe-85e9-4017-ac42-8deee097ff48 req-ad0eae4f-b72c-4353-8954-4511dddfbdc1 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] 10.222.0.82 "GET /v2.0/networks?tenant_id=d1926a94d80b41c39bbbe68e9f355bad&shared=False HTTP/1.1" status: 200  len: 213 time: 0.0334735
May 20 04:27:34.607021 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-8199434c-36b3-4403-85da-d187b866f935 req-80c57b96-e7eb-40ee-8115-39149fc780b0 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] 10.222.0.71 "GET /v2.0/ports?device_id=3836caa9-25d3-4def-82ca-4fb4e1feb7bd HTTP/1.1" status: 200  len: 210 time: 0.0663662
May 20 04:27:34.715348 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e0e91fe-85e9-4017-ac42-8deee097ff48 req-fb935ac1-3bdf-4520-b9c9-55c32ee94bdd tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:34.716731 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9e0e91fe-85e9-4017-ac42-8deee097ff48 req-fb935ac1-3bdf-4520-b9c9-55c32ee94bdd tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] 10.222.0.82 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 769 time: 0.2082307
May 20 04:27:34.732339 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [req-9e0e91fe-85e9-4017-ac42-8deee097ff48 req-c0156b01-0148-4c1f-ad43-d822d570b2bd tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Request body: {'port': {'device_id': '3836caa9-25d3-4def-82ca-4fb4e1feb7bd', 'network_id': 'c5893098-fb92-4405-a661-0d84b5d35597', 'admin_state_up': True, 'tenant_id': 'd1926a94d80b41c39bbbe68e9f355bad'}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:27:34.874733 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [req-9e0e91fe-85e9-4017-ac42-8deee097ff48 req-c0156b01-0148-4c1f-ad43-d822d570b2bd tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:27:34.878843 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-9e0e91fe-85e9-4017-ac42-8deee097ff48 req-c0156b01-0148-4c1f-ad43-d822d570b2bd tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Usage tracker for resource:port and tenant:d1926a94d80b41c39bbbe68e9f355bad is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:27:34.881909 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-9e0e91fe-85e9-4017-ac42-8deee097ff48 req-c0156b01-0148-4c1f-ad43-d822d570b2bd tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Quota usage for port was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:27:34.887820 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [req-9e0e91fe-85e9-4017-ac42-8deee097ff48 req-c0156b01-0148-4c1f-ad43-d822d570b2bd tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:27:34.899213 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-9e0e91fe-85e9-4017-ac42-8deee097ff48 req-c0156b01-0148-4c1f-ad43-d822d570b2bd tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Made reservation on behalf of d1926a94d80b41c39bbbe68e9f355bad for: {'port': 1} {{(pid=91687) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 04:27:34.903621 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-9e0e91fe-85e9-4017-ac42-8deee097ff48 req-c0156b01-0148-4c1f-ad43-d822d570b2bd tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:34.922393 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-9e0e91fe-85e9-4017-ac42-8deee097ff48 req-c0156b01-0148-4c1f-ad43-d822d570b2bd tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Notify callbacks [] for security_group, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:34.942088 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [req-9e0e91fe-85e9-4017-ac42-8deee097ff48 req-c0156b01-0148-4c1f-ad43-d822d570b2bd tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:27:34.946199 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-9e0e91fe-85e9-4017-ac42-8deee097ff48 req-c0156b01-0148-4c1f-ad43-d822d570b2bd tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Usage tracker for resource:security_group_rule and tenant:d1926a94d80b41c39bbbe68e9f355bad is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:27:34.949429 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-9e0e91fe-85e9-4017-ac42-8deee097ff48 req-c0156b01-0148-4c1f-ad43-d822d570b2bd tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:27:34.955544 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [req-9e0e91fe-85e9-4017-ac42-8deee097ff48 req-c0156b01-0148-4c1f-ad43-d822d570b2bd tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:27:35.061374 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-9e0e91fe-85e9-4017-ac42-8deee097ff48 req-c0156b01-0148-4c1f-ad43-d822d570b2bd tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Notify callbacks [] for security_group, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:35.067417 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-9e0e91fe-85e9-4017-ac42-8deee097ff48 req-c0156b01-0148-4c1f-ad43-d822d570b2bd tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:35.071910 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-a164b852-7947-416b-a56f-54e0ca624cf3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:27:35.150825 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0156b01-0148-4c1f-ad43-d822d570b2bd tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f6287422-b981-4166-af4a-9d85bf42c2af,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:27:35.156853 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-c0156b01-0148-4c1f-ad43-d822d570b2bd tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:27:35.200819 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f21320cc-6a25-4ec1-8a32-8b119b35fd55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:35.259050 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.db_base_plugin_common [req-9e0e91fe-85e9-4017-ac42-8deee097ff48 req-c0156b01-0148-4c1f-ad43-d822d570b2bd tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Allocated IP 192.168.233.170 (c5893098-fb92-4405-a661-0d84b5d35597/6c0e93b5-9ca2-4e5a-a26d-a06ab6a5226e/4206d003-d5be-4144-9b27-43b9aa8e7f47) {{(pid=91687) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 04:27:35.476439 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-9e0e91fe-85e9-4017-ac42-8deee097ff48 req-c0156b01-0148-4c1f-ad43-d822d570b2bd tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Notify callbacks [] for port, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:35.495422 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.provisioning_blocks [req-9e0e91fe-85e9-4017-ac42-8deee097ff48 req-c0156b01-0148-4c1f-ad43-d822d570b2bd tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Transition to ACTIVE for port object 4206d003-d5be-4144-9b27-43b9aa8e7f47 will not be triggered until provisioned by entity DHCP. {{(pid=91687) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:27:35.520075 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-9e0e91fe-85e9-4017-ac42-8deee097ff48 req-c0156b01-0148-4c1f-ad43-d822d570b2bd tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8782892106231', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4162192'] for port, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:35.526146 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-525226ef-b912-4089-8a9f-b2a5f2c1c382 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:27:35.593757 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-9e0e91fe-85e9-4017-ac42-8deee097ff48 req-c0156b01-0148-4c1f-ad43-d822d570b2bd tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Network c5893098-fb92-4405-a661-0d84b5d35597 is already hosted by enough agents. {{(pid=91687) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:27:35.597090 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.base_scheduler [req-9e0e91fe-85e9-4017-ac42-8deee097ff48 req-c0156b01-0148-4c1f-ad43-d822d570b2bd tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Resources bound (agent type, host, resource id):  {{(pid=91687) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:27:35.600037 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.l3_dvrscheduler_db [req-9e0e91fe-85e9-4017-ac42-8deee097ff48 req-c0156b01-0148-4c1f-ad43-d822d570b2bd tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Received port after_create {{(pid=91687) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 04:27:35.649362 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0156b01-0148-4c1f-ad43-d822d570b2bd tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Pushing event updated for resources: {'Port': ['ID=4206d003-d5be-4144-9b27-43b9aa8e7f47,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:27:35.658118 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-c0156b01-0148-4c1f-ad43-d822d570b2bd tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.132s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:27:35.681901 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e0e91fe-85e9-4017-ac42-8deee097ff48 req-c0156b01-0148-4c1f-ad43-d822d570b2bd tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:35.682606 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-9e0e91fe-85e9-4017-ac42-8deee097ff48 req-c0156b01-0148-4c1f-ad43-d822d570b2bd tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for port, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:35.716733 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9e0e91fe-85e9-4017-ac42-8deee097ff48 req-c0156b01-0148-4c1f-ad43-d822d570b2bd tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201  len: 938 time: 0.9888694
May 20 04:27:35.825735 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c45f066a-bac2-44a1-976f-5302732ac108 req-a9227ece-943e-472a-b0e3-f3a027fa6daa tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:35.827707 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-c45f066a-bac2-44a1-976f-5302732ac108 req-a9227ece-943e-472a-b0e3-f3a027fa6daa tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] 10.222.0.71 "GET /v2.0/ports?device_id=3836caa9-25d3-4def-82ca-4fb4e1feb7bd HTTP/1.1" status: 200  len: 936 time: 0.0919998
May 20 04:27:35.834363 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-6058f72d-3330-4d7e-97b5-8034b1d696bc None None] Provisioning for port 4206d003-d5be-4144-9b27-43b9aa8e7f47 completed by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:27:35.841927 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-6058f72d-3330-4d7e-97b5-8034b1d696bc None None] Provisioning complete for port 4206d003-d5be-4144-9b27-43b9aa8e7f47 triggered by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:27:35.842375 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-6058f72d-3330-4d7e-97b5-8034b1d696bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:35.884294 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-c45f066a-bac2-44a1-976f-5302732ac108 req-80baff89-156e-4b88-92a1-f0e074d8de32 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] 10.222.0.71 "GET /v2.0/security-groups?id=f6287422-b981-4166-af4a-9d85bf42c2af&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0490539
May 20 04:27:35.906949 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-6058f72d-3330-4d7e-97b5-8034b1d696bc None None] Port 4206d003-d5be-4144-9b27-43b9aa8e7f47 cannot update to ACTIVE because it is not bound. {{(pid=91688) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 20 04:27:36.525628 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:37.078337 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72613e4e-e9bb-461f-a0f1-0f72724f0b40 req-ed628308-15e7-40ae-bb2a-7a11cfd0acdc tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:37.079020 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-72613e4e-e9bb-461f-a0f1-0f72724f0b40 req-ed628308-15e7-40ae-bb2a-7a11cfd0acdc tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Synchronizing usage tracker for tenant:d1926a94d80b41c39bbbe68e9f355bad on resource:port {{(pid=91687) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:27:37.097426 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-72613e4e-e9bb-461f-a0f1-0f72724f0b40 req-ed628308-15e7-40ae-bb2a-7a11cfd0acdc tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Unset dirty status for tenant:d1926a94d80b41c39bbbe68e9f355bad on resource:port {{(pid=91687) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:27:37.098650 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-72613e4e-e9bb-461f-a0f1-0f72724f0b40 req-ed628308-15e7-40ae-bb2a-7a11cfd0acdc tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] 10.222.0.71 "GET /v2.0/ports?device_id=3836caa9-25d3-4def-82ca-4fb4e1feb7bd HTTP/1.1" status: 200  len: 936 time: 0.1001635
May 20 04:27:37.153312 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-72613e4e-e9bb-461f-a0f1-0f72724f0b40 req-90576ee2-b7f7-4bdc-b585-2122c1609aee tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Synchronizing usage tracker for tenant:d1926a94d80b41c39bbbe68e9f355bad on resource:security_group {{(pid=91687) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:27:37.172991 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-72613e4e-e9bb-461f-a0f1-0f72724f0b40 req-90576ee2-b7f7-4bdc-b585-2122c1609aee tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Unset dirty status for tenant:d1926a94d80b41c39bbbe68e9f355bad on resource:security_group {{(pid=91687) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:27:37.174207 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-72613e4e-e9bb-461f-a0f1-0f72724f0b40 req-90576ee2-b7f7-4bdc-b585-2122c1609aee tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] 10.222.0.71 "GET /v2.0/security-groups?id=f6287422-b981-4166-af4a-9d85bf42c2af&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0689867
May 20 04:27:37.802574 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [req-9e0e91fe-85e9-4017-ac42-8deee097ff48 req-f86d71df-99fb-4a16-904e-60c0046a6848 service neutron] Request body: {'port': {'device_id': '3836caa9-25d3-4def-82ca-4fb4e1feb7bd', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79091'}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:27:37.921438 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-9e0e91fe-85e9-4017-ac42-8deee097ff48 req-f86d71df-99fb-4a16-904e-60c0046a6848 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:38.365762 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.notifiers.nova [req-9e0e91fe-85e9-4017-ac42-8deee097ff48 req-f86d71df-99fb-4a16-904e-60c0046a6848 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 4206d003-d5be-4144-9b27-43b9aa8e7f47 {{(pid=91687) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 04:27:38.373994 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-9e0e91fe-85e9-4017-ac42-8deee097ff48 req-f86d71df-99fb-4a16-904e-60c0046a6848 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:38.376628 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd9d8977-26c9-4992-a5d2-7007c71b96e7 req-7f1ec83b-ac60-4e52-8f3e-573908d756fd tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:38.378283 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-cd9d8977-26c9-4992-a5d2-7007c71b96e7 req-7f1ec83b-ac60-4e52-8f3e-573908d756fd tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] 10.222.0.71 "GET /v2.0/ports?device_id=3836caa9-25d3-4def-82ca-4fb4e1feb7bd HTTP/1.1" status: 200  len: 936 time: 0.0881925
May 20 04:27:38.390518 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.provisioning_blocks [req-9e0e91fe-85e9-4017-ac42-8deee097ff48 req-f86d71df-99fb-4a16-904e-60c0046a6848 service neutron] Transition to ACTIVE for port object 4206d003-d5be-4144-9b27-43b9aa8e7f47 will not be triggered until provisioned by entity L2. {{(pid=91687) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:27:38.394832 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-9e0e91fe-85e9-4017-ac42-8deee097ff48 req-f86d71df-99fb-4a16-904e-60c0046a6848 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4162185'] for port, after_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:38.398740 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-fd692865-4767-4013-b5e7-d400e955d842 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:27:38.430881 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-cd9d8977-26c9-4992-a5d2-7007c71b96e7 req-c836637c-82af-4066-9c8d-eca75fc90874 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] 10.222.0.71 "GET /v2.0/security-groups?id=f6287422-b981-4166-af4a-9d85bf42c2af&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0464485
May 20 04:27:38.528033 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f86d71df-99fb-4a16-904e-60c0046a6848 service neutron] Pushing event updated for resources: {'Port': ['ID=4206d003-d5be-4144-9b27-43b9aa8e7f47,revision_number=2']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:27:38.555249 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-f86d71df-99fb-4a16-904e-60c0046a6848 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.156s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:27:38.663326 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.managers [req-9e0e91fe-85e9-4017-ac42-8deee097ff48 req-f86d71df-99fb-4a16-904e-60c0046a6848 service neutron] Attempting to bind port 4206d003-d5be-4144-9b27-43b9aa8e7f47 on host hv-cinder-79091 for vnic_type normal with profile  {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 04:27:38.663882 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.managers [req-9e0e91fe-85e9-4017-ac42-8deee097ff48 req-f86d71df-99fb-4a16-904e-60c0046a6848 service neutron] Attempting to bind port 4206d003-d5be-4144-9b27-43b9aa8e7f47 by drivers openvswitch,hyperv on host hv-cinder-79091 at level 0 using segments [{'id': '5d30f0fa-a01e-48f4-ae41-9529b23cf3c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 886, 'network_id': 'c5893098-fb92-4405-a661-0d84b5d35597'}] {{(pid=91687) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 04:27:38.664461 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9e0e91fe-85e9-4017-ac42-8deee097ff48 req-f86d71df-99fb-4a16-904e-60c0046a6848 service neutron] Attempting to bind port 4206d003-d5be-4144-9b27-43b9aa8e7f47 on network c5893098-fb92-4405-a661-0d84b5d35597 {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:27:38.673342 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9e0e91fe-85e9-4017-ac42-8deee097ff48 req-f86d71df-99fb-4a16-904e-60c0046a6848 service neutron] Port 4206d003-d5be-4144-9b27-43b9aa8e7f47 on network c5893098-fb92-4405-a661-0d84b5d35597 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79091 {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 20 04:27:38.673892 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9e0e91fe-85e9-4017-ac42-8deee097ff48 req-f86d71df-99fb-4a16-904e-60c0046a6848 service neutron] Attempting to bind port 4206d003-d5be-4144-9b27-43b9aa8e7f47 on network c5893098-fb92-4405-a661-0d84b5d35597 {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:27:38.683328 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9e0e91fe-85e9-4017-ac42-8deee097ff48 req-f86d71df-99fb-4a16-904e-60c0046a6848 service neutron] Checking agent: {'id': '7cc947fd-92eb-4d43-ad6b-ea002afff217', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79091', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 4, 19, 34), 'started_at': datetime.datetime(2021, 5, 20, 4, 19, 34), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 4, 27, 37), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 04:27:38.683886 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9e0e91fe-85e9-4017-ac42-8deee097ff48 req-f86d71df-99fb-4a16-904e-60c0046a6848 service neutron] Checking segment: {'id': '5d30f0fa-a01e-48f4-ae41-9529b23cf3c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 886, 'network_id': 'c5893098-fb92-4405-a661-0d84b5d35597'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91687) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:27:38.684512 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9e0e91fe-85e9-4017-ac42-8deee097ff48 req-f86d71df-99fb-4a16-904e-60c0046a6848 service neutron] Bound using segment: {'id': '5d30f0fa-a01e-48f4-ae41-9529b23cf3c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 886, 'network_id': 'c5893098-fb92-4405-a661-0d84b5d35597'} {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 04:27:38.685278 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.managers [req-9e0e91fe-85e9-4017-ac42-8deee097ff48 req-f86d71df-99fb-4a16-904e-60c0046a6848 service neutron] Bound port: 4206d003-d5be-4144-9b27-43b9aa8e7f47, host: hv-cinder-79091, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '5d30f0fa-a01e-48f4-ae41-9529b23cf3c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 886, 'network_id': 'c5893098-fb92-4405-a661-0d84b5d35597'}}] {{(pid=91687) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 04:27:38.685868 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-9e0e91fe-85e9-4017-ac42-8deee097ff48 req-f86d71df-99fb-4a16-904e-60c0046a6848 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:38.790306 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [req-9e0e91fe-85e9-4017-ac42-8deee097ff48 req-f86d71df-99fb-4a16-904e-60c0046a6848 service neutron] For port 4206d003-d5be-4144-9b27-43b9aa8e7f47, host hv-cinder-79091, cleared binding levels {{(pid=91687) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 04:27:38.793535 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [req-9e0e91fe-85e9-4017-ac42-8deee097ff48 req-f86d71df-99fb-4a16-904e-60c0046a6848 service neutron] For port 4206d003-d5be-4144-9b27-43b9aa8e7f47, host hv-cinder-79091, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=4206d003-d5be-4144-9b27-43b9aa8e7f47,segment=NetworkSegment(5d30f0fa-a01e-48f4-ae41-9529b23cf3c9),segment_id=5d30f0fa-a01e-48f4-ae41-9529b23cf3c9)] {{(pid=91687) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 04:27:38.800772 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-9e0e91fe-85e9-4017-ac42-8deee097ff48 req-f86d71df-99fb-4a16-904e-60c0046a6848 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4162185'] for port, after_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:38.808037 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-ab525840-f3af-42be-8a2f-9c13348fae0f service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:27:38.866130 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e0e91fe-85e9-4017-ac42-8deee097ff48 req-f86d71df-99fb-4a16-904e-60c0046a6848 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:38.866901 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-9e0e91fe-85e9-4017-ac42-8deee097ff48 req-f86d71df-99fb-4a16-904e-60c0046a6848 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for port, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:38.868330 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9e0e91fe-85e9-4017-ac42-8deee097ff48 req-f86d71df-99fb-4a16-904e-60c0046a6848 service neutron] 10.222.0.82 "PUT /v2.0/ports/4206d003-d5be-4144-9b27-43b9aa8e7f47 HTTP/1.1" status: 200  len: 1098 time: 1.0706184
May 20 04:27:38.871739 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3836caa9-25d3-4def-82ca-4fb4e1feb7bd', 'tag': '4206d003-d5be-4144-9b27-43b9aa8e7f47'}] {{(pid=91687) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:27:38.899249 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f86d71df-99fb-4a16-904e-60c0046a6848 service neutron] Pushing event updated for resources: {'Port': ['ID=4206d003-d5be-4144-9b27-43b9aa8e7f47,revision_number=3']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:27:38.902863 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-f86d71df-99fb-4a16-904e-60c0046a6848 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:27:38.923674 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '3836caa9-25d3-4def-82ca-4fb4e1feb7bd', 'tag': '4206d003-d5be-4144-9b27-43b9aa8e7f47', 'status': 'completed', 'code': 200}
May 20 04:27:38.954514 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.agents_db [None req-92d61f12-17bc-4bf9-9eab-8a69b8c6da2f None None] Agent healthcheck: found 6 active agents {{(pid=91689) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 04:27:39.626413 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9a9e121-b36d-4881-a083-14e9932c7153 req-980322bd-d935-48c1-9627-b9c0e8c22d96 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:39.627801 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-c9a9e121-b36d-4881-a083-14e9932c7153 req-980322bd-d935-48c1-9627-b9c0e8c22d96 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] 10.222.0.71 "GET /v2.0/ports?device_id=3836caa9-25d3-4def-82ca-4fb4e1feb7bd HTTP/1.1" status: 200  len: 948 time: 0.0867779
May 20 04:27:39.675755 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-c9a9e121-b36d-4881-a083-14e9932c7153 req-a894351b-c7a4-4b5b-bbb2-6d45b931999d tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] 10.222.0.71 "GET /v2.0/security-groups?id=f6287422-b981-4166-af4a-9d85bf42c2af&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0417047
May 20 04:27:40.445308 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a624045-c6a4-463d-8033-f6a51a598c77 req-27e9b149-6e24-4600-ab82-9692b0bbdacb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:40.446797 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-0a624045-c6a4-463d-8033-f6a51a598c77 req-27e9b149-6e24-4600-ab82-9692b0bbdacb service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=d1926a94d80b41c39bbbe68e9f355bad&device_id=3836caa9-25d3-4def-82ca-4fb4e1feb7bd HTTP/1.1" status: 200  len: 1101 time: 0.0775371
May 20 04:27:40.482402 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-0a624045-c6a4-463d-8033-f6a51a598c77 req-e2ff4c7f-f757-4959-b362-4e34f35ad8b5 service neutron] 10.222.0.82 "GET /v2.0/networks?tenant_id=d1926a94d80b41c39bbbe68e9f355bad&shared=False HTTP/1.1" status: 200  len: 213 time: 0.0262032
May 20 04:27:40.624513 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a624045-c6a4-463d-8033-f6a51a598c77 req-62be8b2c-0f3a-43d6-96aa-204505cffc1f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:40.625883 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-0a624045-c6a4-463d-8033-f6a51a598c77 req-62be8b2c-0f3a-43d6-96aa-204505cffc1f service neutron] 10.222.0.82 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.1357911
May 20 04:27:40.744244 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e0e91fe-85e9-4017-ac42-8deee097ff48 req-ac8877a9-0397-49bb-9fb1-153d7dcbbdc3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:40.745813 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9e0e91fe-85e9-4017-ac42-8deee097ff48 req-ac8877a9-0397-49bb-9fb1-153d7dcbbdc3 service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=d1926a94d80b41c39bbbe68e9f355bad&device_id=3836caa9-25d3-4def-82ca-4fb4e1feb7bd HTTP/1.1" status: 200  len: 1101 time: 0.0815787
May 20 04:27:40.870835 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-335d23de-fe33-4ff6-85f3-6398fe912e20 req-12206730-5b14-4907-b274-ff028c862d82 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:40.872330 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-335d23de-fe33-4ff6-85f3-6398fe912e20 req-12206730-5b14-4907-b274-ff028c862d82 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] 10.222.0.71 "GET /v2.0/ports?device_id=3836caa9-25d3-4def-82ca-4fb4e1feb7bd HTTP/1.1" status: 200  len: 948 time: 0.0860815
May 20 04:27:40.980158 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9e0e91fe-85e9-4017-ac42-8deee097ff48 req-2a8b36f9-676b-4b05-a860-537a2e988e63 service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.170&port_id=4206d003-d5be-4144-9b27-43b9aa8e7f47 HTTP/1.1" status: 200  len: 217 time: 0.0718410
May 20 04:27:40.983082 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-335d23de-fe33-4ff6-85f3-6398fe912e20 req-176386e6-9e49-4045-981c-5341e14229a4 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] 10.222.0.71 "GET /v2.0/security-groups?id=f6287422-b981-4166-af4a-9d85bf42c2af&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1044753
May 20 04:27:41.051449 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e0e91fe-85e9-4017-ac42-8deee097ff48 req-981b81ec-dcdc-444f-95b5-16fa795de0c6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:41.052894 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9e0e91fe-85e9-4017-ac42-8deee097ff48 req-981b81ec-dcdc-444f-95b5-16fa795de0c6 service neutron] 10.222.0.82 "GET /v2.0/subnets?id=6c0e93b5-9ca2-4e5a-a26d-a06ab6a5226e HTTP/1.1" status: 200  len: 843 time: 0.0592158
May 20 04:27:41.133022 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e0e91fe-85e9-4017-ac42-8deee097ff48 req-1685c27a-6f4f-49a1-9554-486a07683764 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:41.134464 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9e0e91fe-85e9-4017-ac42-8deee097ff48 req-1685c27a-6f4f-49a1-9554-486a07683764 service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=c5893098-fb92-4405-a661-0d84b5d35597&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1178 time: 0.0741146
May 20 04:27:41.273876 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9e0e91fe-85e9-4017-ac42-8deee097ff48 req-385fe3c1-9212-425f-8457-231f663475bb service neutron] 10.222.0.82 "GET /v2.0/networks/c5893098-fb92-4405-a661-0d84b5d35597?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1312625
May 20 04:27:41.417820 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9e0e91fe-85e9-4017-ac42-8deee097ff48 req-5a369b81-9daf-49b6-b3a0-dce7238d930e service neutron] 10.222.0.82 "GET /v2.0/networks/c5893098-fb92-4405-a661-0d84b5d35597?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1362584
May 20 04:27:42.190022 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48420eb8-6574-4728-8d99-e0a40efa98a6 req-7ff6427a-cd0d-4ac1-b0a7-008480179155 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:42.193453 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-48420eb8-6574-4728-8d99-e0a40efa98a6 req-7ff6427a-cd0d-4ac1-b0a7-008480179155 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] 10.222.0.71 "GET /v2.0/ports?device_id=3836caa9-25d3-4def-82ca-4fb4e1feb7bd HTTP/1.1" status: 200  len: 948 time: 0.0949082
May 20 04:27:42.262133 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-48420eb8-6574-4728-8d99-e0a40efa98a6 req-c49803c0-d08b-472c-8e7b-7b27526a4a78 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] 10.222.0.71 "GET /v2.0/security-groups?id=f6287422-b981-4166-af4a-9d85bf42c2af&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0637190
May 20 04:27:43.446957 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1677e606-0c64-4e1c-b28e-bfd32613514e req-38dcefa7-598a-4a8e-aef9-8f62ebf02238 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:43.448458 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-1677e606-0c64-4e1c-b28e-bfd32613514e req-38dcefa7-598a-4a8e-aef9-8f62ebf02238 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] 10.222.0.71 "GET /v2.0/ports?device_id=3836caa9-25d3-4def-82ca-4fb4e1feb7bd HTTP/1.1" status: 200  len: 948 time: 0.0801065
May 20 04:27:43.494855 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-1677e606-0c64-4e1c-b28e-bfd32613514e req-6e273e59-f942-4e5b-bc6a-93e1afd15270 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] 10.222.0.71 "GET /v2.0/security-groups?id=f6287422-b981-4166-af4a-9d85bf42c2af&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0398805
May 20 04:27:44.696731 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5385120a-89e1-4282-9dc7-6d70272decfc req-96fd28c2-5744-4263-8d1d-07af90f31e7b tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:44.698116 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-5385120a-89e1-4282-9dc7-6d70272decfc req-96fd28c2-5744-4263-8d1d-07af90f31e7b tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] 10.222.0.71 "GET /v2.0/ports?device_id=3836caa9-25d3-4def-82ca-4fb4e1feb7bd HTTP/1.1" status: 200  len: 948 time: 0.0860920
May 20 04:27:44.744682 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-5385120a-89e1-4282-9dc7-6d70272decfc req-1382f925-e367-4adc-8819-95405fe8155f tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] 10.222.0.71 "GET /v2.0/security-groups?id=f6287422-b981-4166-af4a-9d85bf42c2af&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0377693
May 20 04:27:45.828122 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 4206d003-d5be-4144-9b27-43b9aa8e7f47 details requested by agent hyperv_hv-cinder-79091 with host hv-cinder-79091 {{(pid=91688) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 20 04:27:45.973760 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port 4206d003-d5be-4144-9b27-43b9aa8e7f47, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=4206d003-d5be-4144-9b27-43b9aa8e7f47,segment=NetworkSegment(5d30f0fa-a01e-48f4-ae41-9529b23cf3c9),segment_id=5d30f0fa-a01e-48f4-ae41-9529b23cf3c9)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:27:45.988397 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Returning: {'device': '4206d003-d5be-4144-9b27-43b9aa8e7f47', 'network_id': 'c5893098-fb92-4405-a661-0d84b5d35597', 'port_id': '4206d003-d5be-4144-9b27-43b9aa8e7f47', 'mac_address': 'fa:16:3e:ae:cf:4a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 886, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '6c0e93b5-9ca2-4e5a-a26d-a06ab6a5226e', 'ip_address': '192.168.233.170'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91688) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 20 04:27:46.018384 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d0d7a1c-531d-45d7-9308-4ac5132a3d19 req-34410b31-0157-4205-bc43-6991138a50aa tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:46.019843 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4d0d7a1c-531d-45d7-9308-4ac5132a3d19 req-34410b31-0157-4205-bc43-6991138a50aa tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] 10.222.0.71 "GET /v2.0/ports?device_id=3836caa9-25d3-4def-82ca-4fb4e1feb7bd HTTP/1.1" status: 200  len: 948 time: 0.1654274
May 20 04:27:46.044935 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:46.061608 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.notifiers.nova [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4206d003-d5be-4144-9b27-43b9aa8e7f47 {{(pid=91688) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 04:27:46.065835 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4d0d7a1c-531d-45d7-9308-4ac5132a3d19 req-129287e6-9198-4d52-b89f-36d674329d8e tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] 10.222.0.71 "GET /v2.0/security-groups?id=f6287422-b981-4166-af4a-9d85bf42c2af&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0396955
May 20 04:27:46.077332 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port 4206d003-d5be-4144-9b27-43b9aa8e7f47, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=4206d003-d5be-4144-9b27-43b9aa8e7f47,segment=NetworkSegment(5d30f0fa-a01e-48f4-ae41-9529b23cf3c9),segment_id=5d30f0fa-a01e-48f4-ae41-9529b23cf3c9)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:27:46.082265 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:46.084193 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:27:46.152029 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Pushing event updated for resources: {'Port': ['ID=4206d003-d5be-4144-9b27-43b9aa8e7f47,revision_number=4']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:27:46.155213 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:27:47.270092 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08ae2b54-ed2f-4795-85fd-6731056e2d65 req-dae6903a-cf33-467b-a833-d1d4c5a74424 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:47.271589 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-08ae2b54-ed2f-4795-85fd-6731056e2d65 req-dae6903a-cf33-467b-a833-d1d4c5a74424 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] 10.222.0.71 "GET /v2.0/ports?device_id=3836caa9-25d3-4def-82ca-4fb4e1feb7bd HTTP/1.1" status: 200  len: 949 time: 0.0921795
May 20 04:27:47.317773 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-08ae2b54-ed2f-4795-85fd-6731056e2d65 req-e4f95785-92b6-4d02-9517-629b73573e7b tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] 10.222.0.71 "GET /v2.0/security-groups?id=f6287422-b981-4166-af4a-9d85bf42c2af&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0394161
May 20 04:27:48.509952 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4d7232f-ea46-4a25-a04f-678ae153eca5 req-200fbb30-ea7d-477d-bb51-78aee49f6221 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:48.511488 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-d4d7232f-ea46-4a25-a04f-678ae153eca5 req-200fbb30-ea7d-477d-bb51-78aee49f6221 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] 10.222.0.71 "GET /v2.0/ports?device_id=3836caa9-25d3-4def-82ca-4fb4e1feb7bd HTTP/1.1" status: 200  len: 949 time: 0.0810044
May 20 04:27:48.561351 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-d4d7232f-ea46-4a25-a04f-678ae153eca5 req-8c11b548-048f-45f6-b97d-c61499304c0d tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] 10.222.0.71 "GET /v2.0/security-groups?id=f6287422-b981-4166-af4a-9d85bf42c2af&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0435593
May 20 04:27:49.500168 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] get_ports_and_sgs() called for port_ids ['4206d003-d5be-4144-9b27-43b9aa8e7f47'] {{(pid=91688) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 04:27:49.765338 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-786c4e21-cc36-4735-afae-b03aeef318b6 req-96d15f2a-c644-45d4-b629-9c759779ce2f tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:49.766899 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-786c4e21-cc36-4735-afae-b03aeef318b6 req-96d15f2a-c644-45d4-b629-9c759779ce2f tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] 10.222.0.71 "GET /v2.0/ports?device_id=3836caa9-25d3-4def-82ca-4fb4e1feb7bd HTTP/1.1" status: 200  len: 949 time: 0.0845044
May 20 04:27:49.814170 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-786c4e21-cc36-4735-afae-b03aeef318b6 req-b4f5ad87-c7d4-4ee7-b484-60badf9f1124 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] 10.222.0.71 "GET /v2.0/security-groups?id=f6287422-b981-4166-af4a-9d85bf42c2af&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0412169
May 20 04:27:51.003123 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4012f42-58a6-4ade-a156-7dee213365d9 req-6dc8a304-0253-4179-be5c-b33bb3d0b16f tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:51.004585 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-b4012f42-58a6-4ade-a156-7dee213365d9 req-6dc8a304-0253-4179-be5c-b33bb3d0b16f tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] 10.222.0.71 "GET /v2.0/ports?device_id=3836caa9-25d3-4def-82ca-4fb4e1feb7bd HTTP/1.1" status: 200  len: 949 time: 0.0827703
May 20 04:27:51.052820 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-b4012f42-58a6-4ade-a156-7dee213365d9 req-ddc7820f-88d7-40fa-9c11-a7b28530ce64 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] 10.222.0.71 "GET /v2.0/security-groups?id=f6287422-b981-4166-af4a-9d85bf42c2af&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0423603
May 20 04:27:52.170288 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 4206d003-d5be-4144-9b27-43b9aa8e7f47 up at agent hyperv_hv-cinder-79091 {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:27:52.245689 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Provisioning for port 4206d003-d5be-4144-9b27-43b9aa8e7f47 completed by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:27:52.250945 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Provisioning complete for port 4206d003-d5be-4144-9b27-43b9aa8e7f47 triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:27:52.251286 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:52.265419 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4072eea2-9952-4cf0-9d43-b74d2e2420e8 req-a45c57e2-f84f-42ff-8439-1e02240254e9 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:52.267059 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-4072eea2-9952-4cf0-9d43-b74d2e2420e8 req-a45c57e2-f84f-42ff-8439-1e02240254e9 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] 10.222.0.71 "GET /v2.0/ports?device_id=3836caa9-25d3-4def-82ca-4fb4e1feb7bd HTTP/1.1" status: 200  len: 949 time: 0.0982339
May 20 04:27:52.314692 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-4072eea2-9952-4cf0-9d43-b74d2e2420e8 req-831f185e-77c0-4d25-a05c-f954eec4e83e tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] 10.222.0.71 "GET /v2.0/security-groups?id=f6287422-b981-4166-af4a-9d85bf42c2af&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0416148
May 20 04:27:52.370640 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:52.398196 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3836caa9-25d3-4def-82ca-4fb4e1feb7bd', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4206d003-d5be-4144-9b27-43b9aa8e7f47'}] {{(pid=91688) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:27:52.409235 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port 4206d003-d5be-4144-9b27-43b9aa8e7f47, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=4206d003-d5be-4144-9b27-43b9aa8e7f47,segment=NetworkSegment(5d30f0fa-a01e-48f4-ae41-9529b23cf3c9),segment_id=5d30f0fa-a01e-48f4-ae41-9529b23cf3c9)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:27:52.414451 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:52.417482 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-19075ce2-40cd-40b1-bc7b-0370a9bf5412 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:27:52.452718 dv-cinder-790910-4-iscsi neutron-server[91688]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3836caa9-25d3-4def-82ca-4fb4e1feb7bd', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4206d003-d5be-4144-9b27-43b9aa8e7f47', 'code': 200}
May 20 04:27:52.489620 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Pushing event updated for resources: {'Port': ['ID=4206d003-d5be-4144-9b27-43b9aa8e7f47,revision_number=5']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:27:52.493178 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:27:53.653397 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f247bdc-8cd4-4fbe-b055-0edc1dcb3287 req-c7c13b34-2ef8-4c1f-b3b9-325158a42b37 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:53.655054 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-3f247bdc-8cd4-4fbe-b055-0edc1dcb3287 req-c7c13b34-2ef8-4c1f-b3b9-325158a42b37 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] 10.222.0.71 "GET /v2.0/ports?device_id=3836caa9-25d3-4def-82ca-4fb4e1feb7bd HTTP/1.1" status: 200  len: 950 time: 0.0829833
May 20 04:27:53.707135 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-3f247bdc-8cd4-4fbe-b055-0edc1dcb3287 req-e55f01fb-c640-4b0b-851c-72c07a1b10f6 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] 10.222.0.71 "GET /v2.0/security-groups?id=f6287422-b981-4166-af4a-9d85bf42c2af&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0459983
May 20 04:27:54.908651 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab88bd51-1480-4ce8-8127-b8c9a9029e18 req-75c677c0-2054-41e4-aafa-01b4c9930ae6 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:54.910154 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-ab88bd51-1480-4ce8-8127-b8c9a9029e18 req-75c677c0-2054-41e4-aafa-01b4c9930ae6 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] 10.222.0.71 "GET /v2.0/ports?device_id=3836caa9-25d3-4def-82ca-4fb4e1feb7bd HTTP/1.1" status: 200  len: 950 time: 0.0915768
May 20 04:27:54.957502 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-ab88bd51-1480-4ce8-8127-b8c9a9029e18 req-7443e831-9f18-4df6-a01b-fd7a9f841b32 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] 10.222.0.71 "GET /v2.0/security-groups?id=f6287422-b981-4166-af4a-9d85bf42c2af&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0413389
May 20 04:27:55.059111 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-bc599072-0392-41bc-b77f-6935e5517195 req-bdda8569-3962-44ec-a5d9-d1211bd21499 service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0805678
May 20 04:27:55.187020 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc599072-0392-41bc-b77f-6935e5517195 req-e805d2f7-7357-484c-b4a3-9a5222d33b22 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:55.188490 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-bc599072-0392-41bc-b77f-6935e5517195 req-e805d2f7-7357-484c-b4a3-9a5222d33b22 service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=e6fe6bea38b946a5a97ea42bf787f1b3&device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 1137 time: 0.0968459
May 20 04:27:55.190989 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0515c47-b314-4f04-bfff-de6428e6c111 req-e00d54d9-43cc-43b7-9649-8b5adc35f080 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:55.192276 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-d0515c47-b314-4f04-bfff-de6428e6c111 req-e00d54d9-43cc-43b7-9649-8b5adc35f080 service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=3836caa9-25d3-4def-82ca-4fb4e1feb7bd HTTP/1.1" status: 200  len: 1103 time: 0.1324992
May 20 04:27:55.317016 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-d0515c47-b314-4f04-bfff-de6428e6c111 req-7517be1f-3e69-4be6-ac89-d6530256a9c0 service neutron] 10.222.0.82 "GET /v2.0/security-groups?id=f6287422-b981-4166-af4a-9d85bf42c2af&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1177454
May 20 04:27:55.361217 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc599072-0392-41bc-b77f-6935e5517195 req-75f920b1-81ad-4d7e-9b63-3b2c1be90964 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:55.362714 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-bc599072-0392-41bc-b77f-6935e5517195 req-75f920b1-81ad-4d7e-9b63-3b2c1be90964 service neutron] 10.222.0.82 "GET /v2.0/networks?id=fdf92998-25fa-4179-ab1b-131af0ce059a HTTP/1.1" status: 200  len: 916 time: 0.1502559
May 20 04:27:55.809394 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-bc599072-0392-41bc-b77f-6935e5517195 req-317bdec9-f2cc-4ddd-83ba-50a3f64fa621 service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=11028190-b228-415d-b5ee-2da1d6800073 HTTP/1.1" status: 200  len: 1001 time: 0.1406543
May 20 04:27:55.909028 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc599072-0392-41bc-b77f-6935e5517195 req-cc815eb2-c566-4790-a770-ddabaef4dcc8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:55.910450 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-bc599072-0392-41bc-b77f-6935e5517195 req-cc815eb2-c566-4790-a770-ddabaef4dcc8 service neutron] 10.222.0.82 "GET /v2.0/subnets?id=e905ed23-00d1-4991-b3bb-e1a1e32b4c86 HTTP/1.1" status: 200  len: 854 time: 0.0682204
May 20 04:27:55.988913 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc599072-0392-41bc-b77f-6935e5517195 req-ea774dcf-b3fa-4b0c-a5a7-3e77d693848b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:55.990438 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-bc599072-0392-41bc-b77f-6935e5517195 req-ea774dcf-b3fa-4b0c-a5a7-3e77d693848b service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=fdf92998-25fa-4179-ab1b-131af0ce059a&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0725577
May 20 04:27:56.136761 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-bc599072-0392-41bc-b77f-6935e5517195 req-7d47bb90-25dd-4a65-9ee6-c722736f809e service neutron] 10.222.0.82 "GET /v2.0/networks/fdf92998-25fa-4179-ab1b-131af0ce059a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1373317
May 20 04:27:56.147037 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-110c3fd4-344f-415e-a0e9-a6b1f86a1ed2 req-441883d7-fa44-409d-9d66-d4a339070fe9 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:56.148543 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-110c3fd4-344f-415e-a0e9-a6b1f86a1ed2 req-441883d7-fa44-409d-9d66-d4a339070fe9 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] 10.222.0.71 "GET /v2.0/ports?device_id=3836caa9-25d3-4def-82ca-4fb4e1feb7bd HTTP/1.1" status: 200  len: 950 time: 0.0849361
May 20 04:27:56.200837 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-110c3fd4-344f-415e-a0e9-a6b1f86a1ed2 req-a886f48a-f3bf-4a91-a87c-823caf13767b tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] 10.222.0.71 "GET /v2.0/security-groups?id=f6287422-b981-4166-af4a-9d85bf42c2af&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0460224
May 20 04:27:56.279040 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-bc599072-0392-41bc-b77f-6935e5517195 req-822a0cfb-8b4f-4a38-8971-68905f563e00 service neutron] 10.222.0.82 "GET /v2.0/networks/fdf92998-25fa-4179-ab1b-131af0ce059a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1348991
May 20 04:27:57.415440 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76bf1245-12f0-4300-a2e5-d8c6740e64db req-36a296d3-ea72-45ee-a32b-12e69aeceb14 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:57.417114 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-76bf1245-12f0-4300-a2e5-d8c6740e64db req-36a296d3-ea72-45ee-a32b-12e69aeceb14 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] 10.222.0.71 "GET /v2.0/ports?device_id=3836caa9-25d3-4def-82ca-4fb4e1feb7bd HTTP/1.1" status: 200  len: 950 time: 0.1019125
May 20 04:27:57.463921 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-76bf1245-12f0-4300-a2e5-d8c6740e64db req-443f6a06-fca4-4ae6-906f-148682fd6947 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] 10.222.0.71 "GET /v2.0/security-groups?id=f6287422-b981-4166-af4a-9d85bf42c2af&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0410240
May 20 04:27:57.914705 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-563c3c80-1e4b-440a-b2a8-98ebee672817 req-ec6fe7d2-4046-48a9-969a-73cb05a5ce1f tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:57.916182 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-563c3c80-1e4b-440a-b2a8-98ebee672817 req-ec6fe7d2-4046-48a9-969a-73cb05a5ce1f tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] 10.222.0.71 "GET /v2.0/ports?device_id=3836caa9-25d3-4def-82ca-4fb4e1feb7bd HTTP/1.1" status: 200  len: 950 time: 0.0832870
May 20 04:27:57.967954 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-563c3c80-1e4b-440a-b2a8-98ebee672817 req-2ece7945-c801-454a-a0ae-ec1aa4b70b66 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] 10.222.0.71 "GET /v2.0/security-groups?id=f6287422-b981-4166-af4a-9d85bf42c2af&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0451782
May 20 04:27:59.165527 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88eb3373-4a48-43c3-be7d-a0f8a737e43a req-4fb3b94d-65b8-4e98-bb45-bd19f61e6c4a tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:59.166906 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-88eb3373-4a48-43c3-be7d-a0f8a737e43a req-4fb3b94d-65b8-4e98-bb45-bd19f61e6c4a tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] 10.222.0.71 "GET /v2.0/ports?device_id=3836caa9-25d3-4def-82ca-4fb4e1feb7bd HTTP/1.1" status: 200  len: 950 time: 0.0872190
May 20 04:27:59.295786 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-88eb3373-4a48-43c3-be7d-a0f8a737e43a req-523d9574-0bbc-4d6b-ab28-163ab00b5aa1 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] 10.222.0.71 "GET /v2.0/security-groups?id=f6287422-b981-4166-af4a-9d85bf42c2af&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1224322
May 20 04:27:59.746503 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1b616e0-4a5e-46c8-a011-3a6c74cc81e0 req-bbedafe8-db0e-4736-a417-3bccdc78d5c9 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:27:59.747934 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-e1b616e0-4a5e-46c8-a011-3a6c74cc81e0 req-bbedafe8-db0e-4736-a417-3bccdc78d5c9 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] 10.222.0.82 "GET /v2.0/ports?device_id=3836caa9-25d3-4def-82ca-4fb4e1feb7bd HTTP/1.1" status: 200  len: 950 time: 0.0883193
May 20 04:27:59.856350 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-6fb741c5-b7f8-43b4-98fe-8d1e620a7e10 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:27:59.959022 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [req-e1b616e0-4a5e-46c8-a011-3a6c74cc81e0 req-67c18f03-7e64-4ce5-a09f-77aa4c01ab46 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Deleting port 4206d003-d5be-4144-9b27-43b9aa8e7f47 {{(pid=91687) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 04:27:59.959370 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-e1b616e0-4a5e-46c8-a011-3a6c74cc81e0 req-67c18f03-7e64-4ce5-a09f-77aa4c01ab46 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8782892520551'] for port, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:00.096919 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [req-e1b616e0-4a5e-46c8-a011-3a6c74cc81e0 req-67c18f03-7e64-4ce5-a09f-77aa4c01ab46 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] For port 4206d003-d5be-4144-9b27-43b9aa8e7f47, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=4206d003-d5be-4144-9b27-43b9aa8e7f47,segment=NetworkSegment(5d30f0fa-a01e-48f4-ae41-9529b23cf3c9),segment_id=5d30f0fa-a01e-48f4-ae41-9529b23cf3c9)] {{(pid=91687) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:28:00.097466 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-e1b616e0-4a5e-46c8-a011-3a6c74cc81e0 req-67c18f03-7e64-4ce5-a09f-77aa4c01ab46 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1718922'] for port, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:00.224620 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [req-e1b616e0-4a5e-46c8-a011-3a6c74cc81e0 req-67c18f03-7e64-4ce5-a09f-77aa4c01ab46 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Calling delete_port for 4206d003-d5be-4144-9b27-43b9aa8e7f47 owned by compute:nova {{(pid=91687) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 04:28:00.343680 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-e1b616e0-4a5e-46c8-a011-3a6c74cc81e0 req-67c18f03-7e64-4ce5-a09f-77aa4c01ab46 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8782892522936', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8782892108804', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4162192'] for port, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:00.350226 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-9a04924e-fbdd-4855-8cb2-2221886789b7 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:28:00.359482 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] get_ports_and_sgs() called for port_ids ['4206d003-d5be-4144-9b27-43b9aa8e7f47'] {{(pid=91688) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 04:28:00.402594 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67c18f03-7e64-4ce5-a09f-77aa4c01ab46 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Pushing event deleted for resources: {'Port': ['ID=4206d003-d5be-4144-9b27-43b9aa8e7f47,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:28:00.444822 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-67c18f03-7e64-4ce5-a09f-77aa4c01ab46 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:28:00.445220 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-67c18f03-7e64-4ce5-a09f-77aa4c01ab46 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:28:00.445577 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-67c18f03-7e64-4ce5-a09f-77aa4c01ab46 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:28:00.446124 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-67c18f03-7e64-4ce5-a09f-77aa4c01ab46 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:28:00.446656 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-67c18f03-7e64-4ce5-a09f-77aa4c01ab46 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:28:00.447192 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-67c18f03-7e64-4ce5-a09f-77aa4c01ab46 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:28:00.447706 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-67c18f03-7e64-4ce5-a09f-77aa4c01ab46 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:28:00.448207 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-67c18f03-7e64-4ce5-a09f-77aa4c01ab46 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:28:00.448707 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-67c18f03-7e64-4ce5-a09f-77aa4c01ab46 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:28:00.449245 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-67c18f03-7e64-4ce5-a09f-77aa4c01ab46 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:28:00.449838 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-67c18f03-7e64-4ce5-a09f-77aa4c01ab46 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:28:00.450340 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-67c18f03-7e64-4ce5-a09f-77aa4c01ab46 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:28:00.465391 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-967c5c6e-7c10-430c-a411-66658422f939 req-1da1b881-2af2-4526-9d68-b2ab6f171083 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] 10.222.0.71 "GET /v2.0/ports?device_id=3836caa9-25d3-4def-82ca-4fb4e1feb7bd HTTP/1.1" status: 200  len: 210 time: 0.0505826
May 20 04:28:00.494112 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-67c18f03-7e64-4ce5-a09f-77aa4c01ab46 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.144s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:28:00.510837 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.l3_dvrscheduler_db [req-e1b616e0-4a5e-46c8-a011-3a6c74cc81e0 req-67c18f03-7e64-4ce5-a09f-77aa4c01ab46 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] No DVR routers for this DVR port 4206d003-d5be-4144-9b27-43b9aa8e7f47 on host hv-cinder-79091 {{(pid=91687) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 04:28:00.514666 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-e1b616e0-4a5e-46c8-a011-3a6c74cc81e0 req-67c18f03-7e64-4ce5-a09f-77aa4c01ab46 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for port, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:00.519161 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3836caa9-25d3-4def-82ca-4fb4e1feb7bd', 'name': 'network-vif-deleted', 'tag': '4206d003-d5be-4144-9b27-43b9aa8e7f47'}] {{(pid=91687) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:28:00.550343 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-e1b616e0-4a5e-46c8-a011-3a6c74cc81e0 req-67c18f03-7e64-4ce5-a09f-77aa4c01ab46 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] 10.222.0.82 "DELETE /v2.0/ports/4206d003-d5be-4144-9b27-43b9aa8e7f47 HTTP/1.1" status: 204  len: 173 time: 0.7946250
May 20 04:28:00.575856 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3836caa9-25d3-4def-82ca-4fb4e1feb7bd', 'name': 'network-vif-deleted', 'tag': '4206d003-d5be-4144-9b27-43b9aa8e7f47', 'status': 'completed', 'code': 200}
May 20 04:28:01.694343 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1f8edcb-efea-44de-8abe-a844838a4850 req-070f4be2-e5f0-41a2-bf98-01cf5352e3af tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:28:01.695875 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-e1f8edcb-efea-44de-8abe-a844838a4850 req-070f4be2-e5f0-41a2-bf98-01cf5352e3af tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.71 "GET /v2.0/ports?device_id=0ec5c357-a1ce-4f29-a687-f059eadabd44 HTTP/1.1" status: 200  len: 945 time: 0.0902936
May 20 04:28:01.744643 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-e1f8edcb-efea-44de-8abe-a844838a4850 req-df797796-22a9-4ec9-978f-e91c2e5c687a tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.71 "GET /v2.0/security-groups?id=e79e4ba4-358f-4b35-b5f3-7372b5116def&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0418563
May 20 04:28:02.549115 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:02.688723 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-7580ea95-cc9d-4a28-bb47-abdbd82ee921 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:02.945320 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ca2118b-5df8-4de4-9a17-b0a1711f30a9 req-8d8cce04-8046-4771-8eca-a5bed36238e4 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:28:02.947062 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9ca2118b-5df8-4de4-9a17-b0a1711f30a9 req-8d8cce04-8046-4771-8eca-a5bed36238e4 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.71 "GET /v2.0/ports?device_id=0ec5c357-a1ce-4f29-a687-f059eadabd44 HTTP/1.1" status: 200  len: 945 time: 0.0845833
May 20 04:28:02.994916 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9ca2118b-5df8-4de4-9a17-b0a1711f30a9 req-3503858b-de51-4b75-9281-be9016518666 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.71 "GET /v2.0/security-groups?id=e79e4ba4-358f-4b35-b5f3-7372b5116def&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0411808
May 20 04:28:03.332767 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ea4803bd-878f-47d5-9084-1ec41953c9db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:03.415830 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 4206d003-d5be-4144-9b27-43b9aa8e7f47 no longer exists at agent hyperv_hv-cinder-79091 {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 04:28:03.455844 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] No Port match for: 4206d003-d5be-4144-9b27-43b9aa8e7f47 {{(pid=91688) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 04:28:03.456195 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 4206d003-d5be-4144-9b27-43b9aa8e7f47 not bound to the agent host hv-cinder-79091 {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 04:28:04.221147 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb5c34fb-f7fd-420a-ab32-900525b151d8 req-9e6cbcdd-5187-4d5c-887a-fddceae01c6f tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:28:04.222623 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-fb5c34fb-f7fd-420a-ab32-900525b151d8 req-9e6cbcdd-5187-4d5c-887a-fddceae01c6f tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.71 "GET /v2.0/ports?device_id=0ec5c357-a1ce-4f29-a687-f059eadabd44 HTTP/1.1" status: 200  len: 945 time: 0.0831759
May 20 04:28:04.271336 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-fb5c34fb-f7fd-420a-ab32-900525b151d8 req-03fd18af-c29d-4b06-9131-dc6496065392 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.71 "GET /v2.0/security-groups?id=e79e4ba4-358f-4b35-b5f3-7372b5116def&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0427604
May 20 04:28:04.378787 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54d0c173-5aa4-443a-9a05-ff496ffe993d req-5f6c21e0-0279-40e9-a786-322dacd2c75f tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:28:04.380278 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-54d0c173-5aa4-443a-9a05-ff496ffe993d req-5f6c21e0-0279-40e9-a786-322dacd2c75f tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.82 "GET /v2.0/ports?device_id=0ec5c357-a1ce-4f29-a687-f059eadabd44 HTTP/1.1" status: 200  len: 945 time: 0.0965486
May 20 04:28:04.522306 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [req-54d0c173-5aa4-443a-9a05-ff496ffe993d req-b2684626-bf9a-4931-a4eb-b548dcaeb5d0 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Deleting port 576807fb-2ca4-4b24-9f9f-348539f6ff95 {{(pid=91687) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 04:28:04.522713 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-54d0c173-5aa4-443a-9a05-ff496ffe993d req-b2684626-bf9a-4931-a4eb-b548dcaeb5d0 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8782892520551'] for port, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:04.672334 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [req-54d0c173-5aa4-443a-9a05-ff496ffe993d req-b2684626-bf9a-4931-a4eb-b548dcaeb5d0 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] For port 576807fb-2ca4-4b24-9f9f-348539f6ff95, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=576807fb-2ca4-4b24-9f9f-348539f6ff95,segment=NetworkSegment(3cfe6ee0-17fa-47f2-8f37-995aaef6bfdc),segment_id=3cfe6ee0-17fa-47f2-8f37-995aaef6bfdc)] {{(pid=91687) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:28:04.672761 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-54d0c173-5aa4-443a-9a05-ff496ffe993d req-b2684626-bf9a-4931-a4eb-b548dcaeb5d0 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1718922'] for port, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:04.809504 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [req-54d0c173-5aa4-443a-9a05-ff496ffe993d req-b2684626-bf9a-4931-a4eb-b548dcaeb5d0 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Calling delete_port for 576807fb-2ca4-4b24-9f9f-348539f6ff95 owned by compute:nova {{(pid=91687) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 04:28:04.963880 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-54d0c173-5aa4-443a-9a05-ff496ffe993d req-b2684626-bf9a-4931-a4eb-b548dcaeb5d0 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8782892522936', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8782892108804', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4162192'] for port, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:04.970093 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-42cd291f-943f-49c0-9eb1-9bdc08033972 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:28:04.976167 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] get_ports_and_sgs() called for port_ids ['576807fb-2ca4-4b24-9f9f-348539f6ff95'] {{(pid=91688) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 04:28:05.019034 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2684626-bf9a-4931-a4eb-b548dcaeb5d0 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Pushing event deleted for resources: {'Port': ['ID=576807fb-2ca4-4b24-9f9f-348539f6ff95,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:28:05.026944 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-b2684626-bf9a-4931-a4eb-b548dcaeb5d0 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.057s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:28:05.105062 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.l3_dvrscheduler_db [req-54d0c173-5aa4-443a-9a05-ff496ffe993d req-b2684626-bf9a-4931-a4eb-b548dcaeb5d0 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] No DVR routers for this DVR port 576807fb-2ca4-4b24-9f9f-348539f6ff95 on host hv-cinder-79091 {{(pid=91687) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 04:28:05.107732 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-54d0c173-5aa4-443a-9a05-ff496ffe993d req-b2684626-bf9a-4931-a4eb-b548dcaeb5d0 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for port, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:05.110648 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0ec5c357-a1ce-4f29-a687-f059eadabd44', 'name': 'network-vif-deleted', 'tag': '576807fb-2ca4-4b24-9f9f-348539f6ff95'}] {{(pid=91687) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:28:05.129177 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-54d0c173-5aa4-443a-9a05-ff496ffe993d req-b2684626-bf9a-4931-a4eb-b548dcaeb5d0 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.82 "DELETE /v2.0/ports/576807fb-2ca4-4b24-9f9f-348539f6ff95 HTTP/1.1" status: 204  len: 173 time: 0.7413003
May 20 04:28:05.168192 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0ec5c357-a1ce-4f29-a687-f059eadabd44', 'name': 'network-vif-deleted', 'tag': '576807fb-2ca4-4b24-9f9f-348539f6ff95', 'status': 'completed', 'code': 200}
May 20 04:28:05.196174 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f21320cc-6a25-4ec1-8a32-8b119b35fd55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:05.439526 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-009e2a85-b137-4a60-a10d-692ace4ec125 req-1679b25f-5b9f-43ca-92e7-22dd2147ca8e tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] 10.222.0.71 "GET /v2.0/ports?device_id=0ec5c357-a1ce-4f29-a687-f059eadabd44 HTTP/1.1" status: 200  len: 210 time: 0.0461295
May 20 04:28:06.488917 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 43784) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:28:06.539646 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:06.716282 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-1ce132d9-ce0a-4166-bfff-54b25fbfe305 admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=d1926a94d80b41c39bbbe68e9f355bad&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2260373
May 20 04:28:06.718998 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 43792) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:28:06.789149 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-8624a336-4855-44d8-af52-5c86c9c835e4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:06.817357 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-8624a336-4855-44d8-af52-5c86c9c835e4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:06.904561 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-8624a336-4855-44d8-af52-5c86c9c835e4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:06.919542 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-49590bdd-73dd-441d-98ab-582de0d39fd5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:28:06.937774 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8624a336-4855-44d8-af52-5c86c9c835e4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f6287422-b981-4166-af4a-9d85bf42c2af,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:28:06.941558 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-8624a336-4855-44d8-af52-5c86c9c835e4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:28:06.943429 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-8624a336-4855-44d8-af52-5c86c9c835e4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:06.950646 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-8624a336-4855-44d8-af52-5c86c9c835e4 admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/f6287422-b981-4166-af4a-9d85bf42c2af HTTP/1.1" status: 204  len: 168 time: 0.2302337
May 20 04:28:07.709113 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 43834) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:28:07.880798 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.v2.base [None req-2a6aab82-6c10-46cd-b87d-ee6eb290e5c4 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-857163320-network', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc'}} {{(pid=91686) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:28:07.887288 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-2a6aab82-6c10-46cd-b87d-ee6eb290e5c4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:28:07.891858 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-2a6aab82-6c10-46cd-b87d-ee6eb290e5c4 admin admin] Usage tracker for resource:network and tenant:9b6fb271a7a546a38b0c6df5beaf22fc is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:28:07.895331 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-2a6aab82-6c10-46cd-b87d-ee6eb290e5c4 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:28:07.902685 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-2a6aab82-6c10-46cd-b87d-ee6eb290e5c4 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:28:07.916098 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2a6aab82-6c10-46cd-b87d-ee6eb290e5c4 admin admin] Made reservation on behalf of 9b6fb271a7a546a38b0c6df5beaf22fc for: {'network': 1} {{(pid=91686) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 04:28:07.918469 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-2a6aab82-6c10-46cd-b87d-ee6eb290e5c4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-578118'] for network, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:07.930784 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-2a6aab82-6c10-46cd-b87d-ee6eb290e5c4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:07.945867 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-2a6aab82-6c10-46cd-b87d-ee6eb290e5c4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:28:07.949950 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-2a6aab82-6c10-46cd-b87d-ee6eb290e5c4 admin admin] Usage tracker for resource:security_group_rule and tenant:9b6fb271a7a546a38b0c6df5beaf22fc is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:28:07.952943 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-2a6aab82-6c10-46cd-b87d-ee6eb290e5c4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:28:07.959030 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-2a6aab82-6c10-46cd-b87d-ee6eb290e5c4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:28:08.046970 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-2a6aab82-6c10-46cd-b87d-ee6eb290e5c4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:08.051882 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-2a6aab82-6c10-46cd-b87d-ee6eb290e5c4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:08.054908 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-8933fcdf-0cd7-4a84-8409-4d60fff0e9c4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:28:08.083216 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2a6aab82-6c10-46cd-b87d-ee6eb290e5c4 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 874}  {{(pid=91686) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 20 04:28:08.092079 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a6aab82-6c10-46cd-b87d-ee6eb290e5c4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0ffaeca9-4147-460f-8d53-d50ce54eb13f,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:28:08.101165 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-2a6aab82-6c10-46cd-b87d-ee6eb290e5c4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1501910'] for segment, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:08.101504 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.db.segments_db [None req-2a6aab82-6c10-46cd-b87d-ee6eb290e5c4 admin admin] Added segment e9f32492-7a41-4dc9-bc94-b8bce4a8e65d of type vlan for network 11c994a8-6ede-4290-84f0-71af466860db
May 20 04:28:08.103322 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a6aab82-6c10-46cd-b87d-ee6eb290e5c4 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:28:08.103684 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a6aab82-6c10-46cd-b87d-ee6eb290e5c4 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:28:08.104038 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a6aab82-6c10-46cd-b87d-ee6eb290e5c4 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:28:08.104386 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a6aab82-6c10-46cd-b87d-ee6eb290e5c4 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:28:08.104792 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a6aab82-6c10-46cd-b87d-ee6eb290e5c4 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:28:08.105162 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a6aab82-6c10-46cd-b87d-ee6eb290e5c4 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:28:08.105524 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a6aab82-6c10-46cd-b87d-ee6eb290e5c4 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:28:08.105923 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a6aab82-6c10-46cd-b87d-ee6eb290e5c4 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:28:08.106268 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a6aab82-6c10-46cd-b87d-ee6eb290e5c4 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:28:08.106611 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a6aab82-6c10-46cd-b87d-ee6eb290e5c4 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:28:08.106945 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a6aab82-6c10-46cd-b87d-ee6eb290e5c4 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:28:08.107284 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a6aab82-6c10-46cd-b87d-ee6eb290e5c4 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:28:08.114859 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-2a6aab82-6c10-46cd-b87d-ee6eb290e5c4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:28:08.146870 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-2a6aab82-6c10-46cd-b87d-ee6eb290e5c4 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8782892092784'] for network, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:08.179564 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-2a6aab82-6c10-46cd-b87d-ee6eb290e5c4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1590664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1781430'] for network, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:08.180976 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2a6aab82-6c10-46cd-b87d-ee6eb290e5c4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:28:08.181591 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-2a6aab82-6c10-46cd-b87d-ee6eb290e5c4 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for network, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:08.191331 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-570b83a9-8ac5-4ed6-8bc5-060a29629c3b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:28:08.284878 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-2a6aab82-6c10-46cd-b87d-ee6eb290e5c4 admin admin] 10.222.0.71 "POST /v2.0/networks HTTP/1.1" status: 201  len: 884 time: 0.5713122
May 20 04:28:08.285683 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 43844) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:28:08.292071 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [None req-5d93cbb0-b606-447b-9898-e94500790b4d admin admin] Request body: {'subnet': {'network_id': '11c994a8-6ede-4290-84f0-71af466860db', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-857163320-subnet', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'ip_version': 4}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:28:08.294351 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a6aab82-6c10-46cd-b87d-ee6eb290e5c4 admin admin] Pushing event updated for resources: {'Network': ['ID=11c994a8-6ede-4290-84f0-71af466860db,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:28:08.296276 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-2a6aab82-6c10-46cd-b87d-ee6eb290e5c4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:28:08.298222 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-5d93cbb0-b606-447b-9898-e94500790b4d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:28:08.303586 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-5d93cbb0-b606-447b-9898-e94500790b4d admin admin] Usage tracker for resource:subnet and tenant:9b6fb271a7a546a38b0c6df5beaf22fc is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:28:08.307806 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-5d93cbb0-b606-447b-9898-e94500790b4d admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:28:08.308206 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Network 11c994a8-6ede-4290-84f0-71af466860db details requested by agent ovs-agent-dv-cinder-790910-4-iscsi with host dv-cinder-790910-4-iscsi {{(pid=91688) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 20 04:28:08.318058 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-5d93cbb0-b606-447b-9898-e94500790b4d admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:28:08.354593 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5d93cbb0-b606-447b-9898-e94500790b4d admin admin] Made reservation on behalf of 9b6fb271a7a546a38b0c6df5beaf22fc for: {'subnet': 1} {{(pid=91687) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 04:28:08.357978 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-5d93cbb0-b606-447b-9898-e94500790b4d admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-692271'] for subnet, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:08.838875 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-5d93cbb0-b606-447b-9898-e94500790b4d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-255887', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-4160768', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-692253'] for subnet, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:08.842687 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:28:08.908992 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d93cbb0-b606-447b-9898-e94500790b4d admin admin] Pushing event updated for resources: {'Subnet': ['ID=51af45f1-449a-400c-8714-8d713d4a7993,revision_number=0']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:28:08.913364 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-5d93cbb0-b606-447b-9898-e94500790b4d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:28:08.922696 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5d93cbb0-b606-447b-9898-e94500790b4d admin admin] Checking segment: {'id': 'e9f32492-7a41-4dc9-bc94-b8bce4a8e65d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': '11c994a8-6ede-4290-84f0-71af466860db'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91687) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:28:08.923046 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5d93cbb0-b606-447b-9898-e94500790b4d admin admin] Network hostable DHCP agents. Network: 11c994a8-6ede-4290-84f0-71af466860db, hostable agents: ['36d27813-c368-4fd7-ae26-0f662e0a96fd'], hosted agents: [] {{(pid=91687) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 20 04:28:08.940555 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5d93cbb0-b606-447b-9898-e94500790b4d admin admin] Network 11c994a8-6ede-4290-84f0-71af466860db is scheduled to be hosted by DHCP agent 36d27813-c368-4fd7-ae26-0f662e0a96fd with binding_index 1 {{(pid=91687) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 20 04:28:08.950425 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.base_scheduler [None req-5d93cbb0-b606-447b-9898-e94500790b4d admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-790910-4-iscsi, 11c994a8-6ede-4290-84f0-71af466860db) {{(pid=91687) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:28:08.959919 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5d93cbb0-b606-447b-9898-e94500790b4d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:28:08.960265 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e5689e2a-77bc-4533-9597-405f86e4b47d None None] Network 11c994a8-6ede-4290-84f0-71af466860db requested from dv-cinder-790910-4-iscsi {{(pid=91688) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 04:28:08.960400 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-5d93cbb0-b606-447b-9898-e94500790b4d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for subnet, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:08.985073 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-5d93cbb0-b606-447b-9898-e94500790b4d admin admin] 10.222.0.71 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 847 time: 0.6976712
May 20 04:28:08.987987 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 43852) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:28:08.993965 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [None req-3369a57a-25e6-45fe-8612-05a613184fb7 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-857163320-router', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90'}}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:28:08.998656 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-3369a57a-25e6-45fe-8612-05a613184fb7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:28:09.002704 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-3369a57a-25e6-45fe-8612-05a613184fb7 admin admin] Usage tracker for resource:router and tenant:9b6fb271a7a546a38b0c6df5beaf22fc is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:28:09.005771 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-3369a57a-25e6-45fe-8612-05a613184fb7 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:28:09.012232 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-3369a57a-25e6-45fe-8612-05a613184fb7 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:28:09.025673 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-3369a57a-25e6-45fe-8612-05a613184fb7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1796465', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-6255'] for router, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:09.026831 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-3369a57a-25e6-45fe-8612-05a613184fb7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1713009', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1713968', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1590966', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-6244'] for router, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:09.044119 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-3369a57a-25e6-45fe-8612-05a613184fb7 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:09.189755 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f991cacc-1ddb-4459-b040-b415638d2394 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpfbdc8e9b-5136-5478-8aa8-b0b6b9be0f90-11c994a8-6ede-4290-84f0-71af466860db', 'network_id': '11c994a8-6ede-4290-84f0-71af466860db', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'fixed_ips': [{'subnet_id': '51af45f1-449a-400c-8714-8d713d4a7993'}]}} from dv-cinder-790910-4-iscsi. {{(pid=91688) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 20 04:28:09.190829 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f991cacc-1ddb-4459-b040-b415638d2394 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_create {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:09.311772 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-3369a57a-25e6-45fe-8612-05a613184fb7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1713977', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1796355', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-6218'] for router, precommit_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:09.348082 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.db_base_plugin_common [None req-f991cacc-1ddb-4459-b040-b415638d2394 None None] Allocated IP 172.20.0.2 (11c994a8-6ede-4290-84f0-71af466860db/51af45f1-449a-400c-8714-8d713d4a7993/37b494d0-4880-4690-a8dc-f497042f06fd) {{(pid=91688) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 04:28:09.577923 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f991cacc-1ddb-4459-b040-b415638d2394 None None] Notify callbacks [] for port, precommit_create {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:09.589304 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-f991cacc-1ddb-4459-b040-b415638d2394 None None] Transition to ACTIVE for port object 37b494d0-4880-4690-a8dc-f497042f06fd will not be triggered until provisioned by entity L2. {{(pid=91688) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:28:09.609388 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-f991cacc-1ddb-4459-b040-b415638d2394 None None] Transition to ACTIVE for port object 37b494d0-4880-4690-a8dc-f497042f06fd will not be triggered until provisioned by entity DHCP. {{(pid=91688) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:28:09.617743 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f991cacc-1ddb-4459-b040-b415638d2394 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8782892106231'] for port, after_create {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:09.622783 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:28:09.634495 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-3369a57a-25e6-45fe-8612-05a613184fb7 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:09.665771 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-3369a57a-25e6-45fe-8612-05a613184fb7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:09.686615 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f991cacc-1ddb-4459-b040-b415638d2394 None None] Network 11c994a8-6ede-4290-84f0-71af466860db is already hosted by enough agents. {{(pid=91688) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:28:09.691633 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.scheduler.base_scheduler [None req-f991cacc-1ddb-4459-b040-b415638d2394 None None] Resources bound (agent type, host, resource id):  {{(pid=91688) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:28:09.693371 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f991cacc-1ddb-4459-b040-b415638d2394 None None] Received port after_create {{(pid=91688) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 04:28:09.699490 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f991cacc-1ddb-4459-b040-b415638d2394 None None] Pushing event updated for resources: {'Port': ['ID=37b494d0-4880-4690-a8dc-f497042f06fd,revision_number=1']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:28:09.735625 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f991cacc-1ddb-4459-b040-b415638d2394 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:28:09.735971 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f991cacc-1ddb-4459-b040-b415638d2394 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:28:09.736298 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f991cacc-1ddb-4459-b040-b415638d2394 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:28:09.736627 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f991cacc-1ddb-4459-b040-b415638d2394 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:28:09.736976 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f991cacc-1ddb-4459-b040-b415638d2394 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:28:09.737299 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f991cacc-1ddb-4459-b040-b415638d2394 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:28:09.737624 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f991cacc-1ddb-4459-b040-b415638d2394 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:28:09.737942 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f991cacc-1ddb-4459-b040-b415638d2394 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:28:09.738250 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f991cacc-1ddb-4459-b040-b415638d2394 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:28:09.738566 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f991cacc-1ddb-4459-b040-b415638d2394 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:28:09.738901 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f991cacc-1ddb-4459-b040-b415638d2394 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:28:09.739207 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f991cacc-1ddb-4459-b040-b415638d2394 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:28:09.747204 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-f991cacc-1ddb-4459-b040-b415638d2394 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:28:09.796227 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.managers [None req-f991cacc-1ddb-4459-b040-b415638d2394 None None] Attempting to bind port 37b494d0-4880-4690-a8dc-f497042f06fd on host dv-cinder-790910-4-iscsi for vnic_type normal with profile  {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 04:28:09.796645 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.managers [None req-f991cacc-1ddb-4459-b040-b415638d2394 None None] Attempting to bind port 37b494d0-4880-4690-a8dc-f497042f06fd by drivers openvswitch,hyperv on host dv-cinder-790910-4-iscsi at level 0 using segments [{'id': 'e9f32492-7a41-4dc9-bc94-b8bce4a8e65d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': '11c994a8-6ede-4290-84f0-71af466860db'}] {{(pid=91688) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 04:28:09.797010 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f991cacc-1ddb-4459-b040-b415638d2394 None None] Attempting to bind port 37b494d0-4880-4690-a8dc-f497042f06fd on network 11c994a8-6ede-4290-84f0-71af466860db {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:28:09.802700 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f991cacc-1ddb-4459-b040-b415638d2394 None None] Checking agent: {'id': '333121d4-1023-4a33-a54c-f4dd052e1612', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-790910-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 4, 13, 33), 'started_at': datetime.datetime(2021, 5, 20, 4, 14, 3), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 4, 28, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-790910-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 04:28:09.803124 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f991cacc-1ddb-4459-b040-b415638d2394 None None] Checking segment: {'id': 'e9f32492-7a41-4dc9-bc94-b8bce4a8e65d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': '11c994a8-6ede-4290-84f0-71af466860db'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91688) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:28:09.803628 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f991cacc-1ddb-4459-b040-b415638d2394 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:09.804055 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f991cacc-1ddb-4459-b040-b415638d2394 None None] Bound using segment: {'id': 'e9f32492-7a41-4dc9-bc94-b8bce4a8e65d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': '11c994a8-6ede-4290-84f0-71af466860db'} {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 04:28:09.804527 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.managers [None req-f991cacc-1ddb-4459-b040-b415638d2394 None None] Bound port: 37b494d0-4880-4690-a8dc-f497042f06fd, host: dv-cinder-790910-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e9f32492-7a41-4dc9-bc94-b8bce4a8e65d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': '11c994a8-6ede-4290-84f0-71af466860db'}}] {{(pid=91688) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 04:28:09.804901 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f991cacc-1ddb-4459-b040-b415638d2394 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:09.811341 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.db_base_plugin_common [None req-3369a57a-25e6-45fe-8612-05a613184fb7 admin admin] Allocated IP 172.27.1.91 (aec557db-0c02-4008-8c9f-2efcd7462f90/217f4b55-4415-4d57-8b43-2ff4c8ac8e81/866cc6c0-5986-4eb4-8827-b255811a13de) {{(pid=91687) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 04:28:09.852396 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 576807fb-2ca4-4b24-9f9f-348539f6ff95 no longer exists at agent hyperv_hv-cinder-79091 {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 04:28:09.897097 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] No Port match for: 576807fb-2ca4-4b24-9f9f-348539f6ff95 {{(pid=91688) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 04:28:09.897413 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 576807fb-2ca4-4b24-9f9f-348539f6ff95 not bound to the agent host hv-cinder-79091 {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 04:28:09.927801 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-f991cacc-1ddb-4459-b040-b415638d2394 None None] For port 37b494d0-4880-4690-a8dc-f497042f06fd, host dv-cinder-790910-4-iscsi, cleared binding levels {{(pid=91688) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 04:28:09.930846 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-f991cacc-1ddb-4459-b040-b415638d2394 None None] For port 37b494d0-4880-4690-a8dc-f497042f06fd, host dv-cinder-790910-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=37b494d0-4880-4690-a8dc-f497042f06fd,segment=NetworkSegment(e9f32492-7a41-4dc9-bc94-b8bce4a8e65d),segment_id=e9f32492-7a41-4dc9-bc94-b8bce4a8e65d)] {{(pid=91688) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 04:28:09.936185 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f991cacc-1ddb-4459-b040-b415638d2394 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:09.940740 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:28:09.958042 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-3369a57a-25e6-45fe-8612-05a613184fb7 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:09.989352 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-3369a57a-25e6-45fe-8612-05a613184fb7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8782892106231', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4162192'] for port, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:09.994239 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-4bf1b852-57cd-4d8b-a4ba-0b8f81e57489 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:28:10.014836 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f991cacc-1ddb-4459-b040-b415638d2394 None None] Pushing event updated for resources: {'Port': ['ID=37b494d0-4880-4690-a8dc-f497042f06fd,revision_number=2']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:28:10.017836 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-f991cacc-1ddb-4459-b040-b415638d2394 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:28:10.062703 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3369a57a-25e6-45fe-8612-05a613184fb7 admin admin] Network aec557db-0c02-4008-8c9f-2efcd7462f90 is already hosted by enough agents. {{(pid=91687) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:28:10.065683 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.base_scheduler [None req-3369a57a-25e6-45fe-8612-05a613184fb7 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91687) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:28:10.070545 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3369a57a-25e6-45fe-8612-05a613184fb7 admin admin] Received port after_create {{(pid=91687) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 04:28:10.184923 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3369a57a-25e6-45fe-8612-05a613184fb7 admin admin] Pushing event updated for resources: {'Port': ['ID=866cc6c0-5986-4eb4-8827-b255811a13de,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:28:10.202058 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-3369a57a-25e6-45fe-8612-05a613184fb7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.208s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:28:10.584146 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-3369a57a-25e6-45fe-8612-05a613184fb7 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:10.904370 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-19dc103c-e404-4530-8a30-20b2d936e279 None None] Network 11c994a8-6ede-4290-84f0-71af466860db requested from dv-cinder-790910-4-iscsi {{(pid=91688) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 04:28:10.949817 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-3369a57a-25e6-45fe-8612-05a613184fb7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1796474', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1714058'] for router, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:11.002149 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 37b494d0-4880-4690-a8dc-f497042f06fd up at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:28:11.080446 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-28d9f1d6-3c77-4c2b-ab05-d3badf81472d None None] Provisioning for port 37b494d0-4880-4690-a8dc-f497042f06fd completed by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:28:11.146555 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning for port 37b494d0-4880-4690-a8dc-f497042f06fd completed by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:28:11.155983 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning complete for port 37b494d0-4880-4690-a8dc-f497042f06fd triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:28:11.156154 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3369a57a-25e6-45fe-8612-05a613184fb7 admin admin] Router a7f66c4d-6b4f-4053-bd69-e1bea7db4c61 is scheduled to L3 agent 02733fc0-fc9c-4e29-bc03-c27a792d539d with binding_index 1 {{(pid=91687) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 20 04:28:11.156366 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:11.325672 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:11.336662 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3369a57a-25e6-45fe-8612-05a613184fb7 admin admin] Notify agent at l3_agent.dv-cinder-790910-4-iscsi the message routers_updated {{(pid=91687) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 04:28:11.349298 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1f1e2591-2997-4935-adfd-f35caa57a602 None None] Sync routers for ids ['a7f66c4d-6b4f-4053-bd69-e1bea7db4c61'] in dv-cinder-790910-4-iscsi {{(pid=91688) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 04:28:11.363767 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-3369a57a-25e6-45fe-8612-05a613184fb7 admin admin] Notify callbacks [] for router, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:11.365254 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-3369a57a-25e6-45fe-8612-05a613184fb7 admin admin] 10.222.0.71 "POST /v2.0/routers HTTP/1.1" status: 201  len: 922 time: 2.3758950
May 20 04:28:11.367828 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 43864) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:28:11.370053 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1f1e2591-2997-4935-adfd-f35caa57a602 None None] Routers {'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91688) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:28:11.370685 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-1f1e2591-2997-4935-adfd-f35caa57a602 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced0b84ee0>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:28:03Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['a7f66c4d-6b4f-4053-bd69-e1bea7db4c61'], 'active': True} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:28:11.417871 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] For port 37b494d0-4880-4690-a8dc-f497042f06fd, host dv-cinder-790910-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=37b494d0-4880-4690-a8dc-f497042f06fd,segment=NetworkSegment(e9f32492-7a41-4dc9-bc94-b8bce4a8e65d),segment_id=e9f32492-7a41-4dc9-bc94-b8bce4a8e65d)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:28:11.428241 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:11.437367 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:28:11.601756 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Pushing event updated for resources: {'Port': ['ID=37b494d0-4880-4690-a8dc-f497042f06fd,revision_number=3']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:28:11.609180 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.172s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:28:11.612947 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-320b41b9-722d-40a0-995c-6419070a3492 None None] Provisioning complete for port 37b494d0-4880-4690-a8dc-f497042f06fd triggered by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:28:11.613341 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-320b41b9-722d-40a0-995c-6419070a3492 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:11.664710 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvr_db [None req-1f1e2591-2997-4935-adfd-f35caa57a602 None None] Set router a7f66c4d-6b4f-4053-bd69-e1bea7db4c61 gateway port host: dv-cinder-790910-4-iscsi {{(pid=91688) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:28:12.037482 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-1f1e2591-2997-4935-adfd-f35caa57a602 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced0b84ee0>, [{'id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'name': 'tempest-TestVolumeBootPattern-857163320-router', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.91'}], 'enable_snat': True}, 'gw_port_id': '866cc6c0-5986-4eb4-8827-b255811a13de', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:28:09Z', 'updated_at': '2021-05-20T04:28:10Z', 'revision_number': 3, 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'gw_port': {'id': '866cc6c0-5986-4eb4-8827-b255811a13de', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:f5:21', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'device_owner': 'network:router_gateway', 'standard_attr_id': 511, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:28:09Z', 'updated_at': '2021-05-20T04:28:09Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi'}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:28:12.041605 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1f1e2591-2997-4935-adfd-f35caa57a602 None None] Checking router: a7f66c4d-6b4f-4053-bd69-e1bea7db4c61 for host: dv-cinder-790910-4-iscsi {{(pid=91688) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 04:28:12.041964 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1f1e2591-2997-4935-adfd-f35caa57a602 None None] Updating router a7f66c4d-6b4f-4053-bd69-e1bea7db4c61 port 866cc6c0-5986-4eb4-8827-b255811a13de binding host dv-cinder-790910-4-iscsi {{(pid=91688) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 20 04:28:12.093741 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1f1e2591-2997-4935-adfd-f35caa57a602 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:12.142478 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-a081b454-f278-43ba-955f-0b89597da459 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:12.357321 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.db_base_plugin_common [None req-a081b454-f278-43ba-955f-0b89597da459 admin admin] Allocated IP 172.20.0.1 (11c994a8-6ede-4290-84f0-71af466860db/51af45f1-449a-400c-8714-8d713d4a7993/0bcb5c14-319d-4871-bef1-50d60ad3f5b8) {{(pid=91687) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 04:28:12.426363 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1f1e2591-2997-4935-adfd-f35caa57a602 None None] Notify callbacks [] for port, precommit_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:12.438890 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-1f1e2591-2997-4935-adfd-f35caa57a602 None None] Transition to ACTIVE for port object 866cc6c0-5986-4eb4-8827-b255811a13de will not be triggered until provisioned by entity L2. {{(pid=91688) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:28:12.447248 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1f1e2591-2997-4935-adfd-f35caa57a602 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:12.450815 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:28:12.517382 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-a081b454-f278-43ba-955f-0b89597da459 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:12.530243 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.managers [None req-1f1e2591-2997-4935-adfd-f35caa57a602 None None] Attempting to bind port 866cc6c0-5986-4eb4-8827-b255811a13de on host dv-cinder-790910-4-iscsi for vnic_type normal with profile  {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 04:28:12.530243 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.managers [None req-1f1e2591-2997-4935-adfd-f35caa57a602 None None] Attempting to bind port 866cc6c0-5986-4eb4-8827-b255811a13de by drivers openvswitch,hyperv on host dv-cinder-790910-4-iscsi at level 0 using segments [{'id': '8df49ec5-3fb9-4715-bc9a-f4019a6b55f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90'}] {{(pid=91688) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 04:28:12.530243 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1f1e2591-2997-4935-adfd-f35caa57a602 None None] Attempting to bind port 866cc6c0-5986-4eb4-8827-b255811a13de on network aec557db-0c02-4008-8c9f-2efcd7462f90 {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:28:12.534190 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.provisioning_blocks [None req-a081b454-f278-43ba-955f-0b89597da459 admin admin] Transition to ACTIVE for port object 0bcb5c14-319d-4871-bef1-50d60ad3f5b8 will not be triggered until provisioned by entity DHCP. {{(pid=91687) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:28:12.536282 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92a2fbaf-428e-48e5-811e-b468a13b926c None None] Pushing event updated for resources: {'Port': ['ID=866cc6c0-5986-4eb4-8827-b255811a13de,revision_number=2']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:28:12.540216 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-92a2fbaf-428e-48e5-811e-b468a13b926c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:28:12.541186 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1f1e2591-2997-4935-adfd-f35caa57a602 None None] Checking agent: {'id': '333121d4-1023-4a33-a54c-f4dd052e1612', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-790910-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 4, 13, 33), 'started_at': datetime.datetime(2021, 5, 20, 4, 14, 3), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 4, 28, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-790910-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 04:28:12.541566 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1f1e2591-2997-4935-adfd-f35caa57a602 None None] Checking segment: {'id': '8df49ec5-3fb9-4715-bc9a-f4019a6b55f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91688) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:28:12.541982 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1f1e2591-2997-4935-adfd-f35caa57a602 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:12.542364 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1f1e2591-2997-4935-adfd-f35caa57a602 None None] Bound using segment: {'id': '8df49ec5-3fb9-4715-bc9a-f4019a6b55f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90'} {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 04:28:12.542843 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.managers [None req-1f1e2591-2997-4935-adfd-f35caa57a602 None None] Bound port: 866cc6c0-5986-4eb4-8827-b255811a13de, host: dv-cinder-790910-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8df49ec5-3fb9-4715-bc9a-f4019a6b55f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90'}}] {{(pid=91688) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 04:28:12.543279 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1f1e2591-2997-4935-adfd-f35caa57a602 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:12.565120 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-a081b454-f278-43ba-955f-0b89597da459 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8782892106231', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4162192'] for port, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:12.570987 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:28:12.619556 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1f1e2591-2997-4935-adfd-f35caa57a602 None None] For port 866cc6c0-5986-4eb4-8827-b255811a13de, host dv-cinder-790910-4-iscsi, cleared binding levels {{(pid=91688) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 04:28:12.623178 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1f1e2591-2997-4935-adfd-f35caa57a602 None None] For port 866cc6c0-5986-4eb4-8827-b255811a13de, host dv-cinder-790910-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=866cc6c0-5986-4eb4-8827-b255811a13de,segment=NetworkSegment(8df49ec5-3fb9-4715-bc9a-f4019a6b55f9),segment_id=8df49ec5-3fb9-4715-bc9a-f4019a6b55f9)] {{(pid=91688) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 04:28:12.627331 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1f1e2591-2997-4935-adfd-f35caa57a602 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:12.632018 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:28:12.633215 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a081b454-f278-43ba-955f-0b89597da459 admin admin] Network 11c994a8-6ede-4290-84f0-71af466860db is already hosted by enough agents. {{(pid=91687) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:28:12.636402 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.base_scheduler [None req-a081b454-f278-43ba-955f-0b89597da459 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91687) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:28:12.640496 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a081b454-f278-43ba-955f-0b89597da459 admin admin] Received port after_create {{(pid=91687) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 04:28:12.685876 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a081b454-f278-43ba-955f-0b89597da459 admin admin] Pushing event updated for resources: {'Port': ['ID=0bcb5c14-319d-4871-bef1-50d60ad3f5b8,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:28:12.691103 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-a081b454-f278-43ba-955f-0b89597da459 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.120s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:28:12.709286 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-a081b454-f278-43ba-955f-0b89597da459 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1716281'] for router_interface, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:12.710640 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1f1e2591-2997-4935-adfd-f35caa57a602 None None] Routers {'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91688) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:28:12.711279 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-1f1e2591-2997-4935-adfd-f35caa57a602 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced0b84ee0>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:28:03Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['a7f66c4d-6b4f-4053-bd69-e1bea7db4c61'], 'active': True} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:28:12.791331 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92a2fbaf-428e-48e5-811e-b468a13b926c None None] Pushing event updated for resources: {'Port': ['ID=866cc6c0-5986-4eb4-8827-b255811a13de,revision_number=3']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:28:12.794656 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-92a2fbaf-428e-48e5-811e-b468a13b926c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.163s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:28:12.922146 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvr_db [None req-1f1e2591-2997-4935-adfd-f35caa57a602 None None] Set router a7f66c4d-6b4f-4053-bd69-e1bea7db4c61 gateway port host: dv-cinder-790910-4-iscsi {{(pid=91688) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:28:13.001813 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-a081b454-f278-43ba-955f-0b89597da459 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:13.032375 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 37b494d0-4880-4690-a8dc-f497042f06fd up at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:28:13.121577 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-5f4d08ad-a2e3-4171-8b6e-294a1dea4324 None None] Provisioning for port 0bcb5c14-319d-4871-bef1-50d60ad3f5b8 completed by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:28:13.180900 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-5f4d08ad-a2e3-4171-8b6e-294a1dea4324 None None] Provisioning complete for port 0bcb5c14-319d-4871-bef1-50d60ad3f5b8 triggered by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:28:13.181301 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-5f4d08ad-a2e3-4171-8b6e-294a1dea4324 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:13.271351 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-5f4d08ad-a2e3-4171-8b6e-294a1dea4324 None None] Port 0bcb5c14-319d-4871-bef1-50d60ad3f5b8 cannot update to ACTIVE because it is not bound. {{(pid=91688) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 20 04:28:13.275972 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning complete for port 37b494d0-4880-4690-a8dc-f497042f06fd triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:28:13.276348 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:13.379154 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08b74381-e679-4ef2-bf01-bac6e90dbcda req-4e44a3aa-1574-4a83-ab1f-d94b059dbd7d tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:28:13.380707 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-08b74381-e679-4ef2-bf01-bac6e90dbcda req-4e44a3aa-1574-4a83-ab1f-d94b059dbd7d tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 984 time: 0.1310043
May 20 04:28:13.385195 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-a081b454-f278-43ba-955f-0b89597da459 admin admin] Notify callbacks [] for port, precommit_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:13.402340 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-a081b454-f278-43ba-955f-0b89597da459 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4162185'] for port, after_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:13.429307 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-72a16694-4cf4-4699-95ff-3ad51eb818ce admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:28:13.495140 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-1f1e2591-2997-4935-adfd-f35caa57a602 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced0b84ee0>, [{'id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'name': 'tempest-TestVolumeBootPattern-857163320-router', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.91'}], 'enable_snat': True}, 'gw_port_id': '866cc6c0-5986-4eb4-8827-b255811a13de', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:28:09Z', 'updated_at': '2021-05-20T04:28:10Z', 'revision_number': 3, 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'gw_port': {'id': '866cc6c0-5986-4eb4-8827-b255811a13de', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:f5:21', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'device_owner': 'network:router_gateway', 'standard_attr_id': 511, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:28:09Z', 'updated_at': '2021-05-20T04:28:12Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi'}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:28:13.500201 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1f1e2591-2997-4935-adfd-f35caa57a602 None None] The sync data for ids ['a7f66c4d-6b4f-4053-bd69-e1bea7db4c61'] in dv-cinder-790910-4-iscsi is: [{'id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'name': 'tempest-TestVolumeBootPattern-857163320-router', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.91'}], 'enable_snat': True}, 'gw_port_id': '866cc6c0-5986-4eb4-8827-b255811a13de', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:28:09Z', 'updated_at': '2021-05-20T04:28:10Z', 'revision_number': 3, 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'gw_port': {'id': '866cc6c0-5986-4eb4-8827-b255811a13de', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:f5:21', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'device_owner': 'network:router_gateway', 'standard_attr_id': 511, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:28:09Z', 'updated_at': '2021-05-20T04:28:12Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi'}] {{(pid=91688) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 04:28:13.522671 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-08b74381-e679-4ef2-bf01-bac6e90dbcda req-388c49b1-bdb7-4d7c-9657-a29b88e27dee tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Synchronizing usage tracker for tenant:e6fe6bea38b946a5a97ea42bf787f1b3 on resource:security_group {{(pid=91687) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:28:13.544140 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-a081b454-f278-43ba-955f-0b89597da459 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1781412', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1716318'] for router_interface, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:13.549161 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a081b454-f278-43ba-955f-0b89597da459 admin admin] Pushing event updated for resources: {'Port': ['ID=0bcb5c14-319d-4871-bef1-50d60ad3f5b8,revision_number=2']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:28:13.555572 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-a081b454-f278-43ba-955f-0b89597da459 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.126s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:28:13.577634 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-08b74381-e679-4ef2-bf01-bac6e90dbcda req-388c49b1-bdb7-4d7c-9657-a29b88e27dee tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Unset dirty status for tenant:e6fe6bea38b946a5a97ea42bf787f1b3 on resource:security_group {{(pid=91687) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:28:13.578840 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-08b74381-e679-4ef2-bf01-bac6e90dbcda req-388c49b1-bdb7-4d7c-9657-a29b88e27dee tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=84c434c2-401c-4319-a0ff-8ceaf7cae545&id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.1916993
May 20 04:28:13.709694 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a081b454-f278-43ba-955f-0b89597da459 admin admin] Network 11c994a8-6ede-4290-84f0-71af466860db is already hosted by enough agents. {{(pid=91687) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:28:13.710825 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.base_scheduler [None req-a081b454-f278-43ba-955f-0b89597da459 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91687) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:28:13.933398 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a081b454-f278-43ba-955f-0b89597da459 admin admin] Router a7f66c4d-6b4f-4053-bd69-e1bea7db4c61 has already been hosted by L3 agent 02733fc0-fc9c-4e29-bc03-c27a792d539d {{(pid=91687) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 04:28:13.998551 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-361902a1-adbe-4ed4-aa8b-f6d01eba2099 None None] Provisioning complete for port 0bcb5c14-319d-4871-bef1-50d60ad3f5b8 triggered by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:28:13.999353 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-361902a1-adbe-4ed4-aa8b-f6d01eba2099 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:14.058397 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-361902a1-adbe-4ed4-aa8b-f6d01eba2099 None None] Port 0bcb5c14-319d-4871-bef1-50d60ad3f5b8 cannot update to ACTIVE because it is not bound. {{(pid=91688) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 20 04:28:14.120319 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a081b454-f278-43ba-955f-0b89597da459 admin admin] Notify agent at l3_agent.dv-cinder-790910-4-iscsi the message routers_updated {{(pid=91687) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 04:28:14.130065 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-a081b454-f278-43ba-955f-0b89597da459 admin admin] 10.222.0.71 "PUT /v2.0/routers/a7f66c4d-6b4f-4053-bd69-e1bea7db4c61/add_router_interface HTTP/1.1" status: 200  len: 503 time: 2.7612104
May 20 04:28:14.682570 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 43904) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:28:14.689230 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [None req-8b045d2f-19d2-4399-bca8-4a7b32cb3293 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-1348979754-network', 'tenant_id': '9cdc6335963a47e384b2530ced2a9b80'}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:28:14.694437 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-8b045d2f-19d2-4399-bca8-4a7b32cb3293 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:28:14.698696 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-8b045d2f-19d2-4399-bca8-4a7b32cb3293 admin admin] Usage tracker for resource:network and tenant:9cdc6335963a47e384b2530ced2a9b80 is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:28:14.701942 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-8b045d2f-19d2-4399-bca8-4a7b32cb3293 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:28:14.709779 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-8b045d2f-19d2-4399-bca8-4a7b32cb3293 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:28:14.723435 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8b045d2f-19d2-4399-bca8-4a7b32cb3293 admin admin] Made reservation on behalf of 9cdc6335963a47e384b2530ced2a9b80 for: {'network': 1} {{(pid=91687) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 04:28:14.725900 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-8b045d2f-19d2-4399-bca8-4a7b32cb3293 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-578118'] for network, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:14.738693 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-8b045d2f-19d2-4399-bca8-4a7b32cb3293 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:14.754841 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-8b045d2f-19d2-4399-bca8-4a7b32cb3293 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:28:14.759044 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-8b045d2f-19d2-4399-bca8-4a7b32cb3293 admin admin] Usage tracker for resource:security_group_rule and tenant:9cdc6335963a47e384b2530ced2a9b80 is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:28:14.762291 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-8b045d2f-19d2-4399-bca8-4a7b32cb3293 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:28:14.769189 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-8b045d2f-19d2-4399-bca8-4a7b32cb3293 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:28:14.786801 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63d9c4e0-ce54-4d8a-a304-471cbf18dc72 req-2a3076ee-6f56-434c-b273-a165c0b171ca tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:28:14.789271 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-63d9c4e0-ce54-4d8a-a304-471cbf18dc72 req-2a3076ee-6f56-434c-b273-a165c0b171ca tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 984 time: 0.0984941
May 20 04:28:14.859507 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-63d9c4e0-ce54-4d8a-a304-471cbf18dc72 req-93d9a9d9-ed20-4d98-8cb4-4a8eb10e7467 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=84c434c2-401c-4319-a0ff-8ceaf7cae545&id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0624635
May 20 04:28:14.896165 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-8b045d2f-19d2-4399-bca8-4a7b32cb3293 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:14.904178 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-8b045d2f-19d2-4399-bca8-4a7b32cb3293 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:14.907921 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-3ea673ca-8b97-4f52-b502-37ee28f1fa53 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:28:14.941618 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b045d2f-19d2-4399-bca8-4a7b32cb3293 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d3c17903-4b75-4277-aa89-339506502cc6,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:28:14.945187 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-8b045d2f-19d2-4399-bca8-4a7b32cb3293 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:28:14.946160 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8b045d2f-19d2-4399-bca8-4a7b32cb3293 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 876}  {{(pid=91687) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 20 04:28:14.957229 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-8b045d2f-19d2-4399-bca8-4a7b32cb3293 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1501910'] for segment, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:14.957574 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.db.segments_db [None req-8b045d2f-19d2-4399-bca8-4a7b32cb3293 admin admin] Added segment 400d6b98-7e80-413b-b776-1d2e09a33a2f of type vlan for network 797bc43b-d3f0-4cce-ab72-4d9b7d99a5cc
May 20 04:28:14.988883 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 866cc6c0-5986-4eb4-8827-b255811a13de up at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:28:14.990965 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-8b045d2f-19d2-4399-bca8-4a7b32cb3293 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8782892092784'] for network, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:15.024487 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-8b045d2f-19d2-4399-bca8-4a7b32cb3293 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1590664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1781430'] for network, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:15.025886 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8b045d2f-19d2-4399-bca8-4a7b32cb3293 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:28:15.026470 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-8b045d2f-19d2-4399-bca8-4a7b32cb3293 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for network, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:15.031604 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-d7f746a0-2bc6-47f7-a8cb-e1ed4558d150 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:28:15.059191 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning for port 866cc6c0-5986-4eb4-8827-b255811a13de completed by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:28:15.063425 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning complete for port 866cc6c0-5986-4eb4-8827-b255811a13de triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:28:15.063799 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:15.132224 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b045d2f-19d2-4399-bca8-4a7b32cb3293 admin admin] Pushing event updated for resources: {'Network': ['ID=797bc43b-d3f0-4cce-ab72-4d9b7d99a5cc,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:28:15.135260 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-8b045d2f-19d2-4399-bca8-4a7b32cb3293 admin admin] 10.222.0.71 "POST /v2.0/networks HTTP/1.1" status: 201  len: 885 time: 0.4508116
May 20 04:28:15.136140 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-8b045d2f-19d2-4399-bca8-4a7b32cb3293 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:28:15.138278 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 43910) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:28:15.143798 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [None req-c86b7fb2-ea15-45d1-a3a5-b0d9046c1f58 admin admin] Request body: {'subnet': {'network_id': '797bc43b-d3f0-4cce-ab72-4d9b7d99a5cc', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-1348979754-subnet', 'tenant_id': '9cdc6335963a47e384b2530ced2a9b80', 'ip_version': 4}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:28:15.148917 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-c86b7fb2-ea15-45d1-a3a5-b0d9046c1f58 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:28:15.153299 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-c86b7fb2-ea15-45d1-a3a5-b0d9046c1f58 admin admin] Usage tracker for resource:subnet and tenant:9cdc6335963a47e384b2530ced2a9b80 is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:28:15.156302 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-c86b7fb2-ea15-45d1-a3a5-b0d9046c1f58 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:28:15.163569 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-c86b7fb2-ea15-45d1-a3a5-b0d9046c1f58 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:28:15.164761 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Network 797bc43b-d3f0-4cce-ab72-4d9b7d99a5cc details requested by agent ovs-agent-dv-cinder-790910-4-iscsi with host dv-cinder-790910-4-iscsi {{(pid=91688) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 20 04:28:15.181931 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c86b7fb2-ea15-45d1-a3a5-b0d9046c1f58 admin admin] Made reservation on behalf of 9cdc6335963a47e384b2530ced2a9b80 for: {'subnet': 1} {{(pid=91687) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 04:28:15.184503 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-c86b7fb2-ea15-45d1-a3a5-b0d9046c1f58 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-692271'] for subnet, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:15.210032 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a2245e9a-ec5e-4eab-b16f-dc7c5525977c None None] Sync routers for ids ['a7f66c4d-6b4f-4053-bd69-e1bea7db4c61'] in dv-cinder-790910-4-iscsi {{(pid=91689) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 04:28:15.222323 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a2245e9a-ec5e-4eab-b16f-dc7c5525977c None None] Routers {'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91689) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:28:15.222840 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-a2245e9a-ec5e-4eab-b16f-dc7c5525977c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced19f6820>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:28:03Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['a7f66c4d-6b4f-4053-bd69-e1bea7db4c61'], 'active': True} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:28:15.288723 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:15.324489 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] For port 866cc6c0-5986-4eb4-8827-b255811a13de, host dv-cinder-790910-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=866cc6c0-5986-4eb4-8827-b255811a13de,segment=NetworkSegment(8df49ec5-3fb9-4715-bc9a-f4019a6b55f9),segment_id=8df49ec5-3fb9-4715-bc9a-f4019a6b55f9)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:28:15.330852 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:15.333081 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-f991cacc-1ddb-4459-b040-b415638d2394 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:28:15.405715 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Pushing event updated for resources: {'Port': ['ID=866cc6c0-5986-4eb4-8827-b255811a13de,revision_number=4']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:28:15.410173 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:28:15.412281 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvr_db [None req-a2245e9a-ec5e-4eab-b16f-dc7c5525977c None None] Set router a7f66c4d-6b4f-4053-bd69-e1bea7db4c61 gateway port host: dv-cinder-790910-4-iscsi {{(pid=91689) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:28:15.598952 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-c86b7fb2-ea15-45d1-a3a5-b0d9046c1f58 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-255887', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-4160768', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-692253'] for subnet, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:15.602764 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:28:15.667056 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c86b7fb2-ea15-45d1-a3a5-b0d9046c1f58 admin admin] Pushing event updated for resources: {'Subnet': ['ID=b84834e7-a1f8-44f0-aa94-dda7f575d2e7,revision_number=0']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:28:15.670048 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-c86b7fb2-ea15-45d1-a3a5-b0d9046c1f58 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.067s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:28:15.687336 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c86b7fb2-ea15-45d1-a3a5-b0d9046c1f58 admin admin] Checking segment: {'id': '400d6b98-7e80-413b-b776-1d2e09a33a2f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': '797bc43b-d3f0-4cce-ab72-4d9b7d99a5cc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91687) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:28:15.688332 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c86b7fb2-ea15-45d1-a3a5-b0d9046c1f58 admin admin] Network hostable DHCP agents. Network: 797bc43b-d3f0-4cce-ab72-4d9b7d99a5cc, hostable agents: ['36d27813-c368-4fd7-ae26-0f662e0a96fd'], hosted agents: [] {{(pid=91687) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 20 04:28:15.709865 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c86b7fb2-ea15-45d1-a3a5-b0d9046c1f58 admin admin] Network 797bc43b-d3f0-4cce-ab72-4d9b7d99a5cc is scheduled to be hosted by DHCP agent 36d27813-c368-4fd7-ae26-0f662e0a96fd with binding_index 1 {{(pid=91687) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 20 04:28:15.724145 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.base_scheduler [None req-c86b7fb2-ea15-45d1-a3a5-b0d9046c1f58 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-790910-4-iscsi, 797bc43b-d3f0-4cce-ab72-4d9b7d99a5cc) {{(pid=91687) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:28:15.733398 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5cafb693-1007-4085-911f-8a58e4d4229e None None] Network 797bc43b-d3f0-4cce-ab72-4d9b7d99a5cc requested from dv-cinder-790910-4-iscsi {{(pid=91688) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 04:28:15.736635 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c86b7fb2-ea15-45d1-a3a5-b0d9046c1f58 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:28:15.737317 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-c86b7fb2-ea15-45d1-a3a5-b0d9046c1f58 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for subnet, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:15.764691 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-c86b7fb2-ea15-45d1-a3a5-b0d9046c1f58 admin admin] 10.222.0.71 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 848 time: 0.6253021
May 20 04:28:15.768938 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 43916) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:28:15.775412 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.v2.base [None req-b152f7ce-d3c2-45db-9896-bf7e7a9a2806 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-1348979754-router', 'tenant_id': '9cdc6335963a47e384b2530ced2a9b80', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90'}}} {{(pid=91686) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:28:15.778634 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-a2245e9a-ec5e-4eab-b16f-dc7c5525977c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced19f6820>, [{'id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'name': 'tempest-TestVolumeBootPattern-857163320-router', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.91'}], 'enable_snat': True}, 'gw_port_id': '866cc6c0-5986-4eb4-8827-b255811a13de', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:28:09Z', 'updated_at': '2021-05-20T04:28:12Z', 'revision_number': 4, 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'gw_port': {'id': '866cc6c0-5986-4eb4-8827-b255811a13de', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:f5:21', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'device_owner': 'network:router_gateway', 'standard_attr_id': 511, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:28:09Z', 'updated_at': '2021-05-20T04:28:12Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_interfaces': [{'id': '0bcb5c14-319d-4871-bef1-50d60ad3f5b8', 'name': '', 'network_id': '11c994a8-6ede-4290-84f0-71af466860db', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'mac_address': 'fa:16:3e:2c:84:48', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'device_owner': 'network:router_interface', 'standard_attr_id': 512, 'fixed_ips': [{'subnet_id': '51af45f1-449a-400c-8714-8d713d4a7993', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:28:12Z', 'updated_at': '2021-05-20T04:28:13Z', 'revision_number': 2, 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'subnets': [{'id': '51af45f1-449a-400c-8714-8d713d4a7993', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:28:15.781135 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-b152f7ce-d3c2-45db-9896-bf7e7a9a2806 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:28:15.786170 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-b152f7ce-d3c2-45db-9896-bf7e7a9a2806 admin admin] Usage tracker for resource:router and tenant:9cdc6335963a47e384b2530ced2a9b80 is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:28:15.786606 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a2245e9a-ec5e-4eab-b16f-dc7c5525977c None None] Checking router: a7f66c4d-6b4f-4053-bd69-e1bea7db4c61 for host: dv-cinder-790910-4-iscsi {{(pid=91689) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 04:28:15.787184 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a2245e9a-ec5e-4eab-b16f-dc7c5525977c None None] Updating router a7f66c4d-6b4f-4053-bd69-e1bea7db4c61 port 0bcb5c14-319d-4871-bef1-50d60ad3f5b8 binding host dv-cinder-790910-4-iscsi {{(pid=91689) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 20 04:28:15.790009 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-b152f7ce-d3c2-45db-9896-bf7e7a9a2806 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:28:15.797822 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-b152f7ce-d3c2-45db-9896-bf7e7a9a2806 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:28:15.810588 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-b152f7ce-d3c2-45db-9896-bf7e7a9a2806 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1796465', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-6255'] for router, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:15.812237 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-b152f7ce-d3c2-45db-9896-bf7e7a9a2806 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1713009', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1713968', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1590966', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-6244'] for router, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:15.838760 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-b152f7ce-d3c2-45db-9896-bf7e7a9a2806 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:15.884561 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron_lib.callbacks.manager [None req-a2245e9a-ec5e-4eab-b16f-dc7c5525977c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:16.017099 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ed0d6d15-f534-43d2-b166-ee24535e667e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpfbdc8e9b-5136-5478-8aa8-b0b6b9be0f90-797bc43b-d3f0-4cce-ab72-4d9b7d99a5cc', 'network_id': '797bc43b-d3f0-4cce-ab72-4d9b7d99a5cc', 'tenant_id': '9cdc6335963a47e384b2530ced2a9b80', 'fixed_ips': [{'subnet_id': 'b84834e7-a1f8-44f0-aa94-dda7f575d2e7'}]}} from dv-cinder-790910-4-iscsi. {{(pid=91688) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 20 04:28:16.017958 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ed0d6d15-f534-43d2-b166-ee24535e667e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_create {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:16.021807 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.agents_db [None req-92d61f12-17bc-4bf9-9eab-8a69b8c6da2f None None] Agent healthcheck: found 6 active agents {{(pid=91689) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 04:28:16.192000 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd0c6507-c2d9-425d-9222-ffadc3540b20 req-db73a642-9535-46dd-a492-2c5481f47b67 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:28:16.192243 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-b152f7ce-d3c2-45db-9896-bf7e7a9a2806 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1713977', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1796355', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-6218'] for router, precommit_update {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:16.192388 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-dd0c6507-c2d9-425d-9222-ffadc3540b20 req-db73a642-9535-46dd-a492-2c5481f47b67 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 984 time: 0.1986570
May 20 04:28:16.212025 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.db_base_plugin_common [None req-ed0d6d15-f534-43d2-b166-ee24535e667e None None] Allocated IP 172.20.0.2 (797bc43b-d3f0-4cce-ab72-4d9b7d99a5cc/b84834e7-a1f8-44f0-aa94-dda7f575d2e7/969bcd0d-d995-4cb6-b639-71f740b78b63) {{(pid=91688) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 04:28:16.251613 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron_lib.callbacks.manager [None req-a2245e9a-ec5e-4eab-b16f-dc7c5525977c None None] Notify callbacks [] for port, precommit_update {{(pid=91689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:16.265971 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-dd0c6507-c2d9-425d-9222-ffadc3540b20 req-f9c6337d-4fcd-4e91-9bfc-745c38920d06 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=84c434c2-401c-4319-a0ff-8ceaf7cae545&id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0637207
May 20 04:28:16.267228 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.provisioning_blocks [None req-a2245e9a-ec5e-4eab-b16f-dc7c5525977c None None] Transition to ACTIVE for port object 0bcb5c14-319d-4871-bef1-50d60ad3f5b8 will not be triggered until provisioned by entity L2. {{(pid=91689) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:28:16.276227 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron_lib.callbacks.manager [None req-a2245e9a-ec5e-4eab-b16f-dc7c5525977c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:16.282961 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG oslo_concurrency.lockutils [None req-2c2f4c9a-1e0f-43e2-9984-19c1b954e4d1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:28:16.421679 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df7e9a1a-bfdd-4f45-884f-e9bfd2aed1ac None None] Pushing event updated for resources: {'Port': ['ID=0bcb5c14-319d-4871-bef1-50d60ad3f5b8,revision_number=3']} {{(pid=91689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:28:16.431439 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df7e9a1a-bfdd-4f45-884f-e9bfd2aed1ac None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:28:16.432139 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df7e9a1a-bfdd-4f45-884f-e9bfd2aed1ac None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:28:16.432618 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df7e9a1a-bfdd-4f45-884f-e9bfd2aed1ac None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:28:16.433119 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df7e9a1a-bfdd-4f45-884f-e9bfd2aed1ac None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:28:16.434901 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df7e9a1a-bfdd-4f45-884f-e9bfd2aed1ac None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:28:16.435430 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df7e9a1a-bfdd-4f45-884f-e9bfd2aed1ac None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:28:16.435906 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df7e9a1a-bfdd-4f45-884f-e9bfd2aed1ac None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:28:16.436689 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df7e9a1a-bfdd-4f45-884f-e9bfd2aed1ac None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:28:16.437520 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df7e9a1a-bfdd-4f45-884f-e9bfd2aed1ac None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:28:16.438023 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df7e9a1a-bfdd-4f45-884f-e9bfd2aed1ac None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:28:16.438516 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df7e9a1a-bfdd-4f45-884f-e9bfd2aed1ac None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:28:16.438994 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df7e9a1a-bfdd-4f45-884f-e9bfd2aed1ac None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:28:16.444240 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG oslo_concurrency.lockutils [None req-df7e9a1a-bfdd-4f45-884f-e9bfd2aed1ac None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.162s {{(pid=91689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:28:16.485798 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ed0d6d15-f534-43d2-b166-ee24535e667e None None] Notify callbacks [] for port, precommit_create {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:16.504618 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-ed0d6d15-f534-43d2-b166-ee24535e667e None None] Transition to ACTIVE for port object 969bcd0d-d995-4cb6-b639-71f740b78b63 will not be triggered until provisioned by entity L2. {{(pid=91688) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:28:16.526704 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-ed0d6d15-f534-43d2-b166-ee24535e667e None None] Transition to ACTIVE for port object 969bcd0d-d995-4cb6-b639-71f740b78b63 will not be triggered until provisioned by entity DHCP. {{(pid=91688) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:28:16.535936 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ed0d6d15-f534-43d2-b166-ee24535e667e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8782892106231'] for port, after_create {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:16.539816 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-f991cacc-1ddb-4459-b040-b415638d2394 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:28:16.557650 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.managers [None req-a2245e9a-ec5e-4eab-b16f-dc7c5525977c None None] Attempting to bind port 0bcb5c14-319d-4871-bef1-50d60ad3f5b8 on host dv-cinder-790910-4-iscsi for vnic_type normal with profile  {{(pid=91689) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 04:28:16.558047 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.managers [None req-a2245e9a-ec5e-4eab-b16f-dc7c5525977c None None] Attempting to bind port 0bcb5c14-319d-4871-bef1-50d60ad3f5b8 by drivers openvswitch,hyperv on host dv-cinder-790910-4-iscsi at level 0 using segments [{'id': 'e9f32492-7a41-4dc9-bc94-b8bce4a8e65d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': '11c994a8-6ede-4290-84f0-71af466860db'}] {{(pid=91689) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 04:28:16.558380 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a2245e9a-ec5e-4eab-b16f-dc7c5525977c None None] Attempting to bind port 0bcb5c14-319d-4871-bef1-50d60ad3f5b8 on network 11c994a8-6ede-4290-84f0-71af466860db {{(pid=91689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:28:16.564806 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a2245e9a-ec5e-4eab-b16f-dc7c5525977c None None] Checking agent: {'id': '333121d4-1023-4a33-a54c-f4dd052e1612', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-790910-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 4, 13, 33), 'started_at': datetime.datetime(2021, 5, 20, 4, 14, 3), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 4, 28, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-790910-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 04:28:16.565342 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a2245e9a-ec5e-4eab-b16f-dc7c5525977c None None] Checking segment: {'id': 'e9f32492-7a41-4dc9-bc94-b8bce4a8e65d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': '11c994a8-6ede-4290-84f0-71af466860db'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91689) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:28:16.565734 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron_lib.callbacks.manager [None req-a2245e9a-ec5e-4eab-b16f-dc7c5525977c None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:16.566125 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a2245e9a-ec5e-4eab-b16f-dc7c5525977c None None] Bound using segment: {'id': 'e9f32492-7a41-4dc9-bc94-b8bce4a8e65d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': '11c994a8-6ede-4290-84f0-71af466860db'} {{(pid=91689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 04:28:16.566600 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.managers [None req-a2245e9a-ec5e-4eab-b16f-dc7c5525977c None None] Bound port: 0bcb5c14-319d-4871-bef1-50d60ad3f5b8, host: dv-cinder-790910-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e9f32492-7a41-4dc9-bc94-b8bce4a8e65d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': '11c994a8-6ede-4290-84f0-71af466860db'}}] {{(pid=91689) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 04:28:16.567127 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron_lib.callbacks.manager [None req-a2245e9a-ec5e-4eab-b16f-dc7c5525977c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:16.593793 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-b152f7ce-d3c2-45db-9896-bf7e7a9a2806 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:16.619890 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ed0d6d15-f534-43d2-b166-ee24535e667e None None] Network 797bc43b-d3f0-4cce-ab72-4d9b7d99a5cc is already hosted by enough agents. {{(pid=91688) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:28:16.624357 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.scheduler.base_scheduler [None req-ed0d6d15-f534-43d2-b166-ee24535e667e None None] Resources bound (agent type, host, resource id):  {{(pid=91688) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:28:16.625670 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-b152f7ce-d3c2-45db-9896-bf7e7a9a2806 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:16.629239 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ed0d6d15-f534-43d2-b166-ee24535e667e None None] Received port after_create {{(pid=91688) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 04:28:16.660404 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2ace91f-cb97-4a5d-9b45-c95ed3fe1871 req-3a4e2a6a-9b25-44a0-88d1-7151b6b7883a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:28:16.662531 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-d2ace91f-cb97-4a5d-9b45-c95ed3fe1871 req-3a4e2a6a-9b25-44a0-88d1-7151b6b7883a service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=e6fe6bea38b946a5a97ea42bf787f1b3&device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 1137 time: 0.0891969
May 20 04:28:16.664565 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed0d6d15-f534-43d2-b166-ee24535e667e None None] Pushing event updated for resources: {'Port': ['ID=969bcd0d-d995-4cb6-b639-71f740b78b63,revision_number=1']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:28:16.674735 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-ed0d6d15-f534-43d2-b166-ee24535e667e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.134s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:28:16.705087 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.db [None req-a2245e9a-ec5e-4eab-b16f-dc7c5525977c None None] For port 0bcb5c14-319d-4871-bef1-50d60ad3f5b8, host dv-cinder-790910-4-iscsi, cleared binding levels {{(pid=91689) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 04:28:16.710144 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.db [None req-a2245e9a-ec5e-4eab-b16f-dc7c5525977c None None] For port 0bcb5c14-319d-4871-bef1-50d60ad3f5b8, host dv-cinder-790910-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=0bcb5c14-319d-4871-bef1-50d60ad3f5b8,segment=NetworkSegment(e9f32492-7a41-4dc9-bc94-b8bce4a8e65d),segment_id=e9f32492-7a41-4dc9-bc94-b8bce4a8e65d)] {{(pid=91689) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 04:28:16.716179 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron_lib.callbacks.manager [None req-a2245e9a-ec5e-4eab-b16f-dc7c5525977c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:16.722300 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG oslo_concurrency.lockutils [None req-df7e9a1a-bfdd-4f45-884f-e9bfd2aed1ac None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:28:16.735425 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.managers [None req-ed0d6d15-f534-43d2-b166-ee24535e667e None None] Attempting to bind port 969bcd0d-d995-4cb6-b639-71f740b78b63 on host dv-cinder-790910-4-iscsi for vnic_type normal with profile  {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 04:28:16.735895 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.managers [None req-ed0d6d15-f534-43d2-b166-ee24535e667e None None] Attempting to bind port 969bcd0d-d995-4cb6-b639-71f740b78b63 by drivers openvswitch,hyperv on host dv-cinder-790910-4-iscsi at level 0 using segments [{'id': '400d6b98-7e80-413b-b776-1d2e09a33a2f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': '797bc43b-d3f0-4cce-ab72-4d9b7d99a5cc'}] {{(pid=91688) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 04:28:16.736367 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ed0d6d15-f534-43d2-b166-ee24535e667e None None] Attempting to bind port 969bcd0d-d995-4cb6-b639-71f740b78b63 on network 797bc43b-d3f0-4cce-ab72-4d9b7d99a5cc {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:28:16.742378 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ed0d6d15-f534-43d2-b166-ee24535e667e None None] Checking agent: {'id': '333121d4-1023-4a33-a54c-f4dd052e1612', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-790910-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 4, 13, 33), 'started_at': datetime.datetime(2021, 5, 20, 4, 14, 3), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 4, 28, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-790910-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 04:28:16.742837 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ed0d6d15-f534-43d2-b166-ee24535e667e None None] Checking segment: {'id': '400d6b98-7e80-413b-b776-1d2e09a33a2f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': '797bc43b-d3f0-4cce-ab72-4d9b7d99a5cc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91688) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:28:16.743305 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ed0d6d15-f534-43d2-b166-ee24535e667e None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:16.743762 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ed0d6d15-f534-43d2-b166-ee24535e667e None None] Bound using segment: {'id': '400d6b98-7e80-413b-b776-1d2e09a33a2f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': '797bc43b-d3f0-4cce-ab72-4d9b7d99a5cc'} {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 04:28:16.744348 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.managers [None req-ed0d6d15-f534-43d2-b166-ee24535e667e None None] Bound port: 969bcd0d-d995-4cb6-b639-71f740b78b63, host: dv-cinder-790910-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '400d6b98-7e80-413b-b776-1d2e09a33a2f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': '797bc43b-d3f0-4cce-ab72-4d9b7d99a5cc'}}] {{(pid=91688) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 04:28:16.744789 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ed0d6d15-f534-43d2-b166-ee24535e667e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:16.839667 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a2245e9a-ec5e-4eab-b16f-dc7c5525977c None None] Routers {'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91689) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:28:16.841051 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-a2245e9a-ec5e-4eab-b16f-dc7c5525977c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced19f6820>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:28:03Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['a7f66c4d-6b4f-4053-bd69-e1bea7db4c61'], 'active': True} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:28:16.861797 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2ace91f-cb97-4a5d-9b45-c95ed3fe1871 req-37297cf3-7571-4aac-aeb9-59d70d182769 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:28:16.863872 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-d2ace91f-cb97-4a5d-9b45-c95ed3fe1871 req-37297cf3-7571-4aac-aeb9-59d70d182769 service neutron] 10.222.0.82 "GET /v2.0/networks?id=fdf92998-25fa-4179-ab1b-131af0ce059a HTTP/1.1" status: 200  len: 916 time: 0.1896482
May 20 04:28:16.898447 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-ed0d6d15-f534-43d2-b166-ee24535e667e None None] For port 969bcd0d-d995-4cb6-b639-71f740b78b63, host dv-cinder-790910-4-iscsi, cleared binding levels {{(pid=91688) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 04:28:16.910959 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-ed0d6d15-f534-43d2-b166-ee24535e667e None None] For port 969bcd0d-d995-4cb6-b639-71f740b78b63, host dv-cinder-790910-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=969bcd0d-d995-4cb6-b639-71f740b78b63,segment=NetworkSegment(400d6b98-7e80-413b-b776-1d2e09a33a2f),segment_id=400d6b98-7e80-413b-b776-1d2e09a33a2f)] {{(pid=91688) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 04:28:16.919583 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ed0d6d15-f534-43d2-b166-ee24535e667e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:16.931516 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-92a2fbaf-428e-48e5-811e-b468a13b926c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:28:16.944252 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df7e9a1a-bfdd-4f45-884f-e9bfd2aed1ac None None] Pushing event updated for resources: {'Port': ['ID=0bcb5c14-319d-4871-bef1-50d60ad3f5b8,revision_number=4']} {{(pid=91689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:28:16.947856 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG oslo_concurrency.lockutils [None req-df7e9a1a-bfdd-4f45-884f-e9bfd2aed1ac None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.225s {{(pid=91689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:28:16.950881 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.db_base_plugin_common [None req-b152f7ce-d3c2-45db-9896-bf7e7a9a2806 admin admin] Allocated IP 172.27.1.85 (aec557db-0c02-4008-8c9f-2efcd7462f90/217f4b55-4415-4d57-8b43-2ff4c8ac8e81/f752de37-e83f-4b51-b1d4-6eceabcfd969) {{(pid=91686) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 04:28:17.047765 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 866cc6c0-5986-4eb4-8827-b255811a13de up at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:28:17.068308 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-d2ace91f-cb97-4a5d-9b45-c95ed3fe1871 req-b9123c29-d3ab-4603-8386-85f78c1dc3da service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=11028190-b228-415d-b5ee-2da1d6800073 HTTP/1.1" status: 200  len: 1001 time: 0.1847615
May 20 04:28:17.127081 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvr_db [None req-a2245e9a-ec5e-4eab-b16f-dc7c5525977c None None] Set router a7f66c4d-6b4f-4053-bd69-e1bea7db4c61 gateway port host: dv-cinder-790910-4-iscsi {{(pid=91689) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:28:17.164427 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed0d6d15-f534-43d2-b166-ee24535e667e None None] Pushing event updated for resources: {'Port': ['ID=969bcd0d-d995-4cb6-b639-71f740b78b63,revision_number=2']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:28:17.176897 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2ace91f-cb97-4a5d-9b45-c95ed3fe1871 req-36145914-0d18-4501-83b5-aafcf1b648f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:28:17.178401 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-b152f7ce-d3c2-45db-9896-bf7e7a9a2806 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:17.178564 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-d2ace91f-cb97-4a5d-9b45-c95ed3fe1871 req-36145914-0d18-4501-83b5-aafcf1b648f0 service neutron] 10.222.0.82 "GET /v2.0/subnets?id=e905ed23-00d1-4991-b3bb-e1a1e32b4c86 HTTP/1.1" status: 200  len: 854 time: 0.1031518
May 20 04:28:17.184817 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-ed0d6d15-f534-43d2-b166-ee24535e667e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.253s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:28:17.218103 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning complete for port 866cc6c0-5986-4eb4-8827-b255811a13de triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:28:17.218597 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:17.223872 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-b152f7ce-d3c2-45db-9896-bf7e7a9a2806 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8782892106231', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2145052'] for port, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:17.229512 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:28:17.297194 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b152f7ce-d3c2-45db-9896-bf7e7a9a2806 admin admin] Network aec557db-0c02-4008-8c9f-2efcd7462f90 is already hosted by enough agents. {{(pid=91686) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:28:17.300691 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.base_scheduler [None req-b152f7ce-d3c2-45db-9896-bf7e7a9a2806 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91686) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:28:17.305368 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b152f7ce-d3c2-45db-9896-bf7e7a9a2806 admin admin] Received port after_create {{(pid=91686) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 04:28:17.322031 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2ace91f-cb97-4a5d-9b45-c95ed3fe1871 req-b6751bed-9335-4587-b163-f501663aebac service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:28:17.323957 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-d2ace91f-cb97-4a5d-9b45-c95ed3fe1871 req-b6751bed-9335-4587-b163-f501663aebac service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=fdf92998-25fa-4179-ab1b-131af0ce059a&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1379383
May 20 04:28:17.494429 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b152f7ce-d3c2-45db-9896-bf7e7a9a2806 admin admin] Pushing event updated for resources: {'Port': ['ID=f752de37-e83f-4b51-b1d4-6eceabcfd969,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:28:17.498092 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-b152f7ce-d3c2-45db-9896-bf7e7a9a2806 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.269s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:28:17.602600 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-d2ace91f-cb97-4a5d-9b45-c95ed3fe1871 req-0a517c90-08e1-4f13-a004-b615cc9953b8 service neutron] 10.222.0.82 "GET /v2.0/networks/fdf92998-25fa-4179-ab1b-131af0ce059a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2712915
May 20 04:28:17.719832 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6cb0e811-b9be-4d77-a7f7-8b8662bf7cc8 req-ef95d95d-612a-4834-9c41-090e77641928 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:28:17.721409 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-6cb0e811-b9be-4d77-a7f7-8b8662bf7cc8 req-ef95d95d-612a-4834-9c41-090e77641928 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 984 time: 0.2109311
May 20 04:28:17.774639 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-d2ace91f-cb97-4a5d-9b45-c95ed3fe1871 req-d8030fea-4f8d-485e-9d13-070c3e01c9ef service neutron] 10.222.0.82 "GET /v2.0/networks/fdf92998-25fa-4179-ab1b-131af0ce059a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1579542
May 20 04:28:17.825999 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-a2245e9a-ec5e-4eab-b16f-dc7c5525977c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced19f6820>, [{'id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'name': 'tempest-TestVolumeBootPattern-857163320-router', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.91'}], 'enable_snat': True}, 'gw_port_id': '866cc6c0-5986-4eb4-8827-b255811a13de', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:28:09Z', 'updated_at': '2021-05-20T04:28:12Z', 'revision_number': 4, 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'gw_port': {'id': '866cc6c0-5986-4eb4-8827-b255811a13de', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:f5:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'device_owner': 'network:router_gateway', 'standard_attr_id': 511, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:28:09Z', 'updated_at': '2021-05-20T04:28:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_interfaces': [{'id': '0bcb5c14-319d-4871-bef1-50d60ad3f5b8', 'name': '', 'network_id': '11c994a8-6ede-4290-84f0-71af466860db', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'mac_address': 'fa:16:3e:2c:84:48', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'device_owner': 'network:router_interface', 'standard_attr_id': 512, 'fixed_ips': [{'subnet_id': '51af45f1-449a-400c-8714-8d713d4a7993', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:28:12Z', 'updated_at': '2021-05-20T04:28:16Z', 'revision_number': 4, 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'subnets': [{'id': '51af45f1-449a-400c-8714-8d713d4a7993', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:28:17.857303 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a2245e9a-ec5e-4eab-b16f-dc7c5525977c None None] The sync data for ids ['a7f66c4d-6b4f-4053-bd69-e1bea7db4c61'] in dv-cinder-790910-4-iscsi is: [{'id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'name': 'tempest-TestVolumeBootPattern-857163320-router', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.91'}], 'enable_snat': True}, 'gw_port_id': '866cc6c0-5986-4eb4-8827-b255811a13de', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:28:09Z', 'updated_at': '2021-05-20T04:28:12Z', 'revision_number': 4, 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'gw_port': {'id': '866cc6c0-5986-4eb4-8827-b255811a13de', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:f5:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'device_owner': 'network:router_gateway', 'standard_attr_id': 511, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:28:09Z', 'updated_at': '2021-05-20T04:28:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_interfaces': [{'id': '0bcb5c14-319d-4871-bef1-50d60ad3f5b8', 'name': '', 'network_id': '11c994a8-6ede-4290-84f0-71af466860db', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'mac_address': 'fa:16:3e:2c:84:48', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'device_owner': 'network:router_interface', 'standard_attr_id': 512, 'fixed_ips': [{'subnet_id': '51af45f1-449a-400c-8714-8d713d4a7993', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:28:12Z', 'updated_at': '2021-05-20T04:28:16Z', 'revision_number': 4, 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'subnets': [{'id': '51af45f1-449a-400c-8714-8d713d4a7993', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91689) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 04:28:17.865781 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-6cb0e811-b9be-4d77-a7f7-8b8662bf7cc8 req-9dfce5bd-ec82-437e-b4ab-d8aa9684d40c tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=84c434c2-401c-4319-a0ff-8ceaf7cae545&id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0905201
May 20 04:28:18.007681 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-b152f7ce-d3c2-45db-9896-bf7e7a9a2806 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:18.462973 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-b152f7ce-d3c2-45db-9896-bf7e7a9a2806 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1796474', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1714058'] for router, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:18.501118 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d3006309-6b82-47cf-a65c-3f36a559b9dc None None] Network 797bc43b-d3f0-4cce-ab72-4d9b7d99a5cc requested from dv-cinder-790910-4-iscsi {{(pid=91688) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 04:28:18.626470 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-e646fa59-a5db-4b9f-a6cc-5df1d03b2ac1 None None] Provisioning for port 969bcd0d-d995-4cb6-b639-71f740b78b63 completed by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:28:18.905117 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b152f7ce-d3c2-45db-9896-bf7e7a9a2806 admin admin] Router d81a9efa-906c-4032-994a-82447e195ad4 is scheduled to L3 agent 02733fc0-fc9c-4e29-bc03-c27a792d539d with binding_index 1 {{(pid=91686) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 20 04:28:19.089650 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 0bcb5c14-319d-4871-bef1-50d60ad3f5b8 up at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:28:19.178399 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning for port 0bcb5c14-319d-4871-bef1-50d60ad3f5b8 completed by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:28:19.185939 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning complete for port 0bcb5c14-319d-4871-bef1-50d60ad3f5b8 triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:28:19.186560 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:19.190613 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87910c50-e26b-4d9b-b071-04eeb1a05e2b req-a489a99c-3fae-4116-8c5d-2405ddccf3ca tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:28:19.198073 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-87910c50-e26b-4d9b-b071-04eeb1a05e2b req-a489a99c-3fae-4116-8c5d-2405ddccf3ca tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 984 time: 0.1361091
May 20 04:28:19.200269 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b152f7ce-d3c2-45db-9896-bf7e7a9a2806 admin admin] Notify agent at l3_agent.dv-cinder-790910-4-iscsi the message routers_updated {{(pid=91686) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 04:28:19.244376 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-49ba615d-dfd5-4088-b2de-a8d2aee8a10f None None] Sync routers for ids ['d81a9efa-906c-4032-994a-82447e195ad4'] in dv-cinder-790910-4-iscsi {{(pid=91688) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 04:28:19.247388 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-b152f7ce-d3c2-45db-9896-bf7e7a9a2806 admin admin] Notify callbacks [] for router, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:19.250381 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-b152f7ce-d3c2-45db-9896-bf7e7a9a2806 admin admin] 10.222.0.71 "POST /v2.0/routers HTTP/1.1" status: 201  len: 923 time: 3.4795861
May 20 04:28:19.252874 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 43946) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:28:19.261963 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-87910c50-e26b-4d9b-b071-04eeb1a05e2b req-c13a61ca-780f-45eb-9449-77bad91508d3 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=84c434c2-401c-4319-a0ff-8ceaf7cae545&id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0623908
May 20 04:28:19.299367 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-49ba615d-dfd5-4088-b2de-a8d2aee8a10f None None] Routers {'d81a9efa-906c-4032-994a-82447e195ad4'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91688) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:28:19.300080 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-49ba615d-dfd5-4088-b2de-a8d2aee8a10f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced189e6d0>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:28:03Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['d81a9efa-906c-4032-994a-82447e195ad4'], 'active': True} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:28:19.588983 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:19.599300 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvr_db [None req-49ba615d-dfd5-4088-b2de-a8d2aee8a10f None None] Set router d81a9efa-906c-4032-994a-82447e195ad4 gateway port host: dv-cinder-790910-4-iscsi {{(pid=91688) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:28:19.817599 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] For port 0bcb5c14-319d-4871-bef1-50d60ad3f5b8, host dv-cinder-790910-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=0bcb5c14-319d-4871-bef1-50d60ad3f5b8,segment=NetworkSegment(e9f32492-7a41-4dc9-bc94-b8bce4a8e65d),segment_id=e9f32492-7a41-4dc9-bc94-b8bce4a8e65d)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:28:19.823542 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:19.824446 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 969bcd0d-d995-4cb6-b639-71f740b78b63 up at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:28:19.849974 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:28:20.007125 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Pushing event updated for resources: {'Port': ['ID=0bcb5c14-319d-4871-bef1-50d60ad3f5b8,revision_number=5']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:28:20.012441 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.163s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:28:20.020769 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning for port 969bcd0d-d995-4cb6-b639-71f740b78b63 completed by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:28:20.029214 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning complete for port 969bcd0d-d995-4cb6-b639-71f740b78b63 triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:28:20.030284 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:20.107144 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-49ba615d-dfd5-4088-b2de-a8d2aee8a10f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced189e6d0>, [{'id': 'd81a9efa-906c-4032-994a-82447e195ad4', 'name': 'tempest-TestVolumeBootPattern-1348979754-router', 'tenant_id': '9cdc6335963a47e384b2530ced2a9b80', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.85'}], 'enable_snat': True}, 'gw_port_id': 'f752de37-e83f-4b51-b1d4-6eceabcfd969', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:28:15Z', 'updated_at': '2021-05-20T04:28:17Z', 'revision_number': 3, 'project_id': '9cdc6335963a47e384b2530ced2a9b80', 'gw_port': {'id': 'f752de37-e83f-4b51-b1d4-6eceabcfd969', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:ce:8c:eb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd81a9efa-906c-4032-994a-82447e195ad4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 523, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.85', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:28:16Z', 'updated_at': '2021-05-20T04:28:16Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi'}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:28:20.115500 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-49ba615d-dfd5-4088-b2de-a8d2aee8a10f None None] Checking router: d81a9efa-906c-4032-994a-82447e195ad4 for host: dv-cinder-790910-4-iscsi {{(pid=91688) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 04:28:20.115859 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-49ba615d-dfd5-4088-b2de-a8d2aee8a10f None None] Updating router d81a9efa-906c-4032-994a-82447e195ad4 port f752de37-e83f-4b51-b1d4-6eceabcfd969 binding host dv-cinder-790910-4-iscsi {{(pid=91688) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 20 04:28:20.216412 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-2016da6e-91f2-4a78-b1e7-2ec273ca939f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:20.218564 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-49ba615d-dfd5-4088-b2de-a8d2aee8a10f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:20.268439 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:20.364139 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] For port 969bcd0d-d995-4cb6-b639-71f740b78b63, host dv-cinder-790910-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=969bcd0d-d995-4cb6-b639-71f740b78b63,segment=NetworkSegment(400d6b98-7e80-413b-b776-1d2e09a33a2f),segment_id=400d6b98-7e80-413b-b776-1d2e09a33a2f)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:28:20.371924 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:20.376457 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-ed0d6d15-f534-43d2-b166-ee24535e667e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:28:20.472185 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69e87a42-a2eb-414a-b2b5-3472433dd6d5 req-967ea68f-c5d7-4806-9460-ae7a2853c5cc tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:28:20.474102 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-69e87a42-a2eb-414a-b2b5-3472433dd6d5 req-967ea68f-c5d7-4806-9460-ae7a2853c5cc tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 984 time: 0.0907221
May 20 04:28:20.481567 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.db_base_plugin_common [None req-2016da6e-91f2-4a78-b1e7-2ec273ca939f admin admin] Allocated IP 172.20.0.1 (797bc43b-d3f0-4cce-ab72-4d9b7d99a5cc/b84834e7-a1f8-44f0-aa94-dda7f575d2e7/625c64ac-ab07-4497-be90-0c20245577b2) {{(pid=91687) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 04:28:20.526728 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-69e87a42-a2eb-414a-b2b5-3472433dd6d5 req-8bfaac14-3675-4f68-81db-90c497b6ac58 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=84c434c2-401c-4319-a0ff-8ceaf7cae545&id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0449178
May 20 04:28:20.577923 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Pushing event updated for resources: {'Port': ['ID=969bcd0d-d995-4cb6-b639-71f740b78b63,revision_number=3']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:28:20.582897 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.206s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:28:20.644808 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-2016da6e-91f2-4a78-b1e7-2ec273ca939f admin admin] Notify callbacks [] for port, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:20.662319 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.provisioning_blocks [None req-2016da6e-91f2-4a78-b1e7-2ec273ca939f admin admin] Transition to ACTIVE for port object 625c64ac-ab07-4497-be90-0c20245577b2 will not be triggered until provisioned by entity DHCP. {{(pid=91687) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:28:20.690131 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-2016da6e-91f2-4a78-b1e7-2ec273ca939f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8782892106231', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4162192'] for port, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:20.694996 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-c0156b01-0148-4c1f-ad43-d822d570b2bd tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:28:20.700859 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-49ba615d-dfd5-4088-b2de-a8d2aee8a10f None None] Notify callbacks [] for port, precommit_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:20.715008 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-49ba615d-dfd5-4088-b2de-a8d2aee8a10f None None] Transition to ACTIVE for port object f752de37-e83f-4b51-b1d4-6eceabcfd969 will not be triggered until provisioned by entity L2. {{(pid=91688) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:28:20.722961 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-49ba615d-dfd5-4088-b2de-a8d2aee8a10f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:20.726785 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-ed0d6d15-f534-43d2-b166-ee24535e667e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:28:20.760250 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2016da6e-91f2-4a78-b1e7-2ec273ca939f admin admin] Network 797bc43b-d3f0-4cce-ab72-4d9b7d99a5cc is already hosted by enough agents. {{(pid=91687) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:28:20.763478 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.base_scheduler [None req-2016da6e-91f2-4a78-b1e7-2ec273ca939f admin admin] Resources bound (agent type, host, resource id):  {{(pid=91687) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:28:20.767391 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2016da6e-91f2-4a78-b1e7-2ec273ca939f admin admin] Received port after_create {{(pid=91687) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 04:28:20.803277 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2016da6e-91f2-4a78-b1e7-2ec273ca939f admin admin] Pushing event updated for resources: {'Port': ['ID=625c64ac-ab07-4497-be90-0c20245577b2,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:28:20.807680 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-2016da6e-91f2-4a78-b1e7-2ec273ca939f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:28:20.822974 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df1ec6ec-42ca-4cbb-9e00-7da8c44f9851 None None] Pushing event updated for resources: {'Port': ['ID=f752de37-e83f-4b51-b1d4-6eceabcfd969,revision_number=2']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:28:20.828059 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-2016da6e-91f2-4a78-b1e7-2ec273ca939f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1716281'] for router_interface, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:20.829897 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-df1ec6ec-42ca-4cbb-9e00-7da8c44f9851 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:28:20.831605 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.managers [None req-49ba615d-dfd5-4088-b2de-a8d2aee8a10f None None] Attempting to bind port f752de37-e83f-4b51-b1d4-6eceabcfd969 on host dv-cinder-790910-4-iscsi for vnic_type normal with profile  {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 04:28:20.832010 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.managers [None req-49ba615d-dfd5-4088-b2de-a8d2aee8a10f None None] Attempting to bind port f752de37-e83f-4b51-b1d4-6eceabcfd969 by drivers openvswitch,hyperv on host dv-cinder-790910-4-iscsi at level 0 using segments [{'id': '8df49ec5-3fb9-4715-bc9a-f4019a6b55f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90'}] {{(pid=91688) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 04:28:20.833123 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-49ba615d-dfd5-4088-b2de-a8d2aee8a10f None None] Attempting to bind port f752de37-e83f-4b51-b1d4-6eceabcfd969 on network aec557db-0c02-4008-8c9f-2efcd7462f90 {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:28:20.845358 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-49ba615d-dfd5-4088-b2de-a8d2aee8a10f None None] Checking agent: {'id': '333121d4-1023-4a33-a54c-f4dd052e1612', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-790910-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 4, 13, 33), 'started_at': datetime.datetime(2021, 5, 20, 4, 14, 3), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 4, 28, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-790910-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 04:28:20.846002 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-49ba615d-dfd5-4088-b2de-a8d2aee8a10f None None] Checking segment: {'id': '8df49ec5-3fb9-4715-bc9a-f4019a6b55f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91688) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:28:20.846686 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-49ba615d-dfd5-4088-b2de-a8d2aee8a10f None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:20.847360 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-49ba615d-dfd5-4088-b2de-a8d2aee8a10f None None] Bound using segment: {'id': '8df49ec5-3fb9-4715-bc9a-f4019a6b55f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90'} {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 04:28:20.849025 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.managers [None req-49ba615d-dfd5-4088-b2de-a8d2aee8a10f None None] Bound port: f752de37-e83f-4b51-b1d4-6eceabcfd969, host: dv-cinder-790910-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8df49ec5-3fb9-4715-bc9a-f4019a6b55f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90'}}] {{(pid=91688) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 04:28:20.849885 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-49ba615d-dfd5-4088-b2de-a8d2aee8a10f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:20.952567 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-49ba615d-dfd5-4088-b2de-a8d2aee8a10f None None] For port f752de37-e83f-4b51-b1d4-6eceabcfd969, host dv-cinder-790910-4-iscsi, cleared binding levels {{(pid=91688) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 04:28:20.956814 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-49ba615d-dfd5-4088-b2de-a8d2aee8a10f None None] For port f752de37-e83f-4b51-b1d4-6eceabcfd969, host dv-cinder-790910-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=f752de37-e83f-4b51-b1d4-6eceabcfd969,segment=NetworkSegment(8df49ec5-3fb9-4715-bc9a-f4019a6b55f9),segment_id=8df49ec5-3fb9-4715-bc9a-f4019a6b55f9)] {{(pid=91688) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 04:28:20.963103 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-49ba615d-dfd5-4088-b2de-a8d2aee8a10f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:20.971078 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:28:20.978672 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-2016da6e-91f2-4a78-b1e7-2ec273ca939f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:21.018263 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 0bcb5c14-319d-4871-bef1-50d60ad3f5b8 up at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:28:21.119395 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-49ba615d-dfd5-4088-b2de-a8d2aee8a10f None None] Routers {'d81a9efa-906c-4032-994a-82447e195ad4'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91688) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:28:21.120022 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-49ba615d-dfd5-4088-b2de-a8d2aee8a10f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced189e6d0>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:28:03Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['d81a9efa-906c-4032-994a-82447e195ad4'], 'active': True} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:28:21.170882 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df1ec6ec-42ca-4cbb-9e00-7da8c44f9851 None None] Pushing event updated for resources: {'Port': ['ID=f752de37-e83f-4b51-b1d4-6eceabcfd969,revision_number=3']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:28:21.180816 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-df1ec6ec-42ca-4cbb-9e00-7da8c44f9851 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.210s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:28:21.206099 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-0f1c3ecf-9cbd-432e-a309-aeeece926488 None None] Provisioning for port 625c64ac-ab07-4497-be90-0c20245577b2 completed by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:28:21.222936 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-0f1c3ecf-9cbd-432e-a309-aeeece926488 None None] Provisioning complete for port 625c64ac-ab07-4497-be90-0c20245577b2 triggered by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:28:21.223309 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-0f1c3ecf-9cbd-432e-a309-aeeece926488 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:21.226818 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-2016da6e-91f2-4a78-b1e7-2ec273ca939f admin admin] Notify callbacks [] for port, precommit_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:21.231905 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-2016da6e-91f2-4a78-b1e7-2ec273ca939f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4162185'] for port, after_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:21.255386 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning complete for port 0bcb5c14-319d-4871-bef1-50d60ad3f5b8 triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:28:21.255767 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:21.262915 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-0be9b540-e823-4bf9-8211-4435cf51cab5 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:28:21.344874 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-2016da6e-91f2-4a78-b1e7-2ec273ca939f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1781412', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1716318'] for router_interface, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:21.348788 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2016da6e-91f2-4a78-b1e7-2ec273ca939f admin admin] Pushing event updated for resources: {'Port': ['ID=625c64ac-ab07-4497-be90-0c20245577b2,revision_number=2']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:28:21.353402 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-2016da6e-91f2-4a78-b1e7-2ec273ca939f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:28:21.411460 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-0f1c3ecf-9cbd-432e-a309-aeeece926488 None None] Port 625c64ac-ab07-4497-be90-0c20245577b2 cannot update to ACTIVE because it is not bound. {{(pid=91688) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 20 04:28:21.425022 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvr_db [None req-49ba615d-dfd5-4088-b2de-a8d2aee8a10f None None] Set router d81a9efa-906c-4032-994a-82447e195ad4 gateway port host: dv-cinder-790910-4-iscsi {{(pid=91688) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:28:21.521711 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2016da6e-91f2-4a78-b1e7-2ec273ca939f admin admin] Network 797bc43b-d3f0-4cce-ab72-4d9b7d99a5cc is already hosted by enough agents. {{(pid=91687) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:28:21.523640 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.base_scheduler [None req-2016da6e-91f2-4a78-b1e7-2ec273ca939f admin admin] Resources bound (agent type, host, resource id):  {{(pid=91687) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:28:21.689906 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 969bcd0d-d995-4cb6-b639-71f740b78b63 up at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:28:21.800115 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2016da6e-91f2-4a78-b1e7-2ec273ca939f admin admin] Router d81a9efa-906c-4032-994a-82447e195ad4 has already been hosted by L3 agent 02733fc0-fc9c-4e29-bc03-c27a792d539d {{(pid=91687) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 04:28:21.886842 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-12e2536d-d0b8-4983-af5a-c6ea741b3340 None None] Provisioning complete for port 625c64ac-ab07-4497-be90-0c20245577b2 triggered by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:28:21.887733 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-12e2536d-d0b8-4983-af5a-c6ea741b3340 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:21.912058 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning complete for port 969bcd0d-d995-4cb6-b639-71f740b78b63 triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:28:21.912058 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:21.993672 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f571f41d-472d-40c3-a1d2-df1212875be9 req-65529bbf-0e8a-48de-b8bd-bbd6dab0877f tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:28:21.998287 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-f571f41d-472d-40c3-a1d2-df1212875be9 req-65529bbf-0e8a-48de-b8bd-bbd6dab0877f tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 984 time: 0.2764516
May 20 04:28:22.002101 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-12e2536d-d0b8-4983-af5a-c6ea741b3340 None None] Port 625c64ac-ab07-4497-be90-0c20245577b2 cannot update to ACTIVE because it is not bound. {{(pid=91688) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 20 04:28:22.057162 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-49ba615d-dfd5-4088-b2de-a8d2aee8a10f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced189e6d0>, [{'id': 'd81a9efa-906c-4032-994a-82447e195ad4', 'name': 'tempest-TestVolumeBootPattern-1348979754-router', 'tenant_id': '9cdc6335963a47e384b2530ced2a9b80', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.85'}], 'enable_snat': True}, 'gw_port_id': 'f752de37-e83f-4b51-b1d4-6eceabcfd969', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:28:15Z', 'updated_at': '2021-05-20T04:28:20Z', 'revision_number': 4, 'project_id': '9cdc6335963a47e384b2530ced2a9b80', 'gw_port': {'id': 'f752de37-e83f-4b51-b1d4-6eceabcfd969', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:ce:8c:eb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd81a9efa-906c-4032-994a-82447e195ad4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 523, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.85', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:28:16Z', 'updated_at': '2021-05-20T04:28:20Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_interfaces': [{'id': '625c64ac-ab07-4497-be90-0c20245577b2', 'name': '', 'network_id': '797bc43b-d3f0-4cce-ab72-4d9b7d99a5cc', 'tenant_id': '9cdc6335963a47e384b2530ced2a9b80', 'mac_address': 'fa:16:3e:8b:b8:5f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd81a9efa-906c-4032-994a-82447e195ad4', 'device_owner': 'network:router_interface', 'standard_attr_id': 524, 'fixed_ips': [{'subnet_id': 'b84834e7-a1f8-44f0-aa94-dda7f575d2e7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:28:20Z', 'updated_at': '2021-05-20T04:28:20Z', 'revision_number': 1, 'project_id': '9cdc6335963a47e384b2530ced2a9b80', 'subnets': [{'id': 'b84834e7-a1f8-44f0-aa94-dda7f575d2e7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:28:22.078598 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-49ba615d-dfd5-4088-b2de-a8d2aee8a10f None None] The sync data for ids ['d81a9efa-906c-4032-994a-82447e195ad4'] in dv-cinder-790910-4-iscsi is: [{'id': 'd81a9efa-906c-4032-994a-82447e195ad4', 'name': 'tempest-TestVolumeBootPattern-1348979754-router', 'tenant_id': '9cdc6335963a47e384b2530ced2a9b80', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.85'}], 'enable_snat': True}, 'gw_port_id': 'f752de37-e83f-4b51-b1d4-6eceabcfd969', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:28:15Z', 'updated_at': '2021-05-20T04:28:20Z', 'revision_number': 4, 'project_id': '9cdc6335963a47e384b2530ced2a9b80', 'gw_port': {'id': 'f752de37-e83f-4b51-b1d4-6eceabcfd969', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:ce:8c:eb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd81a9efa-906c-4032-994a-82447e195ad4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 523, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.85', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:28:16Z', 'updated_at': '2021-05-20T04:28:20Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_interfaces': [{'id': '625c64ac-ab07-4497-be90-0c20245577b2', 'name': '', 'network_id': '797bc43b-d3f0-4cce-ab72-4d9b7d99a5cc', 'tenant_id': '9cdc6335963a47e384b2530ced2a9b80', 'mac_address': 'fa:16:3e:8b:b8:5f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd81a9efa-906c-4032-994a-82447e195ad4', 'device_owner': 'network:router_interface', 'standard_attr_id': 524, 'fixed_ips': [{'subnet_id': 'b84834e7-a1f8-44f0-aa94-dda7f575d2e7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:28:20Z', 'updated_at': '2021-05-20T04:28:20Z', 'revision_number': 1, 'project_id': '9cdc6335963a47e384b2530ced2a9b80', 'subnets': [{'id': 'b84834e7-a1f8-44f0-aa94-dda7f575d2e7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91688) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 04:28:22.128729 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-f571f41d-472d-40c3-a1d2-df1212875be9 req-4b50b553-139f-411b-9213-425e29899bec tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=84c434c2-401c-4319-a0ff-8ceaf7cae545&id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.1265161
May 20 04:28:22.154570 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2016da6e-91f2-4a78-b1e7-2ec273ca939f admin admin] Notify agent at l3_agent.dv-cinder-790910-4-iscsi the message routers_updated {{(pid=91687) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 04:28:22.167515 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-2016da6e-91f2-4a78-b1e7-2ec273ca939f admin admin] 10.222.0.71 "PUT /v2.0/routers/d81a9efa-906c-4032-994a-82447e195ad4/add_router_interface HTTP/1.1" status: 200  len: 503 time: 2.9133308
May 20 04:28:22.964294 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 43972) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:28:22.969866 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [None req-0ba8177e-aecb-4f86-9859-12c3ee5a556b tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1603607005', 'description': 'tempest-secgroup-smoke-1603607005 description', 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc'}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:28:22.976199 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-0ba8177e-aecb-4f86-9859-12c3ee5a556b tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:28:22.982459 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-0ba8177e-aecb-4f86-9859-12c3ee5a556b tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Usage tracker for resource:security_group and tenant:9b6fb271a7a546a38b0c6df5beaf22fc is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:28:22.988472 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-0ba8177e-aecb-4f86-9859-12c3ee5a556b tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:28:22.992114 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device f752de37-e83f-4b51-b1d4-6eceabcfd969 up at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:28:22.998475 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-0ba8177e-aecb-4f86-9859-12c3ee5a556b tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:28:23.011774 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-0ba8177e-aecb-4f86-9859-12c3ee5a556b tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks [] for security_group, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:23.042885 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-0ba8177e-aecb-4f86-9859-12c3ee5a556b tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:28:23.049293 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-0ba8177e-aecb-4f86-9859-12c3ee5a556b tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Usage tracker for resource:security_group_rule and tenant:9b6fb271a7a546a38b0c6df5beaf22fc is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:28:23.053489 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-0ba8177e-aecb-4f86-9859-12c3ee5a556b tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:28:23.061486 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-0ba8177e-aecb-4f86-9859-12c3ee5a556b tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:28:23.146884 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning for port f752de37-e83f-4b51-b1d4-6eceabcfd969 completed by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:28:23.151079 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-0ba8177e-aecb-4f86-9859-12c3ee5a556b tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks [] for security_group, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:23.154343 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning complete for port f752de37-e83f-4b51-b1d4-6eceabcfd969 triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:28:23.154767 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:23.157980 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-0ba8177e-aecb-4f86-9859-12c3ee5a556b tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:23.195777 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-3ed7f35d-851e-473e-95c6-6ba70a90947e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:28:23.215517 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-0ba8177e-aecb-4f86-9859-12c3ee5a556b tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks [] for security_group, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:23.216530 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-0ba8177e-aecb-4f86-9859-12c3ee5a556b tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1794 time: 0.2511938
May 20 04:28:23.220233 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 43984) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:28:23.226975 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.v2.base [None req-6940b659-4bcd-4f1c-8706-c9f1020a6821 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Request body: {'security_group_rule': {'security_group_id': 'ef28d688-789b-4282-a30c-d7d731615fbf', 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=91686) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:28:23.242929 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-6940b659-4bcd-4f1c-8706-c9f1020a6821 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:28:23.251922 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-6940b659-4bcd-4f1c-8706-c9f1020a6821 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Usage tracker for resource:security_group_rule and tenant:9b6fb271a7a546a38b0c6df5beaf22fc is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:28:23.255895 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ba8177e-aecb-4f86-9859-12c3ee5a556b tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Pushing event updated for resources: {'SecurityGroup': ['ID=ef28d688-789b-4282-a30c-d7d731615fbf,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:28:23.265310 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-0ba8177e-aecb-4f86-9859-12c3ee5a556b tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:28:23.270238 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-6940b659-4bcd-4f1c-8706-c9f1020a6821 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:28:23.283502 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-6940b659-4bcd-4f1c-8706-c9f1020a6821 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:28:23.327151 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-6940b659-4bcd-4f1c-8706-c9f1020a6821 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:23.388289 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:23.405259 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2c75fdd-d9db-48da-bf26-f8822c804927 req-42caff7b-714a-43ff-bba8-f4f2c8cd30aa tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:28:23.408396 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-6940b659-4bcd-4f1c-8706-c9f1020a6821 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:23.412854 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-b2c75fdd-d9db-48da-bf26-f8822c804927 req-42caff7b-714a-43ff-bba8-f4f2c8cd30aa tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 984 time: 0.1174405
May 20 04:28:23.414210 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-6940b659-4bcd-4f1c-8706-c9f1020a6821 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1597377'] for security_group_rule, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:23.417824 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:28:23.442653 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] For port f752de37-e83f-4b51-b1d4-6eceabcfd969, host dv-cinder-790910-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=f752de37-e83f-4b51-b1d4-6eceabcfd969,segment=NetworkSegment(8df49ec5-3fb9-4715-bc9a-f4019a6b55f9),segment_id=8df49ec5-3fb9-4715-bc9a-f4019a6b55f9)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:28:23.450078 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:23.455248 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6940b659-4bcd-4f1c-8706-c9f1020a6821 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=bbcccb8f-9b00-4982-a512-19c9af19a6f6,revision_number=0']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:28:23.458476 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-6940b659-4bcd-4f1c-8706-c9f1020a6821 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:28:23.469414 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-df1ec6ec-42ca-4cbb-9e00-7da8c44f9851 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:28:23.471224 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-6940b659-4bcd-4f1c-8706-c9f1020a6821 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:23.472392 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-6940b659-4bcd-4f1c-8706-c9f1020a6821 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.2507946
May 20 04:28:23.475390 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 44000) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:28:23.483026 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.v2.base [None req-cf45c72b-c2ee-4389-92d9-e1fdda6da26d tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Request body: {'security_group_rule': {'security_group_id': 'ef28d688-789b-4282-a30c-d7d731615fbf', 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=91686) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:28:23.491129 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-cf45c72b-c2ee-4389-92d9-e1fdda6da26d tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:28:23.495091 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-b2c75fdd-d9db-48da-bf26-f8822c804927 req-7593393a-3dbe-4fc6-bcc6-303a0a5f6a62 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=84c434c2-401c-4319-a0ff-8ceaf7cae545&id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0809681
May 20 04:28:23.499984 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-cf45c72b-c2ee-4389-92d9-e1fdda6da26d tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Usage tracker for resource:security_group_rule and tenant:9b6fb271a7a546a38b0c6df5beaf22fc is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:28:23.505487 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-cf45c72b-c2ee-4389-92d9-e1fdda6da26d tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:28:23.516127 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-cf45c72b-c2ee-4389-92d9-e1fdda6da26d tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:28:23.548661 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-cf45c72b-c2ee-4389-92d9-e1fdda6da26d tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:23.619315 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Pushing event updated for resources: {'Port': ['ID=f752de37-e83f-4b51-b1d4-6eceabcfd969,revision_number=4']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:28:23.627757 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.158s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:28:23.649746 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-cf45c72b-c2ee-4389-92d9-e1fdda6da26d tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:23.655058 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-cf45c72b-c2ee-4389-92d9-e1fdda6da26d tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1597377'] for security_group_rule, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:23.657750 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-cb32a7e1-35bf-4208-aee3-474378517bbd tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:28:23.681181 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf45c72b-c2ee-4389-92d9-e1fdda6da26d tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9681feda-b2dd-4767-b5b3-6e1a948bd7d3,revision_number=0']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:28:23.690850 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-cf45c72b-c2ee-4389-92d9-e1fdda6da26d tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:28:23.700448 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-cf45c72b-c2ee-4389-92d9-e1fdda6da26d tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:23.702152 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-cf45c72b-c2ee-4389-92d9-e1fdda6da26d tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 763 time: 0.2251766
May 20 04:28:23.705442 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 44010) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:28:23.711592 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.v2.base [None req-9d702d67-45fd-4793-bc5a-618f825a3063 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Request body: {'security_group_rule': {'security_group_id': 'ef28d688-789b-4282-a30c-d7d731615fbf', 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=91686) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:28:23.718847 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-9d702d67-45fd-4793-bc5a-618f825a3063 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:28:23.723332 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-9d702d67-45fd-4793-bc5a-618f825a3063 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Usage tracker for resource:security_group_rule and tenant:9b6fb271a7a546a38b0c6df5beaf22fc is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:28:23.726514 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-9d702d67-45fd-4793-bc5a-618f825a3063 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:28:23.734226 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-9d702d67-45fd-4793-bc5a-618f825a3063 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:28:23.760449 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-9d702d67-45fd-4793-bc5a-618f825a3063 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:23.851093 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-9d702d67-45fd-4793-bc5a-618f825a3063 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:23.855990 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-9d702d67-45fd-4793-bc5a-618f825a3063 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1597377'] for security_group_rule, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:23.858190 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-3939627d-33d1-4c53-a8b6-ab8a6101c0aa tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:28:23.883190 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d702d67-45fd-4793-bc5a-618f825a3063 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6e15c2b4-4df7-4280-8957-9e6d073249ba,revision_number=0']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:28:23.886008 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-9d702d67-45fd-4793-bc5a-618f825a3063 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:28:23.897372 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-9d702d67-45fd-4793-bc5a-618f825a3063 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:23.899138 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-9d702d67-45fd-4793-bc5a-618f825a3063 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.1920455
May 20 04:28:23.902218 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 44018) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:28:23.908017 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [None req-c573c883-0751-455a-8bfc-61a972816022 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Request body: {'security_group_rule': {'security_group_id': 'ef28d688-789b-4282-a30c-d7d731615fbf', 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:28:23.914548 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-c573c883-0751-455a-8bfc-61a972816022 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:28:23.919469 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-c573c883-0751-455a-8bfc-61a972816022 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Usage tracker for resource:security_group_rule and tenant:9b6fb271a7a546a38b0c6df5beaf22fc is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:28:23.922947 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-c573c883-0751-455a-8bfc-61a972816022 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:28:23.930088 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-c573c883-0751-455a-8bfc-61a972816022 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:28:23.949278 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-c573c883-0751-455a-8bfc-61a972816022 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:24.016143 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-c573c883-0751-455a-8bfc-61a972816022 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:24.021463 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-c573c883-0751-455a-8bfc-61a972816022 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1597377'] for security_group_rule, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:24.023587 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-825462b7-d089-4c45-aeac-b0ab8c3bae66 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:28:24.047163 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c573c883-0751-455a-8bfc-61a972816022 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=90acf3d5-582a-4d19-b9f1-c37416b596e9,revision_number=0']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:28:24.049858 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-c573c883-0751-455a-8bfc-61a972816022 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:28:24.059107 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-c573c883-0751-455a-8bfc-61a972816022 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:24.060565 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-c573c883-0751-455a-8bfc-61a972816022 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 768 time: 0.1572495
May 20 04:28:24.063420 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 44022) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:28:24.069201 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [None req-5ed911f5-a287-4141-bf24-5c6cbf510d7c tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Request body: {'security_group_rule': {'security_group_id': 'ef28d688-789b-4282-a30c-d7d731615fbf', 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:28:24.076422 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-5ed911f5-a287-4141-bf24-5c6cbf510d7c tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:28:24.080561 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-5ed911f5-a287-4141-bf24-5c6cbf510d7c tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Usage tracker for resource:security_group_rule and tenant:9b6fb271a7a546a38b0c6df5beaf22fc is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:28:24.083709 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-5ed911f5-a287-4141-bf24-5c6cbf510d7c tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:28:24.089711 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-5ed911f5-a287-4141-bf24-5c6cbf510d7c tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:28:24.101685 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.db.securitygroups_db [None req-5ed911f5-a287-4141-bf24-5c6cbf510d7c tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Project 9b6fb271a7a546a38b0c6df5beaf22fc added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
May 20 04:28:24.107778 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-5ed911f5-a287-4141-bf24-5c6cbf510d7c tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:24.183706 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-5ed911f5-a287-4141-bf24-5c6cbf510d7c tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:24.188553 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-5ed911f5-a287-4141-bf24-5c6cbf510d7c tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1597377'] for security_group_rule, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:24.196215 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-c573c883-0751-455a-8bfc-61a972816022 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:28:24.217973 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ed911f5-a287-4141-bf24-5c6cbf510d7c tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1dd996f3-cd73-454f-b5e7-39bb2d786f5a,revision_number=0']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:28:24.220402 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-5ed911f5-a287-4141-bf24-5c6cbf510d7c tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:28:24.225560 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-5ed911f5-a287-4141-bf24-5c6cbf510d7c tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:24.226744 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-5ed911f5-a287-4141-bf24-5c6cbf510d7c tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 774 time: 0.1622982
May 20 04:28:24.229757 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 44026) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:28:24.235201 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [None req-69ffc8fe-c6de-45e5-9035-77ef0aacf9f6 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Request body: {'security_group_rule': {'security_group_id': 'ef28d688-789b-4282-a30c-d7d731615fbf', 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:28:24.241354 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-69ffc8fe-c6de-45e5-9035-77ef0aacf9f6 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:28:24.245210 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-69ffc8fe-c6de-45e5-9035-77ef0aacf9f6 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Usage tracker for resource:security_group_rule and tenant:9b6fb271a7a546a38b0c6df5beaf22fc is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:28:24.248252 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-69ffc8fe-c6de-45e5-9035-77ef0aacf9f6 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:28:24.254470 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-69ffc8fe-c6de-45e5-9035-77ef0aacf9f6 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:28:24.266746 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.db.securitygroups_db [None req-69ffc8fe-c6de-45e5-9035-77ef0aacf9f6 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Project 9b6fb271a7a546a38b0c6df5beaf22fc added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
May 20 04:28:24.272794 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-69ffc8fe-c6de-45e5-9035-77ef0aacf9f6 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:24.358015 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-69ffc8fe-c6de-45e5-9035-77ef0aacf9f6 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:24.363159 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-69ffc8fe-c6de-45e5-9035-77ef0aacf9f6 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1597377'] for security_group_rule, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:24.369381 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:28:24.388617 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69ffc8fe-c6de-45e5-9035-77ef0aacf9f6 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=68f09093-d55c-4da9-8494-73dabe2578a8,revision_number=0']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:28:24.391373 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-69ffc8fe-c6de-45e5-9035-77ef0aacf9f6 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:28:24.400301 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-69ffc8fe-c6de-45e5-9035-77ef0aacf9f6 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:24.402493 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-69ffc8fe-c6de-45e5-9035-77ef0aacf9f6 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 773 time: 0.1710093
May 20 04:28:24.767505 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45956b4f-2beb-4b6b-8e0f-337e2a1505b9 req-d646f97e-e2a0-4035-88bf-50438100216a tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:28:24.770116 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-45956b4f-2beb-4b6b-8e0f-337e2a1505b9 req-d646f97e-e2a0-4035-88bf-50438100216a tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 984 time: 0.1288304
May 20 04:28:24.851258 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-45956b4f-2beb-4b6b-8e0f-337e2a1505b9 req-5d1bcff2-5d7e-4729-b7b9-985345552a0d tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=84c434c2-401c-4319-a0ff-8ceaf7cae545&id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0740619
May 20 04:28:25.000603 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device f752de37-e83f-4b51-b1d4-6eceabcfd969 up at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:28:25.090343 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning complete for port f752de37-e83f-4b51-b1d4-6eceabcfd969 triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:28:25.090725 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:25.746393 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fa9df0e5-ebbd-4c36-ae43-e02bc4c6a91e None None] Sync routers for ids ['d81a9efa-906c-4032-994a-82447e195ad4'] in dv-cinder-790910-4-iscsi {{(pid=91689) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 04:28:25.759029 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fa9df0e5-ebbd-4c36-ae43-e02bc4c6a91e None None] Routers {'d81a9efa-906c-4032-994a-82447e195ad4'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91689) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:28:25.760058 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-fa9df0e5-ebbd-4c36-ae43-e02bc4c6a91e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced1a6a3a0>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:28:03Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['d81a9efa-906c-4032-994a-82447e195ad4'], 'active': True} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:28:26.009198 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvr_db [None req-fa9df0e5-ebbd-4c36-ae43-e02bc4c6a91e None None] Set router d81a9efa-906c-4032-994a-82447e195ad4 gateway port host: dv-cinder-790910-4-iscsi {{(pid=91689) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:28:26.126500 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a982d86-e0a6-4f96-9289-6f780098a14e req-c5555a7e-6842-4744-a50f-3e7c3db21215 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:28:26.128035 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-2a982d86-e0a6-4f96-9289-6f780098a14e req-c5555a7e-6842-4744-a50f-3e7c3db21215 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 984 time: 0.0891552
May 20 04:28:26.184668 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-2a982d86-e0a6-4f96-9289-6f780098a14e req-3fce3e1a-6ee8-477f-b172-d773eabd16c9 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=84c434c2-401c-4319-a0ff-8ceaf7cae545&id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0462413
May 20 04:28:26.382677 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-fa9df0e5-ebbd-4c36-ae43-e02bc4c6a91e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced1a6a3a0>, [{'id': 'd81a9efa-906c-4032-994a-82447e195ad4', 'name': 'tempest-TestVolumeBootPattern-1348979754-router', 'tenant_id': '9cdc6335963a47e384b2530ced2a9b80', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.85'}], 'enable_snat': True}, 'gw_port_id': 'f752de37-e83f-4b51-b1d4-6eceabcfd969', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:28:15Z', 'updated_at': '2021-05-20T04:28:20Z', 'revision_number': 4, 'project_id': '9cdc6335963a47e384b2530ced2a9b80', 'gw_port': {'id': 'f752de37-e83f-4b51-b1d4-6eceabcfd969', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:ce:8c:eb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd81a9efa-906c-4032-994a-82447e195ad4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 523, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.85', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:28:16Z', 'updated_at': '2021-05-20T04:28:23Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_interfaces': [{'id': '625c64ac-ab07-4497-be90-0c20245577b2', 'name': '', 'network_id': '797bc43b-d3f0-4cce-ab72-4d9b7d99a5cc', 'tenant_id': '9cdc6335963a47e384b2530ced2a9b80', 'mac_address': 'fa:16:3e:8b:b8:5f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd81a9efa-906c-4032-994a-82447e195ad4', 'device_owner': 'network:router_interface', 'standard_attr_id': 524, 'fixed_ips': [{'subnet_id': 'b84834e7-a1f8-44f0-aa94-dda7f575d2e7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:28:20Z', 'updated_at': '2021-05-20T04:28:21Z', 'revision_number': 2, 'project_id': '9cdc6335963a47e384b2530ced2a9b80', 'subnets': [{'id': 'b84834e7-a1f8-44f0-aa94-dda7f575d2e7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:28:26.387674 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fa9df0e5-ebbd-4c36-ae43-e02bc4c6a91e None None] Checking router: d81a9efa-906c-4032-994a-82447e195ad4 for host: dv-cinder-790910-4-iscsi {{(pid=91689) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 04:28:26.388023 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fa9df0e5-ebbd-4c36-ae43-e02bc4c6a91e None None] Updating router d81a9efa-906c-4032-994a-82447e195ad4 port 625c64ac-ab07-4497-be90-0c20245577b2 binding host dv-cinder-790910-4-iscsi {{(pid=91689) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 20 04:28:26.443453 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron_lib.callbacks.manager [None req-fa9df0e5-ebbd-4c36-ae43-e02bc4c6a91e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:26.849658 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron_lib.callbacks.manager [None req-fa9df0e5-ebbd-4c36-ae43-e02bc4c6a91e None None] Notify callbacks [] for port, precommit_update {{(pid=91689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:26.866061 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.provisioning_blocks [None req-fa9df0e5-ebbd-4c36-ae43-e02bc4c6a91e None None] Transition to ACTIVE for port object 625c64ac-ab07-4497-be90-0c20245577b2 will not be triggered until provisioned by entity L2. {{(pid=91689) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:28:26.876015 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron_lib.callbacks.manager [None req-fa9df0e5-ebbd-4c36-ae43-e02bc4c6a91e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:26.880545 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:28:27.006999 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82796729-dd5f-4fab-8f64-08428e159af1 None None] Pushing event updated for resources: {'Port': ['ID=625c64ac-ab07-4497-be90-0c20245577b2,revision_number=3']} {{(pid=91689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:28:27.011686 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG oslo_concurrency.lockutils [None req-82796729-dd5f-4fab-8f64-08428e159af1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.131s {{(pid=91689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:28:27.110609 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.managers [None req-fa9df0e5-ebbd-4c36-ae43-e02bc4c6a91e None None] Attempting to bind port 625c64ac-ab07-4497-be90-0c20245577b2 on host dv-cinder-790910-4-iscsi for vnic_type normal with profile  {{(pid=91689) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 04:28:27.110967 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.managers [None req-fa9df0e5-ebbd-4c36-ae43-e02bc4c6a91e None None] Attempting to bind port 625c64ac-ab07-4497-be90-0c20245577b2 by drivers openvswitch,hyperv on host dv-cinder-790910-4-iscsi at level 0 using segments [{'id': '400d6b98-7e80-413b-b776-1d2e09a33a2f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': '797bc43b-d3f0-4cce-ab72-4d9b7d99a5cc'}] {{(pid=91689) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 04:28:27.111520 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fa9df0e5-ebbd-4c36-ae43-e02bc4c6a91e None None] Attempting to bind port 625c64ac-ab07-4497-be90-0c20245577b2 on network 797bc43b-d3f0-4cce-ab72-4d9b7d99a5cc {{(pid=91689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:28:27.118250 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fa9df0e5-ebbd-4c36-ae43-e02bc4c6a91e None None] Checking agent: {'id': '333121d4-1023-4a33-a54c-f4dd052e1612', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-790910-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 4, 13, 33), 'started_at': datetime.datetime(2021, 5, 20, 4, 14, 3), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 4, 28, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-790910-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 04:28:27.118901 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fa9df0e5-ebbd-4c36-ae43-e02bc4c6a91e None None] Checking segment: {'id': '400d6b98-7e80-413b-b776-1d2e09a33a2f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': '797bc43b-d3f0-4cce-ab72-4d9b7d99a5cc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91689) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:28:27.119379 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron_lib.callbacks.manager [None req-fa9df0e5-ebbd-4c36-ae43-e02bc4c6a91e None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:27.119853 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fa9df0e5-ebbd-4c36-ae43-e02bc4c6a91e None None] Bound using segment: {'id': '400d6b98-7e80-413b-b776-1d2e09a33a2f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': '797bc43b-d3f0-4cce-ab72-4d9b7d99a5cc'} {{(pid=91689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 04:28:27.120462 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.managers [None req-fa9df0e5-ebbd-4c36-ae43-e02bc4c6a91e None None] Bound port: 625c64ac-ab07-4497-be90-0c20245577b2, host: dv-cinder-790910-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '400d6b98-7e80-413b-b776-1d2e09a33a2f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': '797bc43b-d3f0-4cce-ab72-4d9b7d99a5cc'}}] {{(pid=91689) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 04:28:27.120969 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron_lib.callbacks.manager [None req-fa9df0e5-ebbd-4c36-ae43-e02bc4c6a91e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:27.234308 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.db [None req-fa9df0e5-ebbd-4c36-ae43-e02bc4c6a91e None None] For port 625c64ac-ab07-4497-be90-0c20245577b2, host dv-cinder-790910-4-iscsi, cleared binding levels {{(pid=91689) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 04:28:27.238072 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.db [None req-fa9df0e5-ebbd-4c36-ae43-e02bc4c6a91e None None] For port 625c64ac-ab07-4497-be90-0c20245577b2, host dv-cinder-790910-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=625c64ac-ab07-4497-be90-0c20245577b2,segment=NetworkSegment(400d6b98-7e80-413b-b776-1d2e09a33a2f),segment_id=400d6b98-7e80-413b-b776-1d2e09a33a2f)] {{(pid=91689) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 04:28:27.243806 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron_lib.callbacks.manager [None req-fa9df0e5-ebbd-4c36-ae43-e02bc4c6a91e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:27.249791 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG oslo_concurrency.lockutils [None req-11bf997e-acdf-4d42-a7ff-1c2f72a29d58 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:28:27.331357 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82796729-dd5f-4fab-8f64-08428e159af1 None None] Pushing event updated for resources: {'Port': ['ID=625c64ac-ab07-4497-be90-0c20245577b2,revision_number=4']} {{(pid=91689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:28:27.339146 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG oslo_concurrency.lockutils [None req-82796729-dd5f-4fab-8f64-08428e159af1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=91689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:28:27.340293 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fa9df0e5-ebbd-4c36-ae43-e02bc4c6a91e None None] Routers {'d81a9efa-906c-4032-994a-82447e195ad4'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91689) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:28:27.341136 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-fa9df0e5-ebbd-4c36-ae43-e02bc4c6a91e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced1a6a3a0>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:28:03Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['d81a9efa-906c-4032-994a-82447e195ad4'], 'active': True} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:28:27.473044 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46a52cf2-75b3-43a6-a1d2-3b404f46b83c req-ffa3faff-b1f1-4a47-ae0f-6a2e8bd9e985 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:28:27.481961 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-46a52cf2-75b3-43a6-a1d2-3b404f46b83c req-ffa3faff-b1f1-4a47-ae0f-6a2e8bd9e985 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 984 time: 0.1503973
May 20 04:28:27.550753 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-46a52cf2-75b3-43a6-a1d2-3b404f46b83c req-8de07ad9-e53a-4645-8c0f-54e532669414 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=84c434c2-401c-4319-a0ff-8ceaf7cae545&id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0673668
May 20 04:28:27.631217 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvr_db [None req-fa9df0e5-ebbd-4c36-ae43-e02bc4c6a91e None None] Set router d81a9efa-906c-4032-994a-82447e195ad4 gateway port host: dv-cinder-790910-4-iscsi {{(pid=91689) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:28:27.957110 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-fa9df0e5-ebbd-4c36-ae43-e02bc4c6a91e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced1a6a3a0>, [{'id': 'd81a9efa-906c-4032-994a-82447e195ad4', 'name': 'tempest-TestVolumeBootPattern-1348979754-router', 'tenant_id': '9cdc6335963a47e384b2530ced2a9b80', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.85'}], 'enable_snat': True}, 'gw_port_id': 'f752de37-e83f-4b51-b1d4-6eceabcfd969', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:28:15Z', 'updated_at': '2021-05-20T04:28:20Z', 'revision_number': 4, 'project_id': '9cdc6335963a47e384b2530ced2a9b80', 'gw_port': {'id': 'f752de37-e83f-4b51-b1d4-6eceabcfd969', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:ce:8c:eb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd81a9efa-906c-4032-994a-82447e195ad4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 523, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.85', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:28:16Z', 'updated_at': '2021-05-20T04:28:23Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_interfaces': [{'id': '625c64ac-ab07-4497-be90-0c20245577b2', 'name': '', 'network_id': '797bc43b-d3f0-4cce-ab72-4d9b7d99a5cc', 'tenant_id': '9cdc6335963a47e384b2530ced2a9b80', 'mac_address': 'fa:16:3e:8b:b8:5f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd81a9efa-906c-4032-994a-82447e195ad4', 'device_owner': 'network:router_interface', 'standard_attr_id': 524, 'fixed_ips': [{'subnet_id': 'b84834e7-a1f8-44f0-aa94-dda7f575d2e7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:28:20Z', 'updated_at': '2021-05-20T04:28:27Z', 'revision_number': 4, 'project_id': '9cdc6335963a47e384b2530ced2a9b80', 'subnets': [{'id': 'b84834e7-a1f8-44f0-aa94-dda7f575d2e7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:28:27.961162 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fa9df0e5-ebbd-4c36-ae43-e02bc4c6a91e None None] The sync data for ids ['d81a9efa-906c-4032-994a-82447e195ad4'] in dv-cinder-790910-4-iscsi is: [{'id': 'd81a9efa-906c-4032-994a-82447e195ad4', 'name': 'tempest-TestVolumeBootPattern-1348979754-router', 'tenant_id': '9cdc6335963a47e384b2530ced2a9b80', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.85'}], 'enable_snat': True}, 'gw_port_id': 'f752de37-e83f-4b51-b1d4-6eceabcfd969', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:28:15Z', 'updated_at': '2021-05-20T04:28:20Z', 'revision_number': 4, 'project_id': '9cdc6335963a47e384b2530ced2a9b80', 'gw_port': {'id': 'f752de37-e83f-4b51-b1d4-6eceabcfd969', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:ce:8c:eb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd81a9efa-906c-4032-994a-82447e195ad4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 523, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.85', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:28:16Z', 'updated_at': '2021-05-20T04:28:23Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_interfaces': [{'id': '625c64ac-ab07-4497-be90-0c20245577b2', 'name': '', 'network_id': '797bc43b-d3f0-4cce-ab72-4d9b7d99a5cc', 'tenant_id': '9cdc6335963a47e384b2530ced2a9b80', 'mac_address': 'fa:16:3e:8b:b8:5f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd81a9efa-906c-4032-994a-82447e195ad4', 'device_owner': 'network:router_interface', 'standard_attr_id': 524, 'fixed_ips': [{'subnet_id': 'b84834e7-a1f8-44f0-aa94-dda7f575d2e7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:28:20Z', 'updated_at': '2021-05-20T04:28:27Z', 'revision_number': 4, 'project_id': '9cdc6335963a47e384b2530ced2a9b80', 'subnets': [{'id': 'b84834e7-a1f8-44f0-aa94-dda7f575d2e7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91689) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 04:28:28.908620 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e0ae4cf-63a4-45fc-a498-9f078333d02b req-c4d09524-e766-4d34-97ff-7de2fc8cc925 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:28:28.910822 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9e0ae4cf-63a4-45fc-a498-9f078333d02b req-c4d09524-e766-4d34-97ff-7de2fc8cc925 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 984 time: 0.0958869
May 20 04:28:28.980043 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9e0ae4cf-63a4-45fc-a498-9f078333d02b req-c23e6e2a-e389-4236-a463-a797d7961336 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=84c434c2-401c-4319-a0ff-8ceaf7cae545&id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0585599
May 20 04:28:29.022335 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 625c64ac-ab07-4497-be90-0c20245577b2 up at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:28:29.094995 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning for port 625c64ac-ab07-4497-be90-0c20245577b2 completed by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:28:29.103990 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning complete for port 625c64ac-ab07-4497-be90-0c20245577b2 triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:28:29.104624 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:29.229510 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:29.266623 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] For port 625c64ac-ab07-4497-be90-0c20245577b2, host dv-cinder-790910-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=625c64ac-ab07-4497-be90-0c20245577b2,segment=NetworkSegment(400d6b98-7e80-413b-b776-1d2e09a33a2f),segment_id=400d6b98-7e80-413b-b776-1d2e09a33a2f)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:28:29.272124 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:29.275365 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:28:29.343179 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Pushing event updated for resources: {'Port': ['ID=625c64ac-ab07-4497-be90-0c20245577b2,revision_number=5']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:28:29.346493 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:28:29.867434 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-33a79ebb-331f-4df5-a7b5-8a1140ea97c4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:30.198607 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65626047-4476-46be-8c3e-172da9e21890 req-fd34c922-e2c7-4daa-bc05-449d2b7eca7e tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:28:30.200155 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-65626047-4476-46be-8c3e-172da9e21890 req-fd34c922-e2c7-4daa-bc05-449d2b7eca7e tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 984 time: 0.0846570
May 20 04:28:30.251149 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-65626047-4476-46be-8c3e-172da9e21890 req-fe7c4b20-3b4b-434d-b544-ba0de64f8e96 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=84c434c2-401c-4319-a0ff-8ceaf7cae545&id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0447769
May 20 04:28:30.967948 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 625c64ac-ab07-4497-be90-0c20245577b2 up at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:28:31.043981 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning complete for port 625c64ac-ab07-4497-be90-0c20245577b2 triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:28:31.044230 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:31.468067 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa050932-8c31-4b33-8fce-889b1dcc8581 req-bc330ce5-55f7-48a7-acdf-cc91435175e2 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:28:31.470676 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-fa050932-8c31-4b33-8fce-889b1dcc8581 req-bc330ce5-55f7-48a7-acdf-cc91435175e2 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 984 time: 0.1130011
May 20 04:28:31.521758 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-fa050932-8c31-4b33-8fce-889b1dcc8581 req-117be217-1a23-47b7-90fe-317abc1aa573 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=84c434c2-401c-4319-a0ff-8ceaf7cae545&id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0451765
May 20 04:28:32.580943 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:32.676415 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-40e203fb-3fca-4a89-a9ef-b7484030f259 req-3de788ca-d9c7-4c3c-b5b9-6a7a2dd9fce5 service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0725725
May 20 04:28:32.690851 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ee059d06-7159-4743-b93f-99601dcfecb0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:32.725267 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06620805-6b37-4474-9511-86aa388fe324 req-6c9a5ca1-05ce-411e-8ee6-06c8305c9571 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:28:32.726786 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-06620805-6b37-4474-9511-86aa388fe324 req-6c9a5ca1-05ce-411e-8ee6-06c8305c9571 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 984 time: 0.0918579
May 20 04:28:32.779763 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-06620805-6b37-4474-9511-86aa388fe324 req-f0467714-d915-4648-a5ca-2e16e3da479c tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=84c434c2-401c-4319-a0ff-8ceaf7cae545&id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0465600
May 20 04:28:32.780498 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40e203fb-3fca-4a89-a9ef-b7484030f259 req-24aea6f2-7cca-4412-9a9a-b8e17e213dc3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:28:32.782432 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-40e203fb-3fca-4a89-a9ef-b7484030f259 req-24aea6f2-7cca-4412-9a9a-b8e17e213dc3 service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=a1319e4a0fc74f98ba4bb88d8a04086b&device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 1099 time: 0.0791304
May 20 04:28:32.942852 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40e203fb-3fca-4a89-a9ef-b7484030f259 req-3f08c5f8-2d2f-41b8-a7dc-c62657bc3b8f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:28:32.944315 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-40e203fb-3fca-4a89-a9ef-b7484030f259 req-3f08c5f8-2d2f-41b8-a7dc-c62657bc3b8f service neutron] 10.222.0.82 "GET /v2.0/networks?id=e31171ff-f097-446e-b691-bef7aad2fb3b HTTP/1.1" status: 200  len: 910 time: 0.1414759
May 20 04:28:33.055587 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-40e203fb-3fca-4a89-a9ef-b7484030f259 req-45db3718-88f3-4a48-b78e-15f7c6f15b6c service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=9c846663-c90b-41d4-a8d1-1086882ba27e HTTP/1.1" status: 200  len: 1002 time: 0.1025307
May 20 04:28:33.130833 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40e203fb-3fca-4a89-a9ef-b7484030f259 req-b8d92155-52fe-428e-9104-d5921589b8bc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:28:33.132319 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-40e203fb-3fca-4a89-a9ef-b7484030f259 req-b8d92155-52fe-428e-9104-d5921589b8bc service neutron] 10.222.0.82 "GET /v2.0/subnets?id=410f59de-055d-4298-96bf-5d9a7712368d HTTP/1.1" status: 200  len: 848 time: 0.0698600
May 20 04:28:33.212754 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40e203fb-3fca-4a89-a9ef-b7484030f259 req-87ac0ee3-6e6a-46ac-b3e0-3e3f2efcca30 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:28:33.214349 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-40e203fb-3fca-4a89-a9ef-b7484030f259 req-87ac0ee3-6e6a-46ac-b3e0-3e3f2efcca30 service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=e31171ff-f097-446e-b691-bef7aad2fb3b&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0747933
May 20 04:28:33.343185 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ea4803bd-878f-47d5-9084-1ec41953c9db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:33.353198 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-40e203fb-3fca-4a89-a9ef-b7484030f259 req-eae95661-dc45-4a29-b4f8-be33acb2d460 service neutron] 10.222.0.82 "GET /v2.0/networks/e31171ff-f097-446e-b691-bef7aad2fb3b?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1316655
May 20 04:28:33.596521 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-40e203fb-3fca-4a89-a9ef-b7484030f259 req-5e8a20fe-a38a-4f6d-b489-d5bea66c2342 service neutron] 10.222.0.82 "GET /v2.0/networks/e31171ff-f097-446e-b691-bef7aad2fb3b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2352173
May 20 04:28:34.000357 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25cb030e-0cd0-4605-a10c-b2e99f1dce9f req-261aa9cf-7d1b-486a-abd1-d8f0773d4ec3 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:28:34.001918 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-25cb030e-0cd0-4605-a10c-b2e99f1dce9f req-261aa9cf-7d1b-486a-abd1-d8f0773d4ec3 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 984 time: 0.0983853
May 20 04:28:34.053927 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-25cb030e-0cd0-4605-a10c-b2e99f1dce9f req-8445b581-d057-41c0-a7b3-582110f405b6 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=84c434c2-401c-4319-a0ff-8ceaf7cae545&id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0453074
May 20 04:28:35.206685 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f21320cc-6a25-4ec1-8a32-8b119b35fd55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:35.262139 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-617df498-d8d4-4440-bfef-ca23a1abc82a req-96f8d89a-7b72-4738-8a4b-040eaf5a4c17 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:28:35.263690 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-617df498-d8d4-4440-bfef-ca23a1abc82a req-96f8d89a-7b72-4738-8a4b-040eaf5a4c17 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 984 time: 0.0892661
May 20 04:28:35.316250 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-617df498-d8d4-4440-bfef-ca23a1abc82a req-5db809e0-713e-4ce5-a7c4-1ec7df459d3e tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=84c434c2-401c-4319-a0ff-8ceaf7cae545&id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0460687
May 20 04:28:36.507710 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3062801e-1d5d-4942-ac11-4d98bcd48a2e req-c978c4c0-79a0-428f-b27d-19375c704f4f tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:28:36.509264 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-3062801e-1d5d-4942-ac11-4d98bcd48a2e req-c978c4c0-79a0-428f-b27d-19375c704f4f tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 984 time: 0.0844059
May 20 04:28:36.543488 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:36.559712 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-3062801e-1d5d-4942-ac11-4d98bcd48a2e req-2c1c3427-d84f-4b3c-a305-d864fc8eedc4 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=84c434c2-401c-4319-a0ff-8ceaf7cae545&id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0438640
May 20 04:28:37.771312 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-240c4c22-28fc-4628-94a7-407f4c10fca1 req-5ed1a1fc-f211-4852-8652-9f4edc315b36 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:28:37.772923 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-240c4c22-28fc-4628-94a7-407f4c10fca1 req-5ed1a1fc-f211-4852-8652-9f4edc315b36 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 984 time: 0.0874462
May 20 04:28:37.822304 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-240c4c22-28fc-4628-94a7-407f4c10fca1 req-505b7fae-308c-42c8-94eb-a5ff495c85a8 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=84c434c2-401c-4319-a0ff-8ceaf7cae545&id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0433648
May 20 04:28:39.014993 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26a54c4b-9b49-49e8-9d9e-0ec283bc7fd1 req-1997f506-3e00-4cf8-833a-bf8ab13f958e tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:28:39.018429 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-26a54c4b-9b49-49e8-9d9e-0ec283bc7fd1 req-1997f506-3e00-4cf8-833a-bf8ab13f958e tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 984 time: 0.0810487
May 20 04:28:39.079156 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-26a54c4b-9b49-49e8-9d9e-0ec283bc7fd1 req-00521eb5-f9a4-4d24-b8c2-442a0737672d tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=84c434c2-401c-4319-a0ff-8ceaf7cae545&id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0552883
May 20 04:28:40.279493 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2aa66196-faea-4e03-9962-20c1637c293b req-2825eed7-71a9-4d0b-a4cd-e9b7570c5ad4 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:28:40.281153 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-2aa66196-faea-4e03-9962-20c1637c293b req-2825eed7-71a9-4d0b-a4cd-e9b7570c5ad4 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 984 time: 0.0847068
May 20 04:28:40.335214 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-2aa66196-faea-4e03-9962-20c1637c293b req-b49cec6c-a50b-4e4a-8a10-02defa1ef22a tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=84c434c2-401c-4319-a0ff-8ceaf7cae545&id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0471790
May 20 04:28:41.555654 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-063ede8f-b6f6-4725-aa5b-34622a047126 req-fe66e711-594d-4a5e-b94a-ebda7ed5b363 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:28:41.557220 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-063ede8f-b6f6-4725-aa5b-34622a047126 req-fe66e711-594d-4a5e-b94a-ebda7ed5b363 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 984 time: 0.0930054
May 20 04:28:41.623460 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-063ede8f-b6f6-4725-aa5b-34622a047126 req-944c7a12-8671-4516-b52f-6a231a0515a8 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=84c434c2-401c-4319-a0ff-8ceaf7cae545&id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0595157
May 20 04:28:42.838527 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b19dcbe3-57ca-491b-b553-a0a97426912d req-f7717131-3e74-494d-88f5-57ccd54054d0 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:28:42.841746 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-b19dcbe3-57ca-491b-b553-a0a97426912d req-f7717131-3e74-494d-88f5-57ccd54054d0 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 984 time: 0.1101644
May 20 04:28:42.903319 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-b19dcbe3-57ca-491b-b553-a0a97426912d req-279e5420-c7da-464b-a20b-fdd241d8ccf8 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=84c434c2-401c-4319-a0ff-8ceaf7cae545&id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0534766
May 20 04:28:44.309355 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7f74f52-4fc0-42e4-8b0b-4103e7f2b221 req-926c5b86-43ca-4094-beb1-1ff041621a91 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:28:44.310957 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-c7f74f52-4fc0-42e4-8b0b-4103e7f2b221 req-926c5b86-43ca-4094-beb1-1ff041621a91 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 984 time: 0.0902536
May 20 04:28:44.361333 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-c7f74f52-4fc0-42e4-8b0b-4103e7f2b221 req-ea8281cd-65f9-49f8-88a7-bb66a52db27f tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=84c434c2-401c-4319-a0ff-8ceaf7cae545&id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0439003
May 20 04:28:45.205678 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 44382) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:28:45.364614 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-6e648c22-8957-4479-895d-c3e7118e46f2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:45.382737 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-6e648c22-8957-4479-895d-c3e7118e46f2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:28:45.386674 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-6e648c22-8957-4479-895d-c3e7118e46f2 admin admin] Usage tracker for resource:security_group_rule and tenant:0bc3a4ec612a4ef2999876c46e85dde5 is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:28:45.389774 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-6e648c22-8957-4479-895d-c3e7118e46f2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:28:45.396821 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-6e648c22-8957-4479-895d-c3e7118e46f2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:28:45.496743 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-6e648c22-8957-4479-895d-c3e7118e46f2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:45.501226 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-6e648c22-8957-4479-895d-c3e7118e46f2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:45.508928 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-c0156b01-0148-4c1f-ad43-d822d570b2bd tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:28:45.555445 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-6e648c22-8957-4479-895d-c3e7118e46f2 admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=0bc3a4ec612a4ef2999876c46e85dde5&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3456123
May 20 04:28:45.555445 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e648c22-8957-4479-895d-c3e7118e46f2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=61e4226c-70a8-477a-a537-242cbff26589,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:28:45.555943 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 44396) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:28:45.557331 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-6e648c22-8957-4479-895d-c3e7118e46f2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:28:45.629452 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-3eeb7c69-a479-4662-953d-5c4df50b73c9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:45.661505 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-3eeb7c69-a479-4662-953d-5c4df50b73c9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:45.723287 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-3eeb7c69-a479-4662-953d-5c4df50b73c9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:45.727251 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-62a8d6dc-af5a-45a4-9479-2c882085d836 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:28:45.738463 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3eeb7c69-a479-4662-953d-5c4df50b73c9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=61e4226c-70a8-477a-a537-242cbff26589,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:28:45.742308 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-3eeb7c69-a479-4662-953d-5c4df50b73c9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:28:45.745494 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-3eeb7c69-a479-4662-953d-5c4df50b73c9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:45.746643 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-3eeb7c69-a479-4662-953d-5c4df50b73c9 admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/61e4226c-70a8-477a-a537-242cbff26589 HTTP/1.1" status: 204  len: 168 time: 0.1890218
May 20 04:28:46.066838 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 44406) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:28:46.085873 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-9cf80be4-f233-4132-a461-b65ad284e92b admin admin] Notify callbacks [] for security_group, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:46.100624 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-9cf80be4-f233-4132-a461-b65ad284e92b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:28:46.105089 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-9cf80be4-f233-4132-a461-b65ad284e92b admin admin] Usage tracker for resource:security_group_rule and tenant:f6e84b4793b24848814b32a5e77956f2 is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:28:46.108086 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-9cf80be4-f233-4132-a461-b65ad284e92b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:28:46.114334 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-9cf80be4-f233-4132-a461-b65ad284e92b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:28:46.204641 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-9cf80be4-f233-4132-a461-b65ad284e92b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:46.210325 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-9cf80be4-f233-4132-a461-b65ad284e92b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:46.219338 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-026d6c72-f746-4595-9f3a-f4ce723e4105 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:28:46.261696 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-9cf80be4-f233-4132-a461-b65ad284e92b admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=f6e84b4793b24848814b32a5e77956f2&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1913440
May 20 04:28:46.261696 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9cf80be4-f233-4132-a461-b65ad284e92b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8c951808-d66c-4c8d-92ac-96f53f358815,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:28:46.262665 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 44412) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:28:46.264490 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-9cf80be4-f233-4132-a461-b65ad284e92b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:28:46.325153 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-951d4382-c92b-4291-b3db-cd6886cd7d2f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:46.352590 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-951d4382-c92b-4291-b3db-cd6886cd7d2f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:46.419193 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-951d4382-c92b-4291-b3db-cd6886cd7d2f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:46.423953 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-94191f4b-ff93-4dd4-86a4-c8f6cc17aab2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:28:46.437166 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-951d4382-c92b-4291-b3db-cd6886cd7d2f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8c951808-d66c-4c8d-92ac-96f53f358815,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:28:46.440146 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-951d4382-c92b-4291-b3db-cd6886cd7d2f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:28:46.448115 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-951d4382-c92b-4291-b3db-cd6886cd7d2f admin admin] Notify callbacks [] for security_group, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:46.449215 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-951d4382-c92b-4291-b3db-cd6886cd7d2f admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/8c951808-d66c-4c8d-92ac-96f53f358815 HTTP/1.1" status: 204  len: 168 time: 0.1860988
May 20 04:28:48.550393 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 44510) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:28:48.676152 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-29842e77-dca0-4b9b-8c12-cfb45e62de72 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:48.691909 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-29842e77-dca0-4b9b-8c12-cfb45e62de72 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:28:48.696162 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-29842e77-dca0-4b9b-8c12-cfb45e62de72 admin admin] Usage tracker for resource:security_group_rule and tenant:3b3882106ab445e5867f70f0244f9c82 is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:28:48.699295 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-29842e77-dca0-4b9b-8c12-cfb45e62de72 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:28:48.705561 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-29842e77-dca0-4b9b-8c12-cfb45e62de72 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:28:48.794626 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-29842e77-dca0-4b9b-8c12-cfb45e62de72 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:48.799478 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-29842e77-dca0-4b9b-8c12-cfb45e62de72 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:48.810293 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-ce210b7d-d7d0-48f0-a3da-dd088cd42ca2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:28:48.850985 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-29842e77-dca0-4b9b-8c12-cfb45e62de72 admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=3b3882106ab445e5867f70f0244f9c82&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2983692
May 20 04:28:48.852237 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29842e77-dca0-4b9b-8c12-cfb45e62de72 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fbdb1b07-1aae-4861-93c6-ac0585f3f7de,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:28:48.852725 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 44516) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:28:48.855665 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-29842e77-dca0-4b9b-8c12-cfb45e62de72 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:28:48.931556 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-f3a5240b-cf55-42bf-bdb4-e0167114270f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:48.959565 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-f3a5240b-cf55-42bf-bdb4-e0167114270f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:49.027760 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-f3a5240b-cf55-42bf-bdb4-e0167114270f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:49.037255 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-2017ee4c-d2b8-499a-abd3-348be15c49f2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:28:49.062900 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3a5240b-cf55-42bf-bdb4-e0167114270f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fbdb1b07-1aae-4861-93c6-ac0585f3f7de,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:28:49.068021 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-f3a5240b-cf55-42bf-bdb4-e0167114270f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:28:49.075809 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-f3a5240b-cf55-42bf-bdb4-e0167114270f admin admin] Notify callbacks [] for security_group, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:49.077708 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-f3a5240b-cf55-42bf-bdb4-e0167114270f admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/fbdb1b07-1aae-4861-93c6-ac0585f3f7de HTTP/1.1" status: 204  len: 168 time: 0.2234950
May 20 04:28:49.413312 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 44528) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:28:49.433685 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-07e7327a-c0d8-4d60-8335-73d413b05f47 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:49.450154 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-07e7327a-c0d8-4d60-8335-73d413b05f47 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:28:49.454946 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-07e7327a-c0d8-4d60-8335-73d413b05f47 admin admin] Usage tracker for resource:security_group_rule and tenant:b4e5d71163b242669cab717df22c5172 is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:28:49.458419 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-07e7327a-c0d8-4d60-8335-73d413b05f47 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:28:49.465094 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-07e7327a-c0d8-4d60-8335-73d413b05f47 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:28:49.562565 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-07e7327a-c0d8-4d60-8335-73d413b05f47 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:49.567751 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-07e7327a-c0d8-4d60-8335-73d413b05f47 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:49.575446 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-8b045d2f-19d2-4399-bca8-4a7b32cb3293 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:28:49.616326 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07e7327a-c0d8-4d60-8335-73d413b05f47 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8679f86d-3530-4bb0-91ad-2033a7e82484,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:28:49.620407 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-07e7327a-c0d8-4d60-8335-73d413b05f47 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:28:49.627738 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-07e7327a-c0d8-4d60-8335-73d413b05f47 admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=b4e5d71163b242669cab717df22c5172&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2087829
May 20 04:28:49.628224 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 44536) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:28:49.709672 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-0a1274b9-f2dd-4dda-9428-519f4e79853c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:49.759068 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-0a1274b9-f2dd-4dda-9428-519f4e79853c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:49.852171 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-0a1274b9-f2dd-4dda-9428-519f4e79853c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:49.856534 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-6e648c22-8957-4479-895d-c3e7118e46f2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:28:49.870490 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a1274b9-f2dd-4dda-9428-519f4e79853c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8679f86d-3530-4bb0-91ad-2033a7e82484,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:28:49.874221 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-0a1274b9-f2dd-4dda-9428-519f4e79853c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:28:49.881846 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-0a1274b9-f2dd-4dda-9428-519f4e79853c admin admin] Notify callbacks [] for security_group, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:49.883980 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-0a1274b9-f2dd-4dda-9428-519f4e79853c admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/8679f86d-3530-4bb0-91ad-2033a7e82484 HTTP/1.1" status: 204  len: 168 time: 0.2547700
May 20 04:28:50.586760 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 44560) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:28:50.655099 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.db_base_plugin_v2 [None req-e06623cb-0e10-4d48-8bae-e5b3415f28e6 admin admin] Deleting subnet 2dceece0-8bc3-4f29-a183-108f8744d094 {{(pid=91687) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 20 04:28:50.659130 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-e06623cb-0e10-4d48-8bae-e5b3415f28e6 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:50.728852 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-e06623cb-0e10-4d48-8bae-e5b3415f28e6 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-936634'] for subnet, precommit_delete_associations {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:50.833878 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-e06623cb-0e10-4d48-8bae-e5b3415f28e6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1504133'] for subnet, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:51.118624 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-e06623cb-0e10-4d48-8bae-e5b3415f28e6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1504178', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-255887', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-4160847', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-692244'] for subnet, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:51.123144 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:28:51.160295 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e06623cb-0e10-4d48-8bae-e5b3415f28e6 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=2dceece0-8bc3-4f29-a183-108f8744d094,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:28:51.164119 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-e06623cb-0e10-4d48-8bae-e5b3415f28e6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:28:51.166854 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-e06623cb-0e10-4d48-8bae-e5b3415f28e6 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for subnet, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:51.173379 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-e06623cb-0e10-4d48-8bae-e5b3415f28e6 admin admin] 10.222.0.71 "DELETE /v2.0/subnets/2dceece0-8bc3-4f29-a183-108f8744d094 HTTP/1.1" status: 204  len: 168 time: 0.5850618
May 20 04:28:51.176111 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 44578) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:28:51.284439 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-acbeb02f-8a19-4c61-99bf-0ca812d59d50 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-593149'] for network, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:51.479558 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-acbeb02f-8a19-4c61-99bf-0ca812d59d50 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1505550', 'neutron.services.segments.db._delete_segments_for_network-8782892550274'] for network, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:51.494832 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.services.segments.db [None req-acbeb02f-8a19-4c61-99bf-0ca812d59d50 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fced0f510a0>,) {'filters': {'network_id': ['c6308b4a-efff-48c2-b41d-58a08edddda1']}} {{(pid=91687) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:28:51.506809 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.services.segments.db [None req-acbeb02f-8a19-4c61-99bf-0ca812d59d50 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fced0f510a0>, '3cfe6ee0-17fa-47f2-8f37-995aaef6bfdc') {'for_net_delete': True} {{(pid=91687) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:28:51.507097 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.services.segments.db [None req-acbeb02f-8a19-4c61-99bf-0ca812d59d50 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fced0f510a0>, '3cfe6ee0-17fa-47f2-8f37-995aaef6bfdc') {} {{(pid=91687) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:28:51.519212 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-acbeb02f-8a19-4c61-99bf-0ca812d59d50 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8782892560523', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-936621'] for segment, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:51.538101 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-acbeb02f-8a19-4c61-99bf-0ca812d59d50 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1501910'] for segment, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:51.545550 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-acbeb02f-8a19-4c61-99bf-0ca812d59d50 admin admin] Releasing vlan 899 on physical network physnet1 to pool {{(pid=91687) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 20 04:28:51.546129 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-acbeb02f-8a19-4c61-99bf-0ca812d59d50 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1501910', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-4162285'] for segment, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:51.559546 dv-cinder-790910-4-iscsi neutron-server[91687]: Traceback (most recent call last):
May 20 04:28:51.559546 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 20 04:28:51.559546 dv-cinder-790910-4-iscsi neutron-server[91687]:     timer()
May 20 04:28:51.559546 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 20 04:28:51.559546 dv-cinder-790910-4-iscsi neutron-server[91687]:     cb(*args, **kw)
May 20 04:28:51.559546 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 20 04:28:51.559546 dv-cinder-790910-4-iscsi neutron-server[91687]:     return func(*args, **kwargs)
May 20 04:28:51.559546 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 20 04:28:51.559546 dv-cinder-790910-4-iscsi neutron-server[91687]:     self._notify()
May 20 04:28:51.559546 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 20 04:28:51.559546 dv-cinder-790910-4-iscsi neutron-server[91687]:     self.callback(batched_events)
May 20 04:28:51.559546 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 20 04:28:51.559546 dv-cinder-790910-4-iscsi neutron-server[91687]:     event.method(event)
May 20 04:28:51.559546 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 20 04:28:51.559546 dv-cinder-790910-4-iscsi neutron-server[91687]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 20 04:28:51.559546 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 20 04:28:51.559546 dv-cinder-790910-4-iscsi neutron-server[91687]:     aggregate_uuid = self.p_client.list_aggregates(
May 20 04:28:51.559546 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 20 04:28:51.559546 dv-cinder-790910-4-iscsi neutron-server[91687]:     return f(self, *a, **k)
May 20 04:28:51.559546 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 20 04:28:51.559546 dv-cinder-790910-4-iscsi neutron-server[91687]:     return self._get(url).json()
May 20 04:28:51.559546 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 20 04:28:51.559546 dv-cinder-790910-4-iscsi neutron-server[91687]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 20 04:28:51.559546 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 20 04:28:51.559546 dv-cinder-790910-4-iscsi neutron-server[91687]:     return self.request(url, 'GET', **kwargs)
May 20 04:28:51.559546 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 20 04:28:51.559546 dv-cinder-790910-4-iscsi neutron-server[91687]:     base_url = self.get_endpoint(auth, allow=allow,
May 20 04:28:51.559546 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 20 04:28:51.559546 dv-cinder-790910-4-iscsi neutron-server[91687]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 20 04:28:51.559546 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 20 04:28:51.559546 dv-cinder-790910-4-iscsi neutron-server[91687]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 20 04:28:51.559546 dv-cinder-790910-4-iscsi neutron-server[91687]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 20 04:28:51.640175 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-acbeb02f-8a19-4c61-99bf-0ca812d59d50 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1505543', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1590664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1781430', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1713996'] for network, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:51.644049 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-b84b7633-027f-4db1-93a8-640d97a5f09a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:28:51.659676 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-acbeb02f-8a19-4c61-99bf-0ca812d59d50 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for network, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:51.667415 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acbeb02f-8a19-4c61-99bf-0ca812d59d50 admin admin] Pushing event deleted for resources: {'Network': ['ID=c6308b4a-efff-48c2-b41d-58a08edddda1,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:28:51.673642 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-acbeb02f-8a19-4c61-99bf-0ca812d59d50 admin admin] 10.222.0.71 "DELETE /v2.0/networks/c6308b4a-efff-48c2-b41d-58a08edddda1 HTTP/1.1" status: 204  len: 168 time: 0.4935308
May 20 04:28:51.673642 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-acbeb02f-8a19-4c61-99bf-0ca812d59d50 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:28:51.872318 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 44602) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:28:51.927185 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-a9cdcc04-3693-4e92-b587-424ab38b9abc admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=8a32187e285543a88aae7f4283a9636f&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0535839
May 20 04:28:51.930049 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 44606) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:28:51.994032 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-c0ff87ef-6638-4cf5-b1d8-4a515d3fe761 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:52.021409 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-c0ff87ef-6638-4cf5-b1d8-4a515d3fe761 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:52.091802 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-c0ff87ef-6638-4cf5-b1d8-4a515d3fe761 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:52.097079 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-19c7f328-8200-41a2-827d-bac9f7a820f6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:28:52.112020 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0ff87ef-6638-4cf5-b1d8-4a515d3fe761 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e79e4ba4-358f-4b35-b5f3-7372b5116def,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:28:52.114672 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-c0ff87ef-6638-4cf5-b1d8-4a515d3fe761 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:28:52.123030 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-c0ff87ef-6638-4cf5-b1d8-4a515d3fe761 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:28:52.124349 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-c0ff87ef-6638-4cf5-b1d8-4a515d3fe761 admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/e79e4ba4-358f-4b35-b5f3-7372b5116def HTTP/1.1" status: 204  len: 168 time: 0.1932805
May 20 04:28:52.952052 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.agents_db [None req-92d61f12-17bc-4bf9-9eab-8a69b8c6da2f None None] Agent healthcheck: found 6 active agents {{(pid=91689) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 04:28:57.709298 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [req-4b50bb13-5eed-4067-b22a-4332fc629b14 req-9c6a9ef2-1500-4118-9ca6-6bf0a9ad95e5 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Synchronizing usage tracker for tenant:9b6fb271a7a546a38b0c6df5beaf22fc on resource:security_group {{(pid=91686) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:28:57.727055 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [req-4b50bb13-5eed-4067-b22a-4332fc629b14 req-9c6a9ef2-1500-4118-9ca6-6bf0a9ad95e5 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Unset dirty status for tenant:9b6fb271a7a546a38b0c6df5beaf22fc on resource:security_group {{(pid=91686) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:28:57.728499 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-4b50bb13-5eed-4067-b22a-4332fc629b14 req-9c6a9ef2-1500-4118-9ca6-6bf0a9ad95e5 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1603607005&fields=id&tenant_id=9b6fb271a7a546a38b0c6df5beaf22fc HTTP/1.1" status: 200  len: 267 time: 0.0626211
May 20 04:28:57.979850 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b50bb13-5eed-4067-b22a-4332fc629b14 req-97fe5832-6f58-48db-b331-3de921cf9aff tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:28:57.980551 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [req-4b50bb13-5eed-4067-b22a-4332fc629b14 req-97fe5832-6f58-48db-b331-3de921cf9aff tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Synchronizing usage tracker for tenant:9b6fb271a7a546a38b0c6df5beaf22fc on resource:network {{(pid=91686) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:28:58.000107 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [req-4b50bb13-5eed-4067-b22a-4332fc629b14 req-97fe5832-6f58-48db-b331-3de921cf9aff tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Unset dirty status for tenant:9b6fb271a7a546a38b0c6df5beaf22fc on resource:network {{(pid=91686) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:28:58.001553 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-4b50bb13-5eed-4067-b22a-4332fc629b14 req-97fe5832-6f58-48db-b331-3de921cf9aff tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/networks?id=11c994a8-6ede-4290-84f0-71af466860db HTTP/1.1" status: 200  len: 811 time: 0.2657378
May 20 04:28:58.021213 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-4b50bb13-5eed-4067-b22a-4332fc629b14 req-cf809a13-3cf7-4dee-a098-6be88fcdbc9c tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/quotas/9b6fb271a7a546a38b0c6df5beaf22fc HTTP/1.1" status: 200  len: 375 time: 0.0130751
May 20 04:28:58.114795 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-4b50bb13-5eed-4067-b22a-4332fc629b14 req-3514d6e4-d36d-4715-92fa-4158a61170c4 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/ports?tenant_id=9b6fb271a7a546a38b0c6df5beaf22fc&fields=id HTTP/1.1" status: 200  len: 302 time: 0.0877068
May 20 04:28:58.366211 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-4b50bb13-5eed-4067-b22a-4332fc629b14 req-0068704a-f174-4038-ad43-b8e3d10386ba service neutron] 10.222.0.71 "GET /v2.0/networks/11c994a8-6ede-4290-84f0-71af466860db?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2393234
May 20 04:28:58.501123 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-4b50bb13-5eed-4067-b22a-4332fc629b14 req-500cf361-b80c-4ad7-859c-e024c469e4e7 service neutron] 10.222.0.71 "GET /v2.0/networks/11c994a8-6ede-4290-84f0-71af466860db?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1288226
May 20 04:28:58.943148 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-16a74058-25aa-4400-8827-049b59d2b8fe req-5b91ac11-4eb0-4be8-aca1-83df426ef8ef tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Synchronizing usage tracker for tenant:9b6fb271a7a546a38b0c6df5beaf22fc on resource:port {{(pid=91687) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:28:58.964362 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-16a74058-25aa-4400-8827-049b59d2b8fe req-5b91ac11-4eb0-4be8-aca1-83df426ef8ef tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Unset dirty status for tenant:9b6fb271a7a546a38b0c6df5beaf22fc on resource:port {{(pid=91687) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:28:58.964801 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-16a74058-25aa-4400-8827-049b59d2b8fe req-5b91ac11-4eb0-4be8-aca1-83df426ef8ef tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/ports?device_id=9e9ac66e-ff2b-4295-8476-471c42fe11a5 HTTP/1.1" status: 200  len: 210 time: 0.0684838
May 20 04:28:59.861922 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f7da5420-32ce-4425-9254-83f4c39246dd None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:00.114604 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b50bb13-5eed-4067-b22a-4332fc629b14 req-dc5c9f64-764b-4528-9919-60e4ca6716c5 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:00.116120 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4b50bb13-5eed-4067-b22a-4332fc629b14 req-dc5c9f64-764b-4528-9919-60e4ca6716c5 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.82 "GET /v2.0/networks?id=11c994a8-6ede-4290-84f0-71af466860db HTTP/1.1" status: 200  len: 811 time: 0.1605580
May 20 04:29:00.122422 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-09bf1f3b-bb49-4fef-9790-05d355a25d9c req-da9bc2ce-73f6-46da-b723-fa96b5724d52 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/ports?device_id=9e9ac66e-ff2b-4295-8476-471c42fe11a5 HTTP/1.1" status: 200  len: 210 time: 0.0433934
May 20 04:29:00.174436 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-4b50bb13-5eed-4067-b22a-4332fc629b14 req-865f83e0-b68f-4252-820c-d7447f1245d4 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Synchronizing usage tracker for tenant:9b6fb271a7a546a38b0c6df5beaf22fc on resource:security_group {{(pid=91687) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:29:00.187550 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-4b50bb13-5eed-4067-b22a-4332fc629b14 req-865f83e0-b68f-4252-820c-d7447f1245d4 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Unset dirty status for tenant:9b6fb271a7a546a38b0c6df5beaf22fc on resource:security_group {{(pid=91687) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:29:00.188989 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4b50bb13-5eed-4067-b22a-4332fc629b14 req-865f83e0-b68f-4252-820c-d7447f1245d4 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.82 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=9b6fb271a7a546a38b0c6df5beaf22fc HTTP/1.1" status: 200  len: 380 time: 0.0635345
May 20 04:29:00.198554 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [req-4b50bb13-5eed-4067-b22a-4332fc629b14 req-5256a0ce-3cea-491f-9c10-48455d0551ad tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Request body: {'port': {'device_id': '9e9ac66e-ff2b-4295-8476-471c42fe11a5', 'network_id': '11c994a8-6ede-4290-84f0-71af466860db', 'admin_state_up': True, 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'security_groups': ['ef28d688-789b-4282-a30c-d7d731615fbf']}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:29:00.396047 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [req-4b50bb13-5eed-4067-b22a-4332fc629b14 req-5256a0ce-3cea-491f-9c10-48455d0551ad tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:29:00.408230 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [req-4b50bb13-5eed-4067-b22a-4332fc629b14 req-5256a0ce-3cea-491f-9c10-48455d0551ad tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:29:00.420505 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-4b50bb13-5eed-4067-b22a-4332fc629b14 req-5256a0ce-3cea-491f-9c10-48455d0551ad tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Made reservation on behalf of 9b6fb271a7a546a38b0c6df5beaf22fc for: {'port': 1} {{(pid=91687) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 04:29:00.426868 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-4b50bb13-5eed-4067-b22a-4332fc629b14 req-5256a0ce-3cea-491f-9c10-48455d0551ad tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:00.626931 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.db_base_plugin_common [req-4b50bb13-5eed-4067-b22a-4332fc629b14 req-5256a0ce-3cea-491f-9c10-48455d0551ad tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Allocated IP 172.20.0.10 (11c994a8-6ede-4290-84f0-71af466860db/51af45f1-449a-400c-8714-8d713d4a7993/836b04fc-7e58-43e4-b4c9-054e40658569) {{(pid=91687) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 04:29:00.893333 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-4b50bb13-5eed-4067-b22a-4332fc629b14 req-5256a0ce-3cea-491f-9c10-48455d0551ad tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks [] for port, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:00.912660 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.provisioning_blocks [req-4b50bb13-5eed-4067-b22a-4332fc629b14 req-5256a0ce-3cea-491f-9c10-48455d0551ad tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Transition to ACTIVE for port object 836b04fc-7e58-43e4-b4c9-054e40658569 will not be triggered until provisioned by entity DHCP. {{(pid=91687) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:29:00.938505 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-4b50bb13-5eed-4067-b22a-4332fc629b14 req-5256a0ce-3cea-491f-9c10-48455d0551ad tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8782892106231', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4162192'] for port, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:00.951866 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-59fc983c-239a-46cb-b1fc-5123a6b99323 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:29:01.018719 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-4b50bb13-5eed-4067-b22a-4332fc629b14 req-5256a0ce-3cea-491f-9c10-48455d0551ad tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Network 11c994a8-6ede-4290-84f0-71af466860db is already hosted by enough agents. {{(pid=91687) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:29:01.022017 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.base_scheduler [req-4b50bb13-5eed-4067-b22a-4332fc629b14 req-5256a0ce-3cea-491f-9c10-48455d0551ad tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Resources bound (agent type, host, resource id):  {{(pid=91687) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:29:01.026342 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.l3_dvrscheduler_db [req-4b50bb13-5eed-4067-b22a-4332fc629b14 req-5256a0ce-3cea-491f-9c10-48455d0551ad tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Received port after_create {{(pid=91687) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 04:29:01.058088 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5256a0ce-3cea-491f-9c10-48455d0551ad tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Pushing event updated for resources: {'Port': ['ID=836b04fc-7e58-43e4-b4c9-054e40658569,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:29:01.075646 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5256a0ce-3cea-491f-9c10-48455d0551ad tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:29:01.076171 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5256a0ce-3cea-491f-9c10-48455d0551ad tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:29:01.076377 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5256a0ce-3cea-491f-9c10-48455d0551ad tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:29:01.076570 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5256a0ce-3cea-491f-9c10-48455d0551ad tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:29:01.077003 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5256a0ce-3cea-491f-9c10-48455d0551ad tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:29:01.077339 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5256a0ce-3cea-491f-9c10-48455d0551ad tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:29:01.077732 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5256a0ce-3cea-491f-9c10-48455d0551ad tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:29:01.078085 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5256a0ce-3cea-491f-9c10-48455d0551ad tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:29:01.078566 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5256a0ce-3cea-491f-9c10-48455d0551ad tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:29:01.078949 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5256a0ce-3cea-491f-9c10-48455d0551ad tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:29:01.079353 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5256a0ce-3cea-491f-9c10-48455d0551ad tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:29:01.079766 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5256a0ce-3cea-491f-9c10-48455d0551ad tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:29:01.089969 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-5256a0ce-3cea-491f-9c10-48455d0551ad tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.145s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:29:01.121711 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b50bb13-5eed-4067-b22a-4332fc629b14 req-5256a0ce-3cea-491f-9c10-48455d0551ad tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:01.122400 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-4b50bb13-5eed-4067-b22a-4332fc629b14 req-5256a0ce-3cea-491f-9c10-48455d0551ad tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for port, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:01.152376 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4b50bb13-5eed-4067-b22a-4332fc629b14 req-5256a0ce-3cea-491f-9c10-48455d0551ad tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 0.9575346
May 20 04:29:01.174473 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [req-4b50bb13-5eed-4067-b22a-4332fc629b14 req-6e2e2d2d-b7bf-459b-a9db-ab914a7a69e7 service neutron] Request body: {'port': {'device_id': '9e9ac66e-ff2b-4295-8476-471c42fe11a5', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79091'}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:29:01.274067 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-de53e171-d0b1-446c-bc64-636545e6b9e8 None None] Provisioning for port 836b04fc-7e58-43e4-b4c9-054e40658569 completed by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:29:01.283624 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-de53e171-d0b1-446c-bc64-636545e6b9e8 None None] Provisioning complete for port 836b04fc-7e58-43e4-b4c9-054e40658569 triggered by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:29:01.284245 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-de53e171-d0b1-446c-bc64-636545e6b9e8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:01.350521 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-de53e171-d0b1-446c-bc64-636545e6b9e8 None None] Port 836b04fc-7e58-43e4-b4c9-054e40658569 cannot update to ACTIVE because it is not bound. {{(pid=91688) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 20 04:29:01.378616 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-4b50bb13-5eed-4067-b22a-4332fc629b14 req-6e2e2d2d-b7bf-459b-a9db-ab914a7a69e7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:01.452690 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c81fa123-57d5-444c-8023-3b7cf197bcbb req-827a54b3-4bca-40d7-b20f-2ac386dd7503 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:01.453306 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-c81fa123-57d5-444c-8023-3b7cf197bcbb req-827a54b3-4bca-40d7-b20f-2ac386dd7503 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Synchronizing usage tracker for tenant:9b6fb271a7a546a38b0c6df5beaf22fc on resource:port {{(pid=91687) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:29:01.513962 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-c81fa123-57d5-444c-8023-3b7cf197bcbb req-827a54b3-4bca-40d7-b20f-2ac386dd7503 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Unset dirty status for tenant:9b6fb271a7a546a38b0c6df5beaf22fc on resource:port {{(pid=91687) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:29:01.515157 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-c81fa123-57d5-444c-8023-3b7cf197bcbb req-827a54b3-4bca-40d7-b20f-2ac386dd7503 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/ports?device_id=9e9ac66e-ff2b-4295-8476-471c42fe11a5 HTTP/1.1" status: 200  len: 932 time: 0.2578409
May 20 04:29:01.697727 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-c81fa123-57d5-444c-8023-3b7cf197bcbb req-229042c4-a0c2-46f5-93b8-73dcc34805f2 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/security-groups?id=ef28d688-789b-4282-a30c-d7d731615fbf&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1764174
May 20 04:29:01.869831 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.notifiers.nova [req-4b50bb13-5eed-4067-b22a-4332fc629b14 req-6e2e2d2d-b7bf-459b-a9db-ab914a7a69e7 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 836b04fc-7e58-43e4-b4c9-054e40658569 {{(pid=91687) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 04:29:01.877824 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-4b50bb13-5eed-4067-b22a-4332fc629b14 req-6e2e2d2d-b7bf-459b-a9db-ab914a7a69e7 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:01.893820 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.provisioning_blocks [req-4b50bb13-5eed-4067-b22a-4332fc629b14 req-6e2e2d2d-b7bf-459b-a9db-ab914a7a69e7 service neutron] Transition to ACTIVE for port object 836b04fc-7e58-43e4-b4c9-054e40658569 will not be triggered until provisioned by entity L2. {{(pid=91687) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:29:01.898570 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-4b50bb13-5eed-4067-b22a-4332fc629b14 req-6e2e2d2d-b7bf-459b-a9db-ab914a7a69e7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4162185'] for port, after_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:01.902437 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-6daecb28-79ec-4470-93f6-87fc0cad101d service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:29:02.062500 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e2e2d2d-b7bf-459b-a9db-ab914a7a69e7 service neutron] Pushing event updated for resources: {'Port': ['ID=836b04fc-7e58-43e4-b4c9-054e40658569,revision_number=2']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:29:02.070623 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-6e2e2d2d-b7bf-459b-a9db-ab914a7a69e7 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.167s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:29:02.153751 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.managers [req-4b50bb13-5eed-4067-b22a-4332fc629b14 req-6e2e2d2d-b7bf-459b-a9db-ab914a7a69e7 service neutron] Attempting to bind port 836b04fc-7e58-43e4-b4c9-054e40658569 on host hv-cinder-79091 for vnic_type normal with profile  {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 04:29:02.154805 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.managers [req-4b50bb13-5eed-4067-b22a-4332fc629b14 req-6e2e2d2d-b7bf-459b-a9db-ab914a7a69e7 service neutron] Attempting to bind port 836b04fc-7e58-43e4-b4c9-054e40658569 by drivers openvswitch,hyperv on host hv-cinder-79091 at level 0 using segments [{'id': 'e9f32492-7a41-4dc9-bc94-b8bce4a8e65d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': '11c994a8-6ede-4290-84f0-71af466860db'}] {{(pid=91687) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 04:29:02.154805 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4b50bb13-5eed-4067-b22a-4332fc629b14 req-6e2e2d2d-b7bf-459b-a9db-ab914a7a69e7 service neutron] Attempting to bind port 836b04fc-7e58-43e4-b4c9-054e40658569 on network 11c994a8-6ede-4290-84f0-71af466860db {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:29:02.160818 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4b50bb13-5eed-4067-b22a-4332fc629b14 req-6e2e2d2d-b7bf-459b-a9db-ab914a7a69e7 service neutron] Port 836b04fc-7e58-43e4-b4c9-054e40658569 on network 11c994a8-6ede-4290-84f0-71af466860db not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79091 {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 20 04:29:02.161177 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4b50bb13-5eed-4067-b22a-4332fc629b14 req-6e2e2d2d-b7bf-459b-a9db-ab914a7a69e7 service neutron] Attempting to bind port 836b04fc-7e58-43e4-b4c9-054e40658569 on network 11c994a8-6ede-4290-84f0-71af466860db {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:29:02.167381 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4b50bb13-5eed-4067-b22a-4332fc629b14 req-6e2e2d2d-b7bf-459b-a9db-ab914a7a69e7 service neutron] Checking agent: {'id': '7cc947fd-92eb-4d43-ad6b-ea002afff217', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79091', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 4, 19, 34), 'started_at': datetime.datetime(2021, 5, 20, 4, 19, 34), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 4, 28, 37), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 04:29:02.167726 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4b50bb13-5eed-4067-b22a-4332fc629b14 req-6e2e2d2d-b7bf-459b-a9db-ab914a7a69e7 service neutron] Checking segment: {'id': 'e9f32492-7a41-4dc9-bc94-b8bce4a8e65d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': '11c994a8-6ede-4290-84f0-71af466860db'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91687) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:29:02.168120 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4b50bb13-5eed-4067-b22a-4332fc629b14 req-6e2e2d2d-b7bf-459b-a9db-ab914a7a69e7 service neutron] Bound using segment: {'id': 'e9f32492-7a41-4dc9-bc94-b8bce4a8e65d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': '11c994a8-6ede-4290-84f0-71af466860db'} {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 04:29:02.168559 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.managers [req-4b50bb13-5eed-4067-b22a-4332fc629b14 req-6e2e2d2d-b7bf-459b-a9db-ab914a7a69e7 service neutron] Bound port: 836b04fc-7e58-43e4-b4c9-054e40658569, host: hv-cinder-79091, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'e9f32492-7a41-4dc9-bc94-b8bce4a8e65d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': '11c994a8-6ede-4290-84f0-71af466860db'}}] {{(pid=91687) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 04:29:02.168910 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-4b50bb13-5eed-4067-b22a-4332fc629b14 req-6e2e2d2d-b7bf-459b-a9db-ab914a7a69e7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:02.284403 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [req-4b50bb13-5eed-4067-b22a-4332fc629b14 req-6e2e2d2d-b7bf-459b-a9db-ab914a7a69e7 service neutron] For port 836b04fc-7e58-43e4-b4c9-054e40658569, host hv-cinder-79091, cleared binding levels {{(pid=91687) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 04:29:02.288029 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [req-4b50bb13-5eed-4067-b22a-4332fc629b14 req-6e2e2d2d-b7bf-459b-a9db-ab914a7a69e7 service neutron] For port 836b04fc-7e58-43e4-b4c9-054e40658569, host hv-cinder-79091, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=836b04fc-7e58-43e4-b4c9-054e40658569,segment=NetworkSegment(e9f32492-7a41-4dc9-bc94-b8bce4a8e65d),segment_id=e9f32492-7a41-4dc9-bc94-b8bce4a8e65d)] {{(pid=91687) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 04:29:02.291924 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-4b50bb13-5eed-4067-b22a-4332fc629b14 req-6e2e2d2d-b7bf-459b-a9db-ab914a7a69e7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4162185'] for port, after_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:02.297116 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-3369a57a-25e6-45fe-8612-05a613184fb7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:29:02.355290 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b50bb13-5eed-4067-b22a-4332fc629b14 req-6e2e2d2d-b7bf-459b-a9db-ab914a7a69e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:02.355907 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-4b50bb13-5eed-4067-b22a-4332fc629b14 req-6e2e2d2d-b7bf-459b-a9db-ab914a7a69e7 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for port, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:02.357321 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4b50bb13-5eed-4067-b22a-4332fc629b14 req-6e2e2d2d-b7bf-459b-a9db-ab914a7a69e7 service neutron] 10.222.0.82 "PUT /v2.0/ports/836b04fc-7e58-43e4-b4c9-054e40658569 HTTP/1.1" status: 200  len: 1094 time: 1.1894376
May 20 04:29:02.357842 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9e9ac66e-ff2b-4295-8476-471c42fe11a5', 'tag': '836b04fc-7e58-43e4-b4c9-054e40658569'}] {{(pid=91687) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:29:02.391065 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e2e2d2d-b7bf-459b-a9db-ab914a7a69e7 service neutron] Pushing event updated for resources: {'Port': ['ID=836b04fc-7e58-43e4-b4c9-054e40658569,revision_number=3']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:29:02.395902 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-6e2e2d2d-b7bf-459b-a9db-ab914a7a69e7 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.099s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:29:02.414821 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9e9ac66e-ff2b-4295-8476-471c42fe11a5', 'tag': '836b04fc-7e58-43e4-b4c9-054e40658569', 'status': 'completed', 'code': 200}
May 20 04:29:02.515585 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b50bb13-5eed-4067-b22a-4332fc629b14 req-992ee5ea-ed81-401b-a99f-a9a982c21eee service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:02.517271 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4b50bb13-5eed-4067-b22a-4332fc629b14 req-992ee5ea-ed81-401b-a99f-a9a982c21eee service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=9b6fb271a7a546a38b0c6df5beaf22fc&device_id=9e9ac66e-ff2b-4295-8476-471c42fe11a5 HTTP/1.1" status: 200  len: 1097 time: 0.0814705
May 20 04:29:02.574526 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:02.604802 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4b50bb13-5eed-4067-b22a-4332fc629b14 req-9c0be115-9e11-4081-8431-92a5ebdccb8b service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=836b04fc-7e58-43e4-b4c9-054e40658569 HTTP/1.1" status: 200  len: 217 time: 0.0775290
May 20 04:29:02.677660 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b50bb13-5eed-4067-b22a-4332fc629b14 req-1c250edd-5dc6-446f-bf5d-fa54d00b3b27 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:02.679262 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4b50bb13-5eed-4067-b22a-4332fc629b14 req-1c250edd-5dc6-446f-bf5d-fa54d00b3b27 service neutron] 10.222.0.82 "GET /v2.0/subnets?id=51af45f1-449a-400c-8714-8d713d4a7993 HTTP/1.1" status: 200  len: 850 time: 0.0663364
May 20 04:29:02.686694 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-21144e82-9b20-4b46-8b92-b31f2b775f03 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:02.787454 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b50bb13-5eed-4067-b22a-4332fc629b14 req-4421298f-ba3c-4b54-9790-a3aa7d5d4578 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:02.789966 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4b50bb13-5eed-4067-b22a-4332fc629b14 req-4421298f-ba3c-4b54-9790-a3aa7d5d4578 service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=11c994a8-6ede-4290-84f0-71af466860db&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1030357
May 20 04:29:02.981939 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4b50bb13-5eed-4067-b22a-4332fc629b14 req-53139de9-4882-4013-93d6-5c45e157f440 service neutron] 10.222.0.82 "GET /v2.0/networks/11c994a8-6ede-4290-84f0-71af466860db?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1835117
May 20 04:29:02.994480 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b20fefb6-1d91-4e0c-b272-f36ab942aef1 req-c06be30c-f03a-41fc-8a25-db6854fff59c tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:02.995937 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-b20fefb6-1d91-4e0c-b272-f36ab942aef1 req-c06be30c-f03a-41fc-8a25-db6854fff59c tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/ports?device_id=9e9ac66e-ff2b-4295-8476-471c42fe11a5 HTTP/1.1" status: 200  len: 944 time: 0.1800456
May 20 04:29:03.133518 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-b20fefb6-1d91-4e0c-b272-f36ab942aef1 req-bb4218f7-f95d-4ed8-a94f-ae810bf7e0b3 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/security-groups?id=ef28d688-789b-4282-a30c-d7d731615fbf&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1155238
May 20 04:29:03.164749 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4b50bb13-5eed-4067-b22a-4332fc629b14 req-7c379579-1216-4e44-b836-a9ad019b6623 service neutron] 10.222.0.82 "GET /v2.0/networks/11c994a8-6ede-4290-84f0-71af466860db?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1678903
May 20 04:29:03.283533 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-450747df-7232-4285-881c-d053fe2a17a9 req-6ae39335-8c51-44f4-9315-81208ab9d803 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:03.285119 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-450747df-7232-4285-881c-d053fe2a17a9 req-6ae39335-8c51-44f4-9315-81208ab9d803 service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=9b6fb271a7a546a38b0c6df5beaf22fc&device_id=9e9ac66e-ff2b-4295-8476-471c42fe11a5 HTTP/1.1" status: 200  len: 1097 time: 0.0749850
May 20 04:29:03.341387 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ea4803bd-878f-47d5-9084-1ec41953c9db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:03.426365 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-450747df-7232-4285-881c-d053fe2a17a9 req-00f4fe7f-8926-43f3-b463-65eecde568ab service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:03.427811 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-450747df-7232-4285-881c-d053fe2a17a9 req-00f4fe7f-8926-43f3-b463-65eecde568ab service neutron] 10.222.0.82 "GET /v2.0/networks?id=11c994a8-6ede-4290-84f0-71af466860db HTTP/1.1" status: 200  len: 912 time: 0.1346653
May 20 04:29:03.579085 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-450747df-7232-4285-881c-d053fe2a17a9 req-289c035e-7847-4669-9835-5a3a9638bd8d service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=836b04fc-7e58-43e4-b4c9-054e40658569 HTTP/1.1" status: 200  len: 217 time: 0.1425593
May 20 04:29:03.642784 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-450747df-7232-4285-881c-d053fe2a17a9 req-6865774b-5e4b-45c0-bea4-8bac026f5776 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:03.644222 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-450747df-7232-4285-881c-d053fe2a17a9 req-6865774b-5e4b-45c0-bea4-8bac026f5776 service neutron] 10.222.0.82 "GET /v2.0/subnets?id=51af45f1-449a-400c-8714-8d713d4a7993 HTTP/1.1" status: 200  len: 850 time: 0.0578189
May 20 04:29:03.726986 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-450747df-7232-4285-881c-d053fe2a17a9 req-0d42066a-c077-4a93-b4ed-dfede2b58ca5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:03.728392 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-450747df-7232-4285-881c-d053fe2a17a9 req-0d42066a-c077-4a93-b4ed-dfede2b58ca5 service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=11c994a8-6ede-4290-84f0-71af466860db&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0762904
May 20 04:29:03.879131 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-450747df-7232-4285-881c-d053fe2a17a9 req-ab0f1874-da9f-4c05-bdbf-73047a6695fa service neutron] 10.222.0.82 "GET /v2.0/networks/11c994a8-6ede-4290-84f0-71af466860db?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1427050
May 20 04:29:04.071871 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-450747df-7232-4285-881c-d053fe2a17a9 req-cdc4ef5c-f2c9-41bd-9f57-dc92e6b3cba8 service neutron] 10.222.0.82 "GET /v2.0/networks/11c994a8-6ede-4290-84f0-71af466860db?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1848874
May 20 04:29:04.331672 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac0cdf78-e27c-4950-9a97-291f46037ff0 req-f5aeaa26-cfff-45e9-8762-8bb2fbb2603a tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:04.333124 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-ac0cdf78-e27c-4950-9a97-291f46037ff0 req-f5aeaa26-cfff-45e9-8762-8bb2fbb2603a tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/ports?device_id=9e9ac66e-ff2b-4295-8476-471c42fe11a5 HTTP/1.1" status: 200  len: 944 time: 0.0857079
May 20 04:29:04.380025 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-ac0cdf78-e27c-4950-9a97-291f46037ff0 req-bb5e65df-c7a7-4265-8caf-932b1c426041 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/security-groups?id=ef28d688-789b-4282-a30c-d7d731615fbf&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0409467
May 20 04:29:05.198834 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f21320cc-6a25-4ec1-8a32-8b119b35fd55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:05.575296 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-206660b1-6486-4135-b601-9c3ae2d42510 req-d7eb42b7-9aac-4890-842d-72767c17d44e tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:05.576885 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-206660b1-6486-4135-b601-9c3ae2d42510 req-d7eb42b7-9aac-4890-842d-72767c17d44e tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/ports?device_id=9e9ac66e-ff2b-4295-8476-471c42fe11a5 HTTP/1.1" status: 200  len: 944 time: 0.0857131
May 20 04:29:05.625597 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-206660b1-6486-4135-b601-9c3ae2d42510 req-323001c4-bbd9-4f0e-86fa-87806f7a433f tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/security-groups?id=ef28d688-789b-4282-a30c-d7d731615fbf&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0419965
May 20 04:29:06.559473 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:06.838548 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a17394b6-9243-4aa0-8632-23e9dbabda3c req-90201e09-f61f-4574-b55c-6438ab2634d2 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:06.840301 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-a17394b6-9243-4aa0-8632-23e9dbabda3c req-90201e09-f61f-4574-b55c-6438ab2634d2 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/ports?device_id=9e9ac66e-ff2b-4295-8476-471c42fe11a5 HTTP/1.1" status: 200  len: 944 time: 0.1026030
May 20 04:29:06.891743 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-a17394b6-9243-4aa0-8632-23e9dbabda3c req-08813e0b-39e9-4442-bcfb-d9eb9c3c2054 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/security-groups?id=ef28d688-789b-4282-a30c-d7d731615fbf&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0451050
May 20 04:29:08.100357 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f12e019-e9dc-474b-a532-23226fe155a0 req-6fa80515-9afa-4533-bb77-97791d38ac4d tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:08.101977 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-3f12e019-e9dc-474b-a532-23226fe155a0 req-6fa80515-9afa-4533-bb77-97791d38ac4d tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/ports?device_id=9e9ac66e-ff2b-4295-8476-471c42fe11a5 HTTP/1.1" status: 200  len: 944 time: 0.0896451
May 20 04:29:08.154574 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-3f12e019-e9dc-474b-a532-23226fe155a0 req-768a0e94-3c4b-4bed-9518-43cddac7987e tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/security-groups?id=ef28d688-789b-4282-a30c-d7d731615fbf&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0450599
May 20 04:29:08.908472 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 44842) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:29:09.040924 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-78ef474c-3bde-4bbb-9371-e13d80459504 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:09.056557 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-78ef474c-3bde-4bbb-9371-e13d80459504 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:29:09.060637 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-78ef474c-3bde-4bbb-9371-e13d80459504 admin admin] Usage tracker for resource:security_group_rule and tenant:556c2b9396ab40af8609d27d418b8783 is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:29:09.063922 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-78ef474c-3bde-4bbb-9371-e13d80459504 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:29:09.070882 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-78ef474c-3bde-4bbb-9371-e13d80459504 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:29:09.167277 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-78ef474c-3bde-4bbb-9371-e13d80459504 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:09.171708 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-78ef474c-3bde-4bbb-9371-e13d80459504 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:09.179073 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-4aa381c2-1b3b-4a81-b4ea-3731ff52692d tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:29:09.225001 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-78ef474c-3bde-4bbb-9371-e13d80459504 admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=556c2b9396ab40af8609d27d418b8783&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3150730
May 20 04:29:09.225511 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78ef474c-3bde-4bbb-9371-e13d80459504 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8c4c0861-5587-4b07-8f1e-1c3d650bdab8,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:29:09.228711 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 44852) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:29:09.232120 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-78ef474c-3bde-4bbb-9371-e13d80459504 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:29:09.297023 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-9c47e5f8-e62d-4603-9b09-74a4e2835048 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:09.325731 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-9c47e5f8-e62d-4603-9b09-74a4e2835048 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:09.349780 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84223d04-c1d6-4990-a685-3678237a4012 req-2b3c8e2d-318f-428d-92cd-ec1b43acdd5a tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:09.351338 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-84223d04-c1d6-4990-a685-3678237a4012 req-2b3c8e2d-318f-428d-92cd-ec1b43acdd5a tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/ports?device_id=9e9ac66e-ff2b-4295-8476-471c42fe11a5 HTTP/1.1" status: 200  len: 944 time: 0.0898893
May 20 04:29:09.387033 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-9c47e5f8-e62d-4603-9b09-74a4e2835048 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:09.392411 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-78ef474c-3bde-4bbb-9371-e13d80459504 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:29:09.406444 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c47e5f8-e62d-4603-9b09-74a4e2835048 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8c4c0861-5587-4b07-8f1e-1c3d650bdab8,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:29:09.409968 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-9c47e5f8-e62d-4603-9b09-74a4e2835048 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:29:09.410954 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-9c47e5f8-e62d-4603-9b09-74a4e2835048 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:09.411208 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-84223d04-c1d6-4990-a685-3678237a4012 req-75578a00-39d9-451a-98c5-ee304ecca418 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/security-groups?id=ef28d688-789b-4282-a30c-d7d731615fbf&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0524969
May 20 04:29:09.413429 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-9c47e5f8-e62d-4603-9b09-74a4e2835048 admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/8c4c0861-5587-4b07-8f1e-1c3d650bdab8 HTTP/1.1" status: 204  len: 168 time: 0.1836176
May 20 04:29:09.715759 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 44860) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:29:09.734009 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-abb57e17-d13d-471f-a746-4d52522cef47 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:09.750322 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-abb57e17-d13d-471f-a746-4d52522cef47 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:29:09.754267 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-abb57e17-d13d-471f-a746-4d52522cef47 admin admin] Usage tracker for resource:security_group_rule and tenant:f41ad447ee264c61b5349a63bd73c385 is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:29:09.757379 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-abb57e17-d13d-471f-a746-4d52522cef47 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:29:09.764521 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-abb57e17-d13d-471f-a746-4d52522cef47 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:29:09.849147 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-abb57e17-d13d-471f-a746-4d52522cef47 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:09.857623 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-abb57e17-d13d-471f-a746-4d52522cef47 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:09.870185 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-37028dd8-c098-4007-a72f-6724820d463e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:29:09.909419 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abb57e17-d13d-471f-a746-4d52522cef47 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=99527a51-fd24-484e-998a-e38387887147,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:29:09.913682 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-abb57e17-d13d-471f-a746-4d52522cef47 admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=f41ad447ee264c61b5349a63bd73c385&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1968193
May 20 04:29:09.914618 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-abb57e17-d13d-471f-a746-4d52522cef47 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:29:09.916636 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 44864) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:29:09.989898 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-7af4464e-587a-441f-b35f-36a71dad2ea6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:10.018803 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-7af4464e-587a-441f-b35f-36a71dad2ea6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:10.082493 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-7af4464e-587a-441f-b35f-36a71dad2ea6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:10.086646 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-951d4382-c92b-4291-b3db-cd6886cd7d2f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:29:10.098403 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7af4464e-587a-441f-b35f-36a71dad2ea6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=99527a51-fd24-484e-998a-e38387887147,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:29:10.103307 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-7af4464e-587a-441f-b35f-36a71dad2ea6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:29:10.105994 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-7af4464e-587a-441f-b35f-36a71dad2ea6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:10.107989 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-7af4464e-587a-441f-b35f-36a71dad2ea6 admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/99527a51-fd24-484e-998a-e38387887147 HTTP/1.1" status: 204  len: 168 time: 0.1903250
May 20 04:29:10.557331 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be27dbda-5df0-4957-9cc5-5b49c12bfe56 req-b682cb4d-17a9-432e-be0a-e5873bc8d104 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:10.559115 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-be27dbda-5df0-4957-9cc5-5b49c12bfe56 req-b682cb4d-17a9-432e-be0a-e5873bc8d104 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 947 time: 0.0941010
May 20 04:29:10.612034 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-be27dbda-5df0-4957-9cc5-5b49c12bfe56 req-602f17b4-ec90-42c9-9505-8b3cdbe35262 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0464168
May 20 04:29:10.646229 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44270157-3594-485d-b33c-e296e5c06eb4 req-6bfabe8a-1f52-4f7f-be13-40685c1b38cf tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:10.647792 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-44270157-3594-485d-b33c-e296e5c06eb4 req-6bfabe8a-1f52-4f7f-be13-40685c1b38cf tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/ports?device_id=9e9ac66e-ff2b-4295-8476-471c42fe11a5 HTTP/1.1" status: 200  len: 944 time: 0.0939755
May 20 04:29:10.700802 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-44270157-3594-485d-b33c-e296e5c06eb4 req-1f244904-6a79-49cf-852a-22ad19600810 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/security-groups?id=ef28d688-789b-4282-a30c-d7d731615fbf&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0436711
May 20 04:29:11.175778 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 836b04fc-7e58-43e4-b4c9-054e40658569 details requested by agent hyperv_hv-cinder-79091 with host hv-cinder-79091 {{(pid=91688) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 20 04:29:11.310635 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port 836b04fc-7e58-43e4-b4c9-054e40658569, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=836b04fc-7e58-43e4-b4c9-054e40658569,segment=NetworkSegment(e9f32492-7a41-4dc9-bc94-b8bce4a8e65d),segment_id=e9f32492-7a41-4dc9-bc94-b8bce4a8e65d)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:29:11.326476 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Returning: {'device': '836b04fc-7e58-43e4-b4c9-054e40658569', 'network_id': '11c994a8-6ede-4290-84f0-71af466860db', 'port_id': '836b04fc-7e58-43e4-b4c9-054e40658569', 'mac_address': 'fa:16:3e:4d:e0:01', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 874, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '51af45f1-449a-400c-8714-8d713d4a7993', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91688) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 20 04:29:11.415682 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:11.435782 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.notifiers.nova [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 836b04fc-7e58-43e4-b4c9-054e40658569 {{(pid=91688) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 04:29:11.452088 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port 836b04fc-7e58-43e4-b4c9-054e40658569, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=836b04fc-7e58-43e4-b4c9-054e40658569,segment=NetworkSegment(e9f32492-7a41-4dc9-bc94-b8bce4a8e65d),segment_id=e9f32492-7a41-4dc9-bc94-b8bce4a8e65d)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:29:11.457434 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:11.459382 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:29:11.526730 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Pushing event updated for resources: {'Port': ['ID=836b04fc-7e58-43e4-b4c9-054e40658569,revision_number=4']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:29:11.535088 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:29:11.535418 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:29:11.535770 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:29:11.536131 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:29:11.536452 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:29:11.536780 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:29:11.537129 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:29:11.537528 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:29:11.537854 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:29:11.538167 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:29:11.538618 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:29:11.538980 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:29:11.542990 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:29:11.828989 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d9da172-8621-40a1-8dd4-b9791c134664 req-f66a02fe-dc0f-4d28-aa63-fba2501eec50 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:11.830451 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-1d9da172-8621-40a1-8dd4-b9791c134664 req-f66a02fe-dc0f-4d28-aa63-fba2501eec50 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 947 time: 0.0983508
May 20 04:29:11.881510 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-1d9da172-8621-40a1-8dd4-b9791c134664 req-ac01197d-3860-4a56-ab8a-753bfb014da0 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0420063
May 20 04:29:11.890195 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] get_ports_and_sgs() called for port_ids ['836b04fc-7e58-43e4-b4c9-054e40658569'] {{(pid=91688) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 04:29:11.903724 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dec95a98-6fd1-411c-945e-535c932321be req-a8da4476-46e7-407a-90b5-4738d04c2cc7 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:11.905258 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-dec95a98-6fd1-411c-945e-535c932321be req-a8da4476-46e7-407a-90b5-4738d04c2cc7 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/ports?device_id=9e9ac66e-ff2b-4295-8476-471c42fe11a5 HTTP/1.1" status: 200  len: 945 time: 0.0911045
May 20 04:29:11.957824 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-dec95a98-6fd1-411c-945e-535c932321be req-34e34181-69cb-43aa-9cd8-c74585dea11b tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/security-groups?id=ef28d688-789b-4282-a30c-d7d731615fbf&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0447960
May 20 04:29:12.364069 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e36a9e72-6e2e-4b16-92d8-1a6b677cc759 req-76ddd6c8-bef0-45df-aa32-6a7144bed578 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:12.365623 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-e36a9e72-6e2e-4b16-92d8-1a6b677cc759 req-76ddd6c8-bef0-45df-aa32-6a7144bed578 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.82 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 947 time: 0.0816004
May 20 04:29:12.518801 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [req-e36a9e72-6e2e-4b16-92d8-1a6b677cc759 req-1aab6326-7f06-4478-a24a-f3f670e7f8a9 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Deleting port 115e1bac-cc4d-40b5-b860-798c85c78924 {{(pid=91687) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 04:29:12.519148 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-e36a9e72-6e2e-4b16-92d8-1a6b677cc759 req-1aab6326-7f06-4478-a24a-f3f670e7f8a9 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8782892520551'] for port, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:12.561435 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 44950) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:29:12.663225 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [req-e36a9e72-6e2e-4b16-92d8-1a6b677cc759 req-1aab6326-7f06-4478-a24a-f3f670e7f8a9 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] For port 115e1bac-cc4d-40b5-b860-798c85c78924, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=115e1bac-cc4d-40b5-b860-798c85c78924,segment=NetworkSegment(9521f383-6017-4b4d-9f47-cff4ed54cb57),segment_id=9521f383-6017-4b4d-9f47-cff4ed54cb57)] {{(pid=91687) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:29:12.664110 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-e36a9e72-6e2e-4b16-92d8-1a6b677cc759 req-1aab6326-7f06-4478-a24a-f3f670e7f8a9 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1718922'] for port, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:12.706806 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-5b09fe5d-596c-4b15-8be8-9b6e068c3125 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:12.723257 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-5b09fe5d-596c-4b15-8be8-9b6e068c3125 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:29:12.728448 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-5b09fe5d-596c-4b15-8be8-9b6e068c3125 admin admin] Usage tracker for resource:security_group_rule and tenant:d245de23dbe2484d9e1a07335008f8f2 is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:29:12.733072 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-5b09fe5d-596c-4b15-8be8-9b6e068c3125 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:29:12.739955 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-5b09fe5d-596c-4b15-8be8-9b6e068c3125 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:29:12.845469 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-5b09fe5d-596c-4b15-8be8-9b6e068c3125 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:12.851272 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-5b09fe5d-596c-4b15-8be8-9b6e068c3125 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:12.861215 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-f85f1d60-6fc4-4ab2-a61a-5fa49fbf303d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:29:12.913113 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-5b09fe5d-596c-4b15-8be8-9b6e068c3125 admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=d245de23dbe2484d9e1a07335008f8f2&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3502729
May 20 04:29:12.916501 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 44956) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:29:12.942967 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b09fe5d-596c-4b15-8be8-9b6e068c3125 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b1f6fa26-5fec-4f4d-8307-1f14c5993243,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:29:12.962346 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b09fe5d-596c-4b15-8be8-9b6e068c3125 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:29:12.962995 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b09fe5d-596c-4b15-8be8-9b6e068c3125 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:29:12.963367 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b09fe5d-596c-4b15-8be8-9b6e068c3125 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:29:12.963734 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b09fe5d-596c-4b15-8be8-9b6e068c3125 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:29:12.964094 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b09fe5d-596c-4b15-8be8-9b6e068c3125 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:29:12.964451 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b09fe5d-596c-4b15-8be8-9b6e068c3125 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:29:12.964806 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b09fe5d-596c-4b15-8be8-9b6e068c3125 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:29:12.965189 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b09fe5d-596c-4b15-8be8-9b6e068c3125 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:29:12.965541 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b09fe5d-596c-4b15-8be8-9b6e068c3125 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:29:12.965895 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b09fe5d-596c-4b15-8be8-9b6e068c3125 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:29:12.966249 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b09fe5d-596c-4b15-8be8-9b6e068c3125 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:29:12.966591 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b09fe5d-596c-4b15-8be8-9b6e068c3125 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:29:12.977616 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-5b09fe5d-596c-4b15-8be8-9b6e068c3125 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.116s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:29:13.006375 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-a7b238af-9c3c-4e62-b0ca-a75f79f9596c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:13.082764 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-a7b238af-9c3c-4e62-b0ca-a75f79f9596c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:13.145893 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22385963-d51c-40f8-833c-0cd174954a6e req-b5ed0f01-6a49-44a8-b434-35c9bfe41f60 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:13.147424 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-22385963-d51c-40f8-833c-0cd174954a6e req-b5ed0f01-6a49-44a8-b434-35c9bfe41f60 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 947 time: 0.1314933
May 20 04:29:13.163805 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-e36a9e72-6e2e-4b16-92d8-1a6b677cc759 req-1aab6326-7f06-4478-a24a-f3f670e7f8a9 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks [] for floatingip, precommit_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:13.164398 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-e36a9e72-6e2e-4b16-92d8-1a6b677cc759 req-1aab6326-7f06-4478-a24a-f3f670e7f8a9 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1716406'] for floatingip, after_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:13.164516 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.db.l3_db [req-e36a9e72-6e2e-4b16-92d8-1a6b677cc759 req-1aab6326-7f06-4478-a24a-f3f670e7f8a9 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Floating IP d48a0309-c834-4503-947b-c46dcd773365 disassociated. External IP: 172.27.1.199, port: 115e1bac-cc4d-40b5-b860-798c85c78924.
May 20 04:29:13.164769 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [req-e36a9e72-6e2e-4b16-92d8-1a6b677cc759 req-1aab6326-7f06-4478-a24a-f3f670e7f8a9 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Calling delete_port for 115e1bac-cc4d-40b5-b860-798c85c78924 owned by compute:nova {{(pid=91687) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 04:29:13.175783 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-a7b238af-9c3c-4e62-b0ca-a75f79f9596c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:13.178564 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 836b04fc-7e58-43e4-b4c9-054e40658569 up at agent hyperv_hv-cinder-79091 {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:29:13.183304 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-4da51bc3-aed5-496d-a21f-a873c65c5cae admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:29:13.206071 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7b238af-9c3c-4e62-b0ca-a75f79f9596c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b1f6fa26-5fec-4f4d-8307-1f14c5993243,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:29:13.209547 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d85841cf-6155-4a11-8673-351d9dc2b828 req-76aa4edf-96bd-485d-8276-a2550c495275 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:13.211163 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-d85841cf-6155-4a11-8673-351d9dc2b828 req-76aa4edf-96bd-485d-8276-a2550c495275 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/ports?device_id=9e9ac66e-ff2b-4295-8476-471c42fe11a5 HTTP/1.1" status: 200  len: 945 time: 0.1248248
May 20 04:29:13.215830 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-a7b238af-9c3c-4e62-b0ca-a75f79f9596c admin admin] Notify callbacks [] for security_group, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:13.216984 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-a7b238af-9c3c-4e62-b0ca-a75f79f9596c admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/b1f6fa26-5fec-4f4d-8307-1f14c5993243 HTTP/1.1" status: 204  len: 168 time: 0.2995102
May 20 04:29:13.218174 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-a7b238af-9c3c-4e62-b0ca-a75f79f9596c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.035s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:29:13.226880 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-22385963-d51c-40f8-833c-0cd174954a6e req-f29671e8-6835-4541-bcb6-0b16d4f9eb0a tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=4cd34759-6d12-41a3-acb1-798752999d4f&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0721278
May 20 04:29:13.277416 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-d85841cf-6155-4a11-8673-351d9dc2b828 req-879d9ffe-5891-4ad7-a9cf-cca4a3109462 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/security-groups?id=ef28d688-789b-4282-a30c-d7d731615fbf&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0581141
May 20 04:29:13.291603 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Provisioning for port 836b04fc-7e58-43e4-b4c9-054e40658569 completed by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:29:13.296662 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Provisioning complete for port 836b04fc-7e58-43e4-b4c9-054e40658569 triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:29:13.297191 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:13.352737 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-e36a9e72-6e2e-4b16-92d8-1a6b677cc759 req-1aab6326-7f06-4478-a24a-f3f670e7f8a9 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8782892522936', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8782892108804', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4162192'] for port, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:13.359238 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-f86d71df-99fb-4a16-904e-60c0046a6848 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:29:13.405846 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1aab6326-7f06-4478-a24a-f3f670e7f8a9 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Pushing event deleted for resources: {'Port': ['ID=115e1bac-cc4d-40b5-b860-798c85c78924,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:29:13.414513 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-1aab6326-7f06-4478-a24a-f3f670e7f8a9 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:29:13.416288 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:13.447115 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9e9ac66e-ff2b-4295-8476-471c42fe11a5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '836b04fc-7e58-43e4-b4c9-054e40658569'}] {{(pid=91688) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:29:13.458027 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port 836b04fc-7e58-43e4-b4c9-054e40658569, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=836b04fc-7e58-43e4-b4c9-054e40658569,segment=NetworkSegment(e9f32492-7a41-4dc9-bc94-b8bce4a8e65d),segment_id=e9f32492-7a41-4dc9-bc94-b8bce4a8e65d)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:29:13.463608 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:13.464920 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 115e1bac-cc4d-40b5-b860-798c85c78924 no longer exists at agent hyperv_hv-cinder-79091 {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 04:29:13.500633 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:29:13.536556 dv-cinder-790910-4-iscsi neutron-server[91688]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9e9ac66e-ff2b-4295-8476-471c42fe11a5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '836b04fc-7e58-43e4-b4c9-054e40658569', 'code': 200}
May 20 04:29:13.547743 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] No Port match for: 115e1bac-cc4d-40b5-b860-798c85c78924 {{(pid=91688) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 04:29:13.548443 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 115e1bac-cc4d-40b5-b860-798c85c78924 not bound to the agent host hv-cinder-79091 {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 04:29:13.584840 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Pushing event updated for resources: {'Port': ['ID=836b04fc-7e58-43e4-b4c9-054e40658569,revision_number=5']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:29:13.588186 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:29:13.606765 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 44970) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:29:13.627498 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.l3_agent_scheduler [req-e36a9e72-6e2e-4b16-92d8-1a6b677cc759 req-1aab6326-7f06-4478-a24a-f3f670e7f8a9 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Router 34eeb764-2607-4d9f-96c4-89598b702500 has already been hosted by L3 agent 02733fc0-fc9c-4e29-bc03-c27a792d539d {{(pid=91687) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 04:29:13.627951 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-5260e29b-4e55-446d-ae40-b76f04444937 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:13.645373 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-5260e29b-4e55-446d-ae40-b76f04444937 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:29:13.650581 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-5260e29b-4e55-446d-ae40-b76f04444937 admin admin] Usage tracker for resource:security_group_rule and tenant:ab73fff4b3fe4caea93e6b8cbf4f95c0 is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:29:13.653993 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-5260e29b-4e55-446d-ae40-b76f04444937 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:29:13.660905 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-5260e29b-4e55-446d-ae40-b76f04444937 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:29:13.755714 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-5260e29b-4e55-446d-ae40-b76f04444937 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:13.760505 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-5260e29b-4e55-446d-ae40-b76f04444937 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:13.769140 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-3eeb7c69-a479-4662-953d-5c4df50b73c9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:29:13.816181 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-5260e29b-4e55-446d-ae40-b76f04444937 admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=ab73fff4b3fe4caea93e6b8cbf4f95c0&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2082670
May 20 04:29:13.817174 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5260e29b-4e55-446d-ae40-b76f04444937 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=96110f6e-ad09-4f35-9ce6-49ceae43f78b,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:29:13.819543 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 44974) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:29:13.822217 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-5260e29b-4e55-446d-ae40-b76f04444937 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:29:13.888675 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-7af536cd-255d-48bb-82dd-c8830d137aac admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:13.918803 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-7af536cd-255d-48bb-82dd-c8830d137aac admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:13.949112 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-e36a9e72-6e2e-4b16-92d8-1a6b677cc759 req-1aab6326-7f06-4478-a24a-f3f670e7f8a9 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify agent at l3_agent.dv-cinder-790910-4-iscsi the message routers_updated {{(pid=91687) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 04:29:13.982742 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1a046312-d860-46e1-b033-4c34349e9881 None None] Sync routers for ids ['34eeb764-2607-4d9f-96c4-89598b702500'] in dv-cinder-790910-4-iscsi {{(pid=91688) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 04:29:13.994335 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-7af536cd-255d-48bb-82dd-c8830d137aac admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:14.002400 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-be853623-7992-45c6-a175-fb5a026a89e8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:29:14.008108 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1a046312-d860-46e1-b033-4c34349e9881 None None] Routers {'34eeb764-2607-4d9f-96c4-89598b702500'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91688) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:29:14.009084 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-1a046312-d860-46e1-b033-4c34349e9881 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced0ab0070>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:29:03Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['34eeb764-2607-4d9f-96c4-89598b702500'], 'active': True} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:29:14.019904 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7af536cd-255d-48bb-82dd-c8830d137aac admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=96110f6e-ad09-4f35-9ce6-49ceae43f78b,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:29:14.036985 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-7af536cd-255d-48bb-82dd-c8830d137aac admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:29:14.042972 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-7af536cd-255d-48bb-82dd-c8830d137aac admin admin] Notify callbacks [] for security_group, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:14.045127 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-7af536cd-255d-48bb-82dd-c8830d137aac admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/96110f6e-ad09-4f35-9ce6-49ceae43f78b HTTP/1.1" status: 204  len: 168 time: 0.2244799
May 20 04:29:14.062882 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-224886c4-9ce0-4039-a337-586a24ab293c req-e33011d2-3ba4-4d8b-a5db-3516819c5d89 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:14.064369 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-224886c4-9ce0-4039-a337-586a24ab293c req-e33011d2-3ba4-4d8b-a5db-3516819c5d89 service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=9e9ac66e-ff2b-4295-8476-471c42fe11a5 HTTP/1.1" status: 200  len: 1099 time: 0.3324986
May 20 04:29:14.065390 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.l3_dvrscheduler_db [req-e36a9e72-6e2e-4b16-92d8-1a6b677cc759 req-1aab6326-7f06-4478-a24a-f3f670e7f8a9 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] No DVR routers for this DVR port 115e1bac-cc4d-40b5-b860-798c85c78924 on host hv-cinder-79091 {{(pid=91687) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 04:29:14.068057 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-e36a9e72-6e2e-4b16-92d8-1a6b677cc759 req-1aab6326-7f06-4478-a24a-f3f670e7f8a9 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for port, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:14.070995 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f32b55e5-d82f-4c9e-a67f-08d83c24cf4d', 'name': 'network-vif-deleted', 'tag': '115e1bac-cc4d-40b5-b860-798c85c78924'}] {{(pid=91687) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:29:14.126747 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-224886c4-9ce0-4039-a337-586a24ab293c req-69567db9-24fd-42c4-bc14-cfa6119f55fc service neutron] 10.222.0.82 "GET /v2.0/security-groups?id=ef28d688-789b-4282-a30c-d7d731615fbf&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0507598
May 20 04:29:14.128222 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-e36a9e72-6e2e-4b16-92d8-1a6b677cc759 req-1aab6326-7f06-4478-a24a-f3f670e7f8a9 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.82 "DELETE /v2.0/ports/115e1bac-cc4d-40b5-b860-798c85c78924 HTTP/1.1" status: 204  len: 173 time: 1.7567179
May 20 04:29:14.149056 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f32b55e5-d82f-4c9e-a67f-08d83c24cf4d', 'name': 'network-vif-deleted', 'tag': '115e1bac-cc4d-40b5-b860-798c85c78924', 'status': 'completed', 'code': 200}
May 20 04:29:14.230681 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvr_db [None req-1a046312-d860-46e1-b033-4c34349e9881 None None] Set router 34eeb764-2607-4d9f-96c4-89598b702500 gateway port host: dv-cinder-790910-4-iscsi {{(pid=91688) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:29:14.429309 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-046a8a6c-7d2a-4e4b-ae4d-68c1e9603d8b req-dab4e12e-9fec-4473-84e4-9115e5c300b6 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=f32b55e5-d82f-4c9e-a67f-08d83c24cf4d HTTP/1.1" status: 200  len: 210 time: 0.0606015
May 20 04:29:14.561566 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91144971-6b1b-4d78-bc1a-ab41a3d02115 req-fe73805b-cb2e-4d45-8870-18c130306365 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:14.563308 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-91144971-6b1b-4d78-bc1a-ab41a3d02115 req-fe73805b-cb2e-4d45-8870-18c130306365 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/ports?device_id=9e9ac66e-ff2b-4295-8476-471c42fe11a5 HTTP/1.1" status: 200  len: 946 time: 0.0937316
May 20 04:29:14.621997 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-91144971-6b1b-4d78-bc1a-ab41a3d02115 req-b218d0e1-fe0c-4f1d-9145-94280139c9b8 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/security-groups?id=ef28d688-789b-4282-a30c-d7d731615fbf&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0509741
May 20 04:29:14.642728 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-1a046312-d860-46e1-b033-4c34349e9881 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced0ab0070>, [{'id': '34eeb764-2607-4d9f-96c4-89598b702500', 'name': 'tempest-AttachVolumeShelveTestJSON-1895235554-router', 'tenant_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.72'}], 'enable_snat': True}, 'gw_port_id': '16508f6e-35a3-4301-9018-78e099969b00', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:21:10Z', 'updated_at': '2021-05-20T04:21:20Z', 'revision_number': 4, 'project_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'gw_port': {'id': '16508f6e-35a3-4301-9018-78e099969b00', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:e3:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '34eeb764-2607-4d9f-96c4-89598b702500', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:21:12Z', 'updated_at': '2021-05-20T04:21:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_interfaces': [{'id': 'aad390e4-f9e2-4bbe-9e64-7b390cc7f3b3', 'name': '', 'network_id': '21794e86-fda7-40a6-a5a8-db117c7eeb9d', 'tenant_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'mac_address': 'fa:16:3e:b2:b9:f0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '34eeb764-2607-4d9f-96c4-89598b702500', 'device_owner': 'network:router_interface', 'standard_attr_id': 88, 'fixed_ips': [{'subnet_id': '06f38702-3d3c-4e25-8f84-85483d1ddf28', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:21:18Z', 'updated_at': '2021-05-20T04:21:40Z', 'revision_number': 5, 'project_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'subnets': [{'id': '06f38702-3d3c-4e25-8f84-85483d1ddf28', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:29:14.646747 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1a046312-d860-46e1-b033-4c34349e9881 None None] Checking router: 34eeb764-2607-4d9f-96c4-89598b702500 for host: dv-cinder-790910-4-iscsi {{(pid=91688) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 04:29:14.655806 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1a046312-d860-46e1-b033-4c34349e9881 None None] Routers {'34eeb764-2607-4d9f-96c4-89598b702500'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91688) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:29:14.656978 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-1a046312-d860-46e1-b033-4c34349e9881 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced0ab0070>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:29:03Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['34eeb764-2607-4d9f-96c4-89598b702500'], 'active': True} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:29:14.863692 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvr_db [None req-1a046312-d860-46e1-b033-4c34349e9881 None None] Set router 34eeb764-2607-4d9f-96c4-89598b702500 gateway port host: dv-cinder-790910-4-iscsi {{(pid=91688) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:29:15.324927 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-1a046312-d860-46e1-b033-4c34349e9881 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced0ab0070>, [{'id': '34eeb764-2607-4d9f-96c4-89598b702500', 'name': 'tempest-AttachVolumeShelveTestJSON-1895235554-router', 'tenant_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.72'}], 'enable_snat': True}, 'gw_port_id': '16508f6e-35a3-4301-9018-78e099969b00', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:21:10Z', 'updated_at': '2021-05-20T04:21:20Z', 'revision_number': 4, 'project_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'gw_port': {'id': '16508f6e-35a3-4301-9018-78e099969b00', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:e3:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '34eeb764-2607-4d9f-96c4-89598b702500', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:21:12Z', 'updated_at': '2021-05-20T04:21:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_interfaces': [{'id': 'aad390e4-f9e2-4bbe-9e64-7b390cc7f3b3', 'name': '', 'network_id': '21794e86-fda7-40a6-a5a8-db117c7eeb9d', 'tenant_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'mac_address': 'fa:16:3e:b2:b9:f0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '34eeb764-2607-4d9f-96c4-89598b702500', 'device_owner': 'network:router_interface', 'standard_attr_id': 88, 'fixed_ips': [{'subnet_id': '06f38702-3d3c-4e25-8f84-85483d1ddf28', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:21:18Z', 'updated_at': '2021-05-20T04:21:40Z', 'revision_number': 5, 'project_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'subnets': [{'id': '06f38702-3d3c-4e25-8f84-85483d1ddf28', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:29:15.331238 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1a046312-d860-46e1-b033-4c34349e9881 None None] The sync data for ids ['34eeb764-2607-4d9f-96c4-89598b702500'] in dv-cinder-790910-4-iscsi is: [{'id': '34eeb764-2607-4d9f-96c4-89598b702500', 'name': 'tempest-AttachVolumeShelveTestJSON-1895235554-router', 'tenant_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.72'}], 'enable_snat': True}, 'gw_port_id': '16508f6e-35a3-4301-9018-78e099969b00', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:21:10Z', 'updated_at': '2021-05-20T04:21:20Z', 'revision_number': 4, 'project_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'gw_port': {'id': '16508f6e-35a3-4301-9018-78e099969b00', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:e3:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '34eeb764-2607-4d9f-96c4-89598b702500', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:21:12Z', 'updated_at': '2021-05-20T04:21:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_interfaces': [{'id': 'aad390e4-f9e2-4bbe-9e64-7b390cc7f3b3', 'name': '', 'network_id': '21794e86-fda7-40a6-a5a8-db117c7eeb9d', 'tenant_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'mac_address': 'fa:16:3e:b2:b9:f0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '34eeb764-2607-4d9f-96c4-89598b702500', 'device_owner': 'network:router_interface', 'standard_attr_id': 88, 'fixed_ips': [{'subnet_id': '06f38702-3d3c-4e25-8f84-85483d1ddf28', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:21:18Z', 'updated_at': '2021-05-20T04:21:40Z', 'revision_number': 5, 'project_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'subnets': [{'id': '06f38702-3d3c-4e25-8f84-85483d1ddf28', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91688) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 04:29:15.573138 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 45016) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:29:15.639955 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 45022) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:29:15.649663 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-680affab-34a1-4fe5-bf8e-6a22155ee394 None None] New status for floating IP d48a0309-c834-4503-947b-c46dcd773365: DOWN {{(pid=91689) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 20 04:29:15.657639 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-455c28ad-6d2c-4db6-a100-0cdf03000539 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks [] for security_group, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:15.688591 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-455c28ad-6d2c-4db6-a100-0cdf03000539 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks [] for security_group, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:15.771653 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-455c28ad-6d2c-4db6-a100-0cdf03000539 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:15.777057 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-f4ed59d7-c8b6-4b08-99b0-e1502cb2603a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:29:15.797198 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-455c28ad-6d2c-4db6-a100-0cdf03000539 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=4cd34759-6d12-41a3-acb1-798752999d4f,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:29:15.799941 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-455c28ad-6d2c-4db6-a100-0cdf03000539 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:29:15.814811 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-455c28ad-6d2c-4db6-a100-0cdf03000539 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks [] for security_group, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:15.819868 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-455c28ad-6d2c-4db6-a100-0cdf03000539 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "DELETE /v2.0/security-groups/4cd34759-6d12-41a3-acb1-798752999d4f HTTP/1.1" status: 204  len: 168 time: 0.2454586
May 20 04:29:15.820514 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 45028) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:29:15.854508 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-d38ce2fb-0bb8-4b86-a292-df13d86b16cc admin admin] Notify callbacks [] for security_group, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:15.874872 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-d38ce2fb-0bb8-4b86-a292-df13d86b16cc admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:29:15.879963 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-d38ce2fb-0bb8-4b86-a292-df13d86b16cc admin admin] Usage tracker for resource:security_group_rule and tenant:17f2d0a8720945249bfca8a512091852 is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:29:15.882984 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.api.v2.resource [None req-230bb30f-5d92-4c26-bd72-2ea76b152b45 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] show failed (client error): The resource could not be found.
May 20 04:29:15.886481 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-230bb30f-5d92-4c26-bd72-2ea76b152b45 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups/4cd34759-6d12-41a3-acb1-798752999d4f HTTP/1.1" status: 404  len: 347 time: 0.0646112
May 20 04:29:15.887055 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 45032) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:29:15.887658 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-d38ce2fb-0bb8-4b86-a292-df13d86b16cc admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:29:15.896057 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-d38ce2fb-0bb8-4b86-a292-df13d86b16cc admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:29:16.023629 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-d38ce2fb-0bb8-4b86-a292-df13d86b16cc admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:16.030485 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-d38ce2fb-0bb8-4b86-a292-df13d86b16cc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:16.040539 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:29:16.084873 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-d38ce2fb-0bb8-4b86-a292-df13d86b16cc admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=17f2d0a8720945249bfca8a512091852&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4403656
May 20 04:29:16.085753 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 45036) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:29:16.088675 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d38ce2fb-0bb8-4b86-a292-df13d86b16cc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9ad7705f-78a8-4292-bf61-ec42c548d7ef,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:29:16.101376 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-d38ce2fb-0bb8-4b86-a292-df13d86b16cc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:29:16.153546 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-b2176008-7920-4564-836e-9db413016b6b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:16.179818 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-b2176008-7920-4564-836e-9db413016b6b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:16.233309 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f70b91b-c88d-4759-a38f-d74bf1c6702b req-c6f78ae8-0193-48fa-97c0-c65bbb3247df tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:16.235131 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-3f70b91b-c88d-4759-a38f-d74bf1c6702b req-c6f78ae8-0193-48fa-97c0-c65bbb3247df tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/ports?device_id=9e9ac66e-ff2b-4295-8476-471c42fe11a5 HTTP/1.1" status: 200  len: 946 time: 0.3956473
May 20 04:29:16.237895 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-b2176008-7920-4564-836e-9db413016b6b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:16.243178 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-3f9b5bad-b0b8-4729-bb73-473e91de1191 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:29:16.253895 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2176008-7920-4564-836e-9db413016b6b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9ad7705f-78a8-4292-bf61-ec42c548d7ef,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:29:16.256478 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-b2176008-7920-4564-836e-9db413016b6b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.013s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:29:16.262476 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-b2176008-7920-4564-836e-9db413016b6b admin admin] Notify callbacks [] for security_group, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:16.266457 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-b2176008-7920-4564-836e-9db413016b6b admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/9ad7705f-78a8-4292-bf61-ec42c548d7ef HTTP/1.1" status: 204  len: 168 time: 0.1771176
May 20 04:29:16.284685 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.plugin [None req-a3f55178-d9b5-4254-9472-eb9ee27c7aaa tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Deleting port 45825bf1-08bb-4366-9e8e-1a2c04255a18 {{(pid=91686) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 04:29:16.285076 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-a3f55178-d9b5-4254-9472-eb9ee27c7aaa tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8782892520551'] for port, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:16.303298 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-3f70b91b-c88d-4759-a38f-d74bf1c6702b req-6717dc32-a0a3-4d3b-bb5a-c7c0e3b76270 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/security-groups?id=ef28d688-789b-4282-a30c-d7d731615fbf&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0619707
May 20 04:29:16.414169 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-a3f55178-d9b5-4254-9472-eb9ee27c7aaa tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1718922'] for port, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:16.414564 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-a3f55178-d9b5-4254-9472-eb9ee27c7aaa tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:16.537423 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36056efe-4af1-4748-92e0-0177a03ab13c req-56a4011a-4853-4715-b730-6820a3819007 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:16.540290 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-36056efe-4af1-4748-92e0-0177a03ab13c req-56a4011a-4853-4715-b730-6820a3819007 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/ports?device_id=9e9ac66e-ff2b-4295-8476-471c42fe11a5 HTTP/1.1" status: 200  len: 946 time: 0.1275403
May 20 04:29:16.569667 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.plugin [None req-a3f55178-d9b5-4254-9472-eb9ee27c7aaa tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Calling delete_port for 45825bf1-08bb-4366-9e8e-1a2c04255a18 owned by network:floatingip {{(pid=91686) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 04:29:16.599909 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-36056efe-4af1-4748-92e0-0177a03ab13c req-5f1855e5-3ce2-4d68-8dca-1e4299803698 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/security-groups?id=ef28d688-789b-4282-a30c-d7d731615fbf&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0532010
May 20 04:29:16.629511 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 45050) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:29:16.778988 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-a3f55178-d9b5-4254-9472-eb9ee27c7aaa tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8782892522936', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8782892108804', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2145052'] for port, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:16.785825 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-09871fe5-a064-470b-975b-e10431460f4f tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:29:16.837378 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3f55178-d9b5-4254-9472-eb9ee27c7aaa tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Pushing event deleted for resources: {'Port': ['ID=45825bf1-08bb-4366-9e8e-1a2c04255a18,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:29:16.871136 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-a3f55178-d9b5-4254-9472-eb9ee27c7aaa tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:29:16.946759 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-a3f55178-d9b5-4254-9472-eb9ee27c7aaa tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks [] for floatingip, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:16.963280 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-a3f55178-d9b5-4254-9472-eb9ee27c7aaa tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for floatingip, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:16.964768 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-a3f55178-d9b5-4254-9472-eb9ee27c7aaa tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "DELETE /v2.0/floatingips/d48a0309-c834-4503-947b-c46dcd773365 HTTP/1.1" status: 204  len: 168 time: 1.0715296
May 20 04:29:17.015566 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ed0434c8-9bb9-4978-b315-566f28776067 tempest-TestVolumeBootPattern-89884506 tempest-TestVolumeBootPattern-89884506-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:17.016916 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-ed0434c8-9bb9-4978-b315-566f28776067 tempest-TestVolumeBootPattern-89884506 tempest-TestVolumeBootPattern-89884506-project-admin] Synchronizing usage tracker for tenant:9cdc6335963a47e384b2530ced2a9b80 on resource:port {{(pid=91687) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:29:17.045999 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-ed0434c8-9bb9-4978-b315-566f28776067 tempest-TestVolumeBootPattern-89884506 tempest-TestVolumeBootPattern-89884506-project-admin] Unset dirty status for tenant:9cdc6335963a47e384b2530ced2a9b80 on resource:port {{(pid=91687) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:29:17.047666 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-ed0434c8-9bb9-4978-b315-566f28776067 tempest-TestVolumeBootPattern-89884506 tempest-TestVolumeBootPattern-89884506-project-admin] 10.222.0.71 "GET /v2.0/ports?device_id=9e9ac66e-ff2b-4295-8476-471c42fe11a5 HTTP/1.1" status: 200  len: 1094 time: 0.4167387
May 20 04:29:17.050490 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 45070) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:29:17.056606 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.v2.base [None req-44b3366a-cabd-41a6-95ca-a39afcf09098 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Request body: {'floatingip': {'floating_network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'port_id': '836b04fc-7e58-43e4-b4c9-054e40658569', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'fixed_ip_address': '172.20.0.10'}} {{(pid=91686) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:29:17.064742 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-44b3366a-cabd-41a6-95ca-a39afcf09098 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:29:17.070756 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-44b3366a-cabd-41a6-95ca-a39afcf09098 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Usage tracker for resource:floatingip and tenant:9b6fb271a7a546a38b0c6df5beaf22fc is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:29:17.073832 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-44b3366a-cabd-41a6-95ca-a39afcf09098 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:29:17.084367 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-44b3366a-cabd-41a6-95ca-a39afcf09098 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:29:17.096010 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-44b3366a-cabd-41a6-95ca-a39afcf09098 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks [] for floatingip, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:17.250781 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-44b3366a-cabd-41a6-95ca-a39afcf09098 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:17.269175 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 45078) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:29:17.278143 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [None req-8e411f1f-6d21-4191-b98f-035f54eb780e tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Request body: {'security_group': {'name': 'tempest-securitygroup--171923539', 'description': 'tempest-description--887805971'}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:29:17.286966 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-8e411f1f-6d21-4191-b98f-035f54eb780e tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:29:17.292192 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-8e411f1f-6d21-4191-b98f-035f54eb780e tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Usage tracker for resource:security_group and tenant:ef3bec4745b14484ac8e21cd16cbd11d is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:29:17.295163 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-8e411f1f-6d21-4191-b98f-035f54eb780e tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:29:17.301370 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-8e411f1f-6d21-4191-b98f-035f54eb780e tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:29:17.321859 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-8e411f1f-6d21-4191-b98f-035f54eb780e tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks [] for security_group, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:17.346387 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-8e411f1f-6d21-4191-b98f-035f54eb780e tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:29:17.350513 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-8e411f1f-6d21-4191-b98f-035f54eb780e tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Usage tracker for resource:security_group_rule and tenant:ef3bec4745b14484ac8e21cd16cbd11d is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:29:17.354417 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-8e411f1f-6d21-4191-b98f-035f54eb780e tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:29:17.361174 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-8e411f1f-6d21-4191-b98f-035f54eb780e tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:29:17.416814 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.db_base_plugin_common [None req-44b3366a-cabd-41a6-95ca-a39afcf09098 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Allocated IP 172.27.1.94 (aec557db-0c02-4008-8c9f-2efcd7462f90/217f4b55-4415-4d57-8b43-2ff4c8ac8e81/811ff955-b742-4cfa-95a2-ecf312186b70) {{(pid=91686) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 04:29:17.546779 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-8e411f1f-6d21-4191-b98f-035f54eb780e tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks [] for security_group, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:17.551165 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-8e411f1f-6d21-4191-b98f-035f54eb780e tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:17.556475 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-7af4464e-587a-441f-b35f-36a71dad2ea6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:29:17.588211 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-44b3366a-cabd-41a6-95ca-a39afcf09098 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks [] for port, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:17.600200 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e411f1f-6d21-4191-b98f-035f54eb780e tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Pushing event updated for resources: {'SecurityGroup': ['ID=35bf24dc-8716-4edf-9f4f-f9d97739d7ef,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:29:17.603058 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-8e411f1f-6d21-4191-b98f-035f54eb780e tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:29:17.603930 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-8e411f1f-6d21-4191-b98f-035f54eb780e tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks [] for security_group, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:17.608392 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-8e411f1f-6d21-4191-b98f-035f54eb780e tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1778 time: 0.3376582
May 20 04:29:17.608675 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 45082) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:29:17.615775 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.v2.base [None req-4794d716-6870-4865-85fa-057ed91e056f tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Request body: {'security_group_rule': {'security_group_id': '35bf24dc-8716-4edf-9f4f-f9d97739d7ef', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=91686) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:29:17.623786 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-4794d716-6870-4865-85fa-057ed91e056f tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:29:17.629077 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-4794d716-6870-4865-85fa-057ed91e056f tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Usage tracker for resource:security_group_rule and tenant:ef3bec4745b14484ac8e21cd16cbd11d is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:29:17.632684 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-4794d716-6870-4865-85fa-057ed91e056f tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:29:17.639292 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-4794d716-6870-4865-85fa-057ed91e056f tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:29:17.644864 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-44b3366a-cabd-41a6-95ca-a39afcf09098 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8782892106231', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2145052'] for port, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:17.650772 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-d4420ce5-551e-4faf-a49e-dda3d9cfacd1 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:29:17.723552 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-44b3366a-cabd-41a6-95ca-a39afcf09098 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Network aec557db-0c02-4008-8c9f-2efcd7462f90 is already hosted by enough agents. {{(pid=91686) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:29:17.727024 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.base_scheduler [None req-44b3366a-cabd-41a6-95ca-a39afcf09098 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Resources bound (agent type, host, resource id):  {{(pid=91686) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:29:17.728849 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-4794d716-6870-4865-85fa-057ed91e056f tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:17.740007 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.l3_dvrscheduler_db [None req-44b3366a-cabd-41a6-95ca-a39afcf09098 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Received port after_create {{(pid=91686) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 04:29:17.798802 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44b3366a-cabd-41a6-95ca-a39afcf09098 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Pushing event updated for resources: {'Port': ['ID=811ff955-b742-4cfa-95a2-ecf312186b70,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:29:17.809005 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-44b3366a-cabd-41a6-95ca-a39afcf09098 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.158s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:29:17.991977 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-4794d716-6870-4865-85fa-057ed91e056f tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:17.997988 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-4794d716-6870-4865-85fa-057ed91e056f tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1597377'] for security_group_rule, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:18.031876 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:29:18.064530 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4794d716-6870-4865-85fa-057ed91e056f tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=cd43f854-8e21-4676-95d2-24c81a56c230,revision_number=0']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:29:18.078406 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-4794d716-6870-4865-85fa-057ed91e056f tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:29:18.152626 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-4794d716-6870-4865-85fa-057ed91e056f tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:18.154525 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-4794d716-6870-4865-85fa-057ed91e056f tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.5445499
May 20 04:29:18.158471 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 45090) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:29:18.163845 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [None req-7687cbdf-a170-4030-bd0c-0c75af694b7e tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Request body: {'security_group_rule': {'security_group_id': '35bf24dc-8716-4edf-9f4f-f9d97739d7ef', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:29:18.169880 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-7687cbdf-a170-4030-bd0c-0c75af694b7e tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:29:18.174215 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-7687cbdf-a170-4030-bd0c-0c75af694b7e tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Usage tracker for resource:security_group_rule and tenant:ef3bec4745b14484ac8e21cd16cbd11d is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:29:18.177488 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-7687cbdf-a170-4030-bd0c-0c75af694b7e tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:29:18.184781 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-7687cbdf-a170-4030-bd0c-0c75af694b7e tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:29:18.200533 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-7687cbdf-a170-4030-bd0c-0c75af694b7e tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:18.272163 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-7687cbdf-a170-4030-bd0c-0c75af694b7e tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:18.277375 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-7687cbdf-a170-4030-bd0c-0c75af694b7e tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1597377'] for security_group_rule, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:18.279941 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-0ce1bdfe-2fff-446f-80e7-96c5997b8c61 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:29:18.301833 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7687cbdf-a170-4030-bd0c-0c75af694b7e tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9bc901dd-d828-43bf-919f-cbd223e62136,revision_number=0']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:29:18.306335 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-7687cbdf-a170-4030-bd0c-0c75af694b7e tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:29:18.316094 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-7687cbdf-a170-4030-bd0c-0c75af694b7e tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:18.317259 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-7687cbdf-a170-4030-bd0c-0c75af694b7e tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.1577983
May 20 04:29:18.320872 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 45094) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:29:18.326794 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [None req-cc1c2c2f-505a-46d5-be79-e4ba34ae4dcb tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Request body: {'floatingip': {'floating_network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90'}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:29:18.332886 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-cc1c2c2f-505a-46d5-be79-e4ba34ae4dcb tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:29:18.337118 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-cc1c2c2f-505a-46d5-be79-e4ba34ae4dcb tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Usage tracker for resource:floatingip and tenant:ef3bec4745b14484ac8e21cd16cbd11d is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:29:18.340134 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-cc1c2c2f-505a-46d5-be79-e4ba34ae4dcb tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:29:18.346024 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-cc1c2c2f-505a-46d5-be79-e4ba34ae4dcb tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:29:18.357355 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-cc1c2c2f-505a-46d5-be79-e4ba34ae4dcb tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks [] for floatingip, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:18.366693 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-44b3366a-cabd-41a6-95ca-a39afcf09098 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks [] for floatingip, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:18.445945 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-44b3366a-cabd-41a6-95ca-a39afcf09098 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:18.500696 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-cc1c2c2f-505a-46d5-be79-e4ba34ae4dcb tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:18.665785 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.db_base_plugin_common [None req-cc1c2c2f-505a-46d5-be79-e4ba34ae4dcb tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Allocated IP 172.27.1.20 (aec557db-0c02-4008-8c9f-2efcd7462f90/217f4b55-4415-4d57-8b43-2ff4c8ac8e81/d2673de2-37f6-4de1-beee-81535239ad2a) {{(pid=91687) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 04:29:18.686314 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-44b3366a-cabd-41a6-95ca-a39afcf09098 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks [] for port, precommit_update {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:18.691532 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-44b3366a-cabd-41a6-95ca-a39afcf09098 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2145029'] for port, after_update {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:18.695616 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:29:18.820082 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-44b3366a-cabd-41a6-95ca-a39afcf09098 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1716406'] for floatingip, after_update {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:18.848741 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-cc1c2c2f-505a-46d5-be79-e4ba34ae4dcb tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks [] for port, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:18.890245 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44b3366a-cabd-41a6-95ca-a39afcf09098 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Pushing event updated for resources: {'Port': ['ID=811ff955-b742-4cfa-95a2-ecf312186b70,revision_number=2']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:29:18.893656 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-44b3366a-cabd-41a6-95ca-a39afcf09098 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.198s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:29:18.896382 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-cc1c2c2f-505a-46d5-be79-e4ba34ae4dcb tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8782892106231', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4162192'] for port, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:18.901015 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-71df8bfe-0c3a-425e-9898-7df2eca67a37 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:29:18.974214 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cc1c2c2f-505a-46d5-be79-e4ba34ae4dcb tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Network aec557db-0c02-4008-8c9f-2efcd7462f90 is already hosted by enough agents. {{(pid=91687) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:29:18.977401 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.base_scheduler [None req-cc1c2c2f-505a-46d5-be79-e4ba34ae4dcb tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Resources bound (agent type, host, resource id):  {{(pid=91687) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:29:18.982836 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cc1c2c2f-505a-46d5-be79-e4ba34ae4dcb tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Received port after_create {{(pid=91687) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 04:29:19.008097 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc1c2c2f-505a-46d5-be79-e4ba34ae4dcb tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Pushing event updated for resources: {'Port': ['ID=d2673de2-37f6-4de1-beee-81535239ad2a,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:29:19.014087 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-cc1c2c2f-505a-46d5-be79-e4ba34ae4dcb tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:29:19.029906 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.db.l3_db [None req-44b3366a-cabd-41a6-95ca-a39afcf09098 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Floating IP b7dc02ef-f6f6-4ccf-a40c-5f698f78e6e5 associated. External IP: 172.27.1.94, port: 836b04fc-7e58-43e4-b4c9-054e40658569.
May 20 04:29:19.114562 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-cc1c2c2f-505a-46d5-be79-e4ba34ae4dcb tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks [] for floatingip, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:19.187134 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-cc1c2c2f-505a-46d5-be79-e4ba34ae4dcb tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:19.409396 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-cc1c2c2f-505a-46d5-be79-e4ba34ae4dcb tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks [] for port, precommit_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:19.417294 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-cc1c2c2f-505a-46d5-be79-e4ba34ae4dcb tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4162185'] for port, after_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:19.421338 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-44b3366a-cabd-41a6-95ca-a39afcf09098 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Router a7f66c4d-6b4f-4053-bd69-e1bea7db4c61 has already been hosted by L3 agent 02733fc0-fc9c-4e29-bc03-c27a792d539d {{(pid=91686) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 04:29:19.423702 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-a0717b7b-9c8d-4b0f-b43a-dbc08a748ec8 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:29:19.604764 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc1c2c2f-505a-46d5-be79-e4ba34ae4dcb tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Pushing event updated for resources: {'Port': ['ID=d2673de2-37f6-4de1-beee-81535239ad2a,revision_number=2']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:29:19.611949 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-cc1c2c2f-505a-46d5-be79-e4ba34ae4dcb tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.188s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:29:19.626371 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-cc1c2c2f-505a-46d5-be79-e4ba34ae4dcb tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1716406'] for floatingip, after_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:19.662061 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-cc1c2c2f-505a-46d5-be79-e4ba34ae4dcb tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for floatingip, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:19.663283 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-cc1c2c2f-505a-46d5-be79-e4ba34ae4dcb tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 692 time: 1.3414335
May 20 04:29:19.796804 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-44b3366a-cabd-41a6-95ca-a39afcf09098 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify agent at l3_agent.dv-cinder-790910-4-iscsi the message routers_updated {{(pid=91686) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 04:29:19.809957 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-62b60769-bd5e-477e-affe-7eaaf6af8e98 None None] Sync routers for ids ['a7f66c4d-6b4f-4053-bd69-e1bea7db4c61'] in dv-cinder-790910-4-iscsi {{(pid=91688) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 04:29:19.822175 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-62b60769-bd5e-477e-affe-7eaaf6af8e98 None None] Routers {'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91688) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:29:19.822925 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-62b60769-bd5e-477e-affe-7eaaf6af8e98 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced16a2f40>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:29:03Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['a7f66c4d-6b4f-4053-bd69-e1bea7db4c61'], 'active': True} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:29:19.823564 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-44b3366a-cabd-41a6-95ca-a39afcf09098 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for floatingip, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:19.888375 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-44b3366a-cabd-41a6-95ca-a39afcf09098 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 996 time: 2.8365798
May 20 04:29:19.889348 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9e9ac66e-ff2b-4295-8476-471c42fe11a5', 'tag': '836b04fc-7e58-43e4-b4c9-054e40658569'}] {{(pid=91686) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:29:19.912847 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-ca088f47-c98b-4101-b9da-cbbbe6124f5f req-9493ce81-80bb-4211-a060-22dfc198c0f9 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Synchronizing usage tracker for tenant:ef3bec4745b14484ac8e21cd16cbd11d on resource:security_group {{(pid=91687) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:29:19.931693 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-ca088f47-c98b-4101-b9da-cbbbe6124f5f req-9493ce81-80bb-4211-a060-22dfc198c0f9 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Unset dirty status for tenant:ef3bec4745b14484ac8e21cd16cbd11d on resource:security_group {{(pid=91687) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:29:19.933468 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-ca088f47-c98b-4101-b9da-cbbbe6124f5f req-9493ce81-80bb-4211-a060-22dfc198c0f9 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?name=tempest-securitygroup--171923539&fields=id&tenant_id=ef3bec4745b14484ac8e21cd16cbd11d HTTP/1.1" status: 200  len: 267 time: 0.0764837
May 20 04:29:20.053852 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvr_db [None req-62b60769-bd5e-477e-affe-7eaaf6af8e98 None None] Set router a7f66c4d-6b4f-4053-bd69-e1bea7db4c61 gateway port host: dv-cinder-790910-4-iscsi {{(pid=91688) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:29:20.108204 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca088f47-c98b-4101-b9da-cbbbe6124f5f req-020e57cf-8cc8-4e73-bb75-bb3fe0d6f8cf tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:20.109941 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-ca088f47-c98b-4101-b9da-cbbbe6124f5f req-020e57cf-8cc8-4e73-bb75-bb3fe0d6f8cf tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/networks?id=21794e86-fda7-40a6-a5a8-db117c7eeb9d HTTP/1.1" status: 200  len: 817 time: 0.1695452
May 20 04:29:20.126541 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-ca088f47-c98b-4101-b9da-cbbbe6124f5f req-7da482f5-e28d-4121-8986-4a572ac1a422 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/quotas/ef3bec4745b14484ac8e21cd16cbd11d HTTP/1.1" status: 200  len: 375 time: 0.0109401
May 20 04:29:20.139630 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9e9ac66e-ff2b-4295-8476-471c42fe11a5', 'tag': '836b04fc-7e58-43e4-b4c9-054e40658569', 'status': 'completed', 'code': 200}
May 20 04:29:20.222292 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-ca088f47-c98b-4101-b9da-cbbbe6124f5f req-849262ff-b696-4562-9728-0ae6e36619d3 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Synchronizing usage tracker for tenant:ef3bec4745b14484ac8e21cd16cbd11d on resource:port {{(pid=91687) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:29:20.242117 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-ca088f47-c98b-4101-b9da-cbbbe6124f5f req-849262ff-b696-4562-9728-0ae6e36619d3 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Unset dirty status for tenant:ef3bec4745b14484ac8e21cd16cbd11d on resource:port {{(pid=91687) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:29:20.243611 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-ca088f47-c98b-4101-b9da-cbbbe6124f5f req-849262ff-b696-4562-9728-0ae6e36619d3 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?tenant_id=ef3bec4745b14484ac8e21cd16cbd11d&fields=id HTTP/1.1" status: 200  len: 348 time: 0.1108718
May 20 04:29:20.423503 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-ca088f47-c98b-4101-b9da-cbbbe6124f5f req-5dfb8c2b-26a4-4e94-9ffb-3ef1b879fc05 service neutron] 10.222.0.71 "GET /v2.0/networks/21794e86-fda7-40a6-a5a8-db117c7eeb9d?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1567614
May 20 04:29:20.506534 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-62b60769-bd5e-477e-affe-7eaaf6af8e98 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced16a2f40>, [{'id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'name': 'tempest-TestVolumeBootPattern-857163320-router', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.91'}], 'enable_snat': True}, 'gw_port_id': '866cc6c0-5986-4eb4-8827-b255811a13de', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:28:09Z', 'updated_at': '2021-05-20T04:28:12Z', 'revision_number': 4, 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'gw_port': {'id': '866cc6c0-5986-4eb4-8827-b255811a13de', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:f5:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'device_owner': 'network:router_gateway', 'standard_attr_id': 511, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:28:09Z', 'updated_at': '2021-05-20T04:28:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_floatingips': [{'id': 'b7dc02ef-f6f6-4ccf-a40c-5f698f78e6e5', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'floating_ip_address': '172.27.1.94', 'floating_network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'router_id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'port_id': '836b04fc-7e58-43e4-b4c9-054e40658569', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 586, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '11c994a8-6ede-4290-84f0-71af466860db', 'mac_address': 'fa:16:3e:4d:e0:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e9ac66e-ff2b-4295-8476-471c42fe11a5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T04:29:18Z', 'updated_at': '2021-05-20T04:29:18Z', 'revision_number': 0, 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0bcb5c14-319d-4871-bef1-50d60ad3f5b8', 'name': '', 'network_id': '11c994a8-6ede-4290-84f0-71af466860db', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'mac_address': 'fa:16:3e:2c:84:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'device_owner': 'network:router_interface', 'standard_attr_id': 512, 'fixed_ips': [{'subnet_id': '51af45f1-449a-400c-8714-8d713d4a7993', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:28:12Z', 'updated_at': '2021-05-20T04:28:19Z', 'revision_number': 5, 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'subnets': [{'id': '51af45f1-449a-400c-8714-8d713d4a7993', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:29:20.511126 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-62b60769-bd5e-477e-affe-7eaaf6af8e98 None None] Checking router: a7f66c4d-6b4f-4053-bd69-e1bea7db4c61 for host: dv-cinder-790910-4-iscsi {{(pid=91688) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 04:29:20.520665 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-62b60769-bd5e-477e-affe-7eaaf6af8e98 None None] Routers {'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91688) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:29:20.521311 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-62b60769-bd5e-477e-affe-7eaaf6af8e98 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced16a2f40>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:29:03Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['a7f66c4d-6b4f-4053-bd69-e1bea7db4c61'], 'active': True} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:29:20.646260 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-ca088f47-c98b-4101-b9da-cbbbe6124f5f req-f16bc3e5-c90e-4b59-9a13-f157b1a709c0 service neutron] 10.222.0.71 "GET /v2.0/networks/21794e86-fda7-40a6-a5a8-db117c7eeb9d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2162852
May 20 04:29:20.717105 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvr_db [None req-62b60769-bd5e-477e-affe-7eaaf6af8e98 None None] Set router a7f66c4d-6b4f-4053-bd69-e1bea7db4c61 gateway port host: dv-cinder-790910-4-iscsi {{(pid=91688) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:29:20.879198 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [req-ad1394da-de34-4a85-8585-464eb7926f8a req-5adb93eb-971c-421a-b5f8-88b6c421e955 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Synchronizing usage tracker for tenant:ef3bec4745b14484ac8e21cd16cbd11d on resource:port {{(pid=91686) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:29:20.892358 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [req-ad1394da-de34-4a85-8585-464eb7926f8a req-5adb93eb-971c-421a-b5f8-88b6c421e955 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Unset dirty status for tenant:ef3bec4745b14484ac8e21cd16cbd11d on resource:port {{(pid=91686) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:29:20.901214 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-ad1394da-de34-4a85-8585-464eb7926f8a req-5adb93eb-971c-421a-b5f8-88b6c421e955 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 210 time: 0.0705340
May 20 04:29:21.107041 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-62b60769-bd5e-477e-affe-7eaaf6af8e98 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced16a2f40>, [{'id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'name': 'tempest-TestVolumeBootPattern-857163320-router', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.91'}], 'enable_snat': True}, 'gw_port_id': '866cc6c0-5986-4eb4-8827-b255811a13de', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:28:09Z', 'updated_at': '2021-05-20T04:28:12Z', 'revision_number': 4, 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'gw_port': {'id': '866cc6c0-5986-4eb4-8827-b255811a13de', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:f5:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'device_owner': 'network:router_gateway', 'standard_attr_id': 511, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:28:09Z', 'updated_at': '2021-05-20T04:28:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_floatingips': [{'id': 'b7dc02ef-f6f6-4ccf-a40c-5f698f78e6e5', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'floating_ip_address': '172.27.1.94', 'floating_network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'router_id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'port_id': '836b04fc-7e58-43e4-b4c9-054e40658569', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 586, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '11c994a8-6ede-4290-84f0-71af466860db', 'mac_address': 'fa:16:3e:4d:e0:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e9ac66e-ff2b-4295-8476-471c42fe11a5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T04:29:18Z', 'updated_at': '2021-05-20T04:29:18Z', 'revision_number': 0, 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0bcb5c14-319d-4871-bef1-50d60ad3f5b8', 'name': '', 'network_id': '11c994a8-6ede-4290-84f0-71af466860db', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'mac_address': 'fa:16:3e:2c:84:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'device_owner': 'network:router_interface', 'standard_attr_id': 512, 'fixed_ips': [{'subnet_id': '51af45f1-449a-400c-8714-8d713d4a7993', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:28:12Z', 'updated_at': '2021-05-20T04:28:19Z', 'revision_number': 5, 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'subnets': [{'id': '51af45f1-449a-400c-8714-8d713d4a7993', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:29:21.111322 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-62b60769-bd5e-477e-affe-7eaaf6af8e98 None None] The sync data for ids ['a7f66c4d-6b4f-4053-bd69-e1bea7db4c61'] in dv-cinder-790910-4-iscsi is: [{'id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'name': 'tempest-TestVolumeBootPattern-857163320-router', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.91'}], 'enable_snat': True}, 'gw_port_id': '866cc6c0-5986-4eb4-8827-b255811a13de', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:28:09Z', 'updated_at': '2021-05-20T04:28:12Z', 'revision_number': 4, 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'gw_port': {'id': '866cc6c0-5986-4eb4-8827-b255811a13de', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:f5:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'device_owner': 'network:router_gateway', 'standard_attr_id': 511, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:28:09Z', 'updated_at': '2021-05-20T04:28:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_floatingips': [{'id': 'b7dc02ef-f6f6-4ccf-a40c-5f698f78e6e5', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'floating_ip_address': '172.27.1.94', 'floating_network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'router_id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'port_id': '836b04fc-7e58-43e4-b4c9-054e40658569', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 586, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '11c994a8-6ede-4290-84f0-71af466860db', 'mac_address': 'fa:16:3e:4d:e0:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e9ac66e-ff2b-4295-8476-471c42fe11a5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T04:29:18Z', 'updated_at': '2021-05-20T04:29:18Z', 'revision_number': 0, 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0bcb5c14-319d-4871-bef1-50d60ad3f5b8', 'name': '', 'network_id': '11c994a8-6ede-4290-84f0-71af466860db', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'mac_address': 'fa:16:3e:2c:84:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'device_owner': 'network:router_interface', 'standard_attr_id': 512, 'fixed_ips': [{'subnet_id': '51af45f1-449a-400c-8714-8d713d4a7993', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:28:12Z', 'updated_at': '2021-05-20T04:28:19Z', 'revision_number': 5, 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'subnets': [{'id': '51af45f1-449a-400c-8714-8d713d4a7993', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91688) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 04:29:21.317890 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b7bc44fc-9f4e-489e-b915-140cb592e777 None None] New status for floating IP b7dc02ef-f6f6-4ccf-a40c-5f698f78e6e5: ACTIVE {{(pid=91689) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 20 04:29:22.084836 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-bb74dc1e-38ca-496c-9ba3-f8717370b9d0 req-3e66ee64-7cbf-4c38-8856-ce609f5fec27 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 210 time: 0.0475883
May 20 04:29:22.114529 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b8aea91-59f0-40c6-9592-827e8a80a873 req-facf53c7-f4e2-4ee3-bd78-525759b3a266 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:22.116005 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-6b8aea91-59f0-40c6-9592-827e8a80a873 req-facf53c7-f4e2-4ee3-bd78-525759b3a266 service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=9b6fb271a7a546a38b0c6df5beaf22fc&device_id=9e9ac66e-ff2b-4295-8476-471c42fe11a5 HTTP/1.1" status: 200  len: 1099 time: 0.1355979
May 20 04:29:23.243839 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-8489d061-7a43-4490-996d-0348b2e1201d req-a0521e2a-c49e-4162-adc4-1f06efb0a2bd tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 210 time: 0.0436566
May 20 04:29:23.543346 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b8aea91-59f0-40c6-9592-827e8a80a873 req-d04dd45c-a279-42f3-8a08-4d72c2a71fa5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:23.545039 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-6b8aea91-59f0-40c6-9592-827e8a80a873 req-d04dd45c-a279-42f3-8a08-4d72c2a71fa5 service neutron] 10.222.0.82 "GET /v2.0/networks?id=11c994a8-6ede-4290-84f0-71af466860db HTTP/1.1" status: 200  len: 912 time: 0.1318369
May 20 04:29:23.656716 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-6b8aea91-59f0-40c6-9592-827e8a80a873 req-ea254339-a260-4521-a8c7-f45d50dc149b service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=836b04fc-7e58-43e4-b4c9-054e40658569 HTTP/1.1" status: 200  len: 1001 time: 0.1038001
May 20 04:29:23.725615 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b8aea91-59f0-40c6-9592-827e8a80a873 req-7cd81a25-df68-45a3-9a83-49821f0b7760 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:23.727064 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-6b8aea91-59f0-40c6-9592-827e8a80a873 req-7cd81a25-df68-45a3-9a83-49821f0b7760 service neutron] 10.222.0.82 "GET /v2.0/subnets?id=51af45f1-449a-400c-8714-8d713d4a7993 HTTP/1.1" status: 200  len: 850 time: 0.0633261
May 20 04:29:23.804928 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b8aea91-59f0-40c6-9592-827e8a80a873 req-bbbd9dc8-4ba6-44e8-b359-37d298ab2a11 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:23.806358 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-6b8aea91-59f0-40c6-9592-827e8a80a873 req-bbbd9dc8-4ba6-44e8-b359-37d298ab2a11 service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=11c994a8-6ede-4290-84f0-71af466860db&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0715566
May 20 04:29:23.939636 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-6b8aea91-59f0-40c6-9592-827e8a80a873 req-b4206a82-6e94-4ceb-a468-ada60036e71c service neutron] 10.222.0.82 "GET /v2.0/networks/11c994a8-6ede-4290-84f0-71af466860db?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1252787
May 20 04:29:24.169755 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-6b8aea91-59f0-40c6-9592-827e8a80a873 req-a90790fb-39cc-4a4f-a0ad-ccdc8085da29 service neutron] 10.222.0.82 "GET /v2.0/networks/11c994a8-6ede-4290-84f0-71af466860db?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2234938
May 20 04:29:24.199563 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca088f47-c98b-4101-b9da-cbbbe6124f5f req-ee976139-9ed7-4131-8cee-d6b99e9cdc49 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:24.200991 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-ca088f47-c98b-4101-b9da-cbbbe6124f5f req-ee976139-9ed7-4131-8cee-d6b99e9cdc49 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.82 "GET /v2.0/networks?id=21794e86-fda7-40a6-a5a8-db117c7eeb9d HTTP/1.1" status: 200  len: 817 time: 0.1749513
May 20 04:29:24.250862 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-ca088f47-c98b-4101-b9da-cbbbe6124f5f req-254650a4-5d94-4e45-93bc-b2964df746d5 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.82 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=ef3bec4745b14484ac8e21cd16cbd11d HTTP/1.1" status: 200  len: 379 time: 0.0411751
May 20 04:29:24.263302 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [req-ca088f47-c98b-4101-b9da-cbbbe6124f5f req-5b0ac852-a377-43c1-999b-db2de911388d tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Request body: {'port': {'device_id': '7925b833-d836-40d7-81b2-48717d6da34b', 'network_id': '21794e86-fda7-40a6-a5a8-db117c7eeb9d', 'admin_state_up': True, 'tenant_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'security_groups': ['35bf24dc-8716-4edf-9f4f-f9d97739d7ef']}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:29:24.413962 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-85397be0-2abd-4be5-a09c-1c0cd070abd2 req-77ef03b9-a723-4a4a-bc46-f8759e05cf97 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 210 time: 0.0514786
May 20 04:29:24.452318 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [req-ca088f47-c98b-4101-b9da-cbbbe6124f5f req-5b0ac852-a377-43c1-999b-db2de911388d tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:29:24.462619 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [req-ca088f47-c98b-4101-b9da-cbbbe6124f5f req-5b0ac852-a377-43c1-999b-db2de911388d tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:29:24.472922 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ca088f47-c98b-4101-b9da-cbbbe6124f5f req-5b0ac852-a377-43c1-999b-db2de911388d tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Made reservation on behalf of ef3bec4745b14484ac8e21cd16cbd11d for: {'port': 1} {{(pid=91687) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 04:29:24.476433 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-ca088f47-c98b-4101-b9da-cbbbe6124f5f req-5b0ac852-a377-43c1-999b-db2de911388d tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:24.643864 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.db_base_plugin_common [req-ca088f47-c98b-4101-b9da-cbbbe6124f5f req-5b0ac852-a377-43c1-999b-db2de911388d tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Allocated IP 172.20.0.11 (21794e86-fda7-40a6-a5a8-db117c7eeb9d/06f38702-3d3c-4e25-8f84-85483d1ddf28/1cc416ab-7f60-449e-8b91-113111ff4aa3) {{(pid=91687) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 04:29:24.945831 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-ca088f47-c98b-4101-b9da-cbbbe6124f5f req-5b0ac852-a377-43c1-999b-db2de911388d tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks [] for port, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:24.960074 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.provisioning_blocks [req-ca088f47-c98b-4101-b9da-cbbbe6124f5f req-5b0ac852-a377-43c1-999b-db2de911388d tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Transition to ACTIVE for port object 1cc416ab-7f60-449e-8b91-113111ff4aa3 will not be triggered until provisioned by entity DHCP. {{(pid=91687) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:29:24.987513 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-ca088f47-c98b-4101-b9da-cbbbe6124f5f req-5b0ac852-a377-43c1-999b-db2de911388d tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8782892106231', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4162192'] for port, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:24.993655 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-849677f9-8984-4111-b111-891d7858294a tempest-ServerRescueNegativeTestJSON-969978466 tempest-ServerRescueNegativeTestJSON-969978466-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:29:25.060769 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ca088f47-c98b-4101-b9da-cbbbe6124f5f req-5b0ac852-a377-43c1-999b-db2de911388d tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Network 21794e86-fda7-40a6-a5a8-db117c7eeb9d is already hosted by enough agents. {{(pid=91687) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:29:25.063983 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.base_scheduler [req-ca088f47-c98b-4101-b9da-cbbbe6124f5f req-5b0ac852-a377-43c1-999b-db2de911388d tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Resources bound (agent type, host, resource id):  {{(pid=91687) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:29:25.067891 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.l3_dvrscheduler_db [req-ca088f47-c98b-4101-b9da-cbbbe6124f5f req-5b0ac852-a377-43c1-999b-db2de911388d tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Received port after_create {{(pid=91687) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 04:29:25.101159 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b0ac852-a377-43c1-999b-db2de911388d tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Pushing event updated for resources: {'Port': ['ID=1cc416ab-7f60-449e-8b91-113111ff4aa3,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:29:25.108091 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-5b0ac852-a377-43c1-999b-db2de911388d tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:29:25.145391 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca088f47-c98b-4101-b9da-cbbbe6124f5f req-5b0ac852-a377-43c1-999b-db2de911388d tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:25.146154 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-ca088f47-c98b-4101-b9da-cbbbe6124f5f req-5b0ac852-a377-43c1-999b-db2de911388d tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for port, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:25.176820 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-ca088f47-c98b-4101-b9da-cbbbe6124f5f req-5b0ac852-a377-43c1-999b-db2de911388d tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 0.9172883
May 20 04:29:25.190989 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [req-ca088f47-c98b-4101-b9da-cbbbe6124f5f req-dfe6a5e0-49de-4181-a0a4-7051dafa56dd service neutron] Request body: {'port': {'device_id': '7925b833-d836-40d7-81b2-48717d6da34b', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79091'}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:29:25.301768 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-807e1338-25d4-4bc2-a2e4-8605554a5d94 None None] Provisioning for port 1cc416ab-7f60-449e-8b91-113111ff4aa3 completed by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:29:25.307478 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-ca088f47-c98b-4101-b9da-cbbbe6124f5f req-dfe6a5e0-49de-4181-a0a4-7051dafa56dd service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:25.307824 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-807e1338-25d4-4bc2-a2e4-8605554a5d94 None None] Provisioning complete for port 1cc416ab-7f60-449e-8b91-113111ff4aa3 triggered by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:29:25.308274 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-807e1338-25d4-4bc2-a2e4-8605554a5d94 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:25.402939 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-807e1338-25d4-4bc2-a2e4-8605554a5d94 None None] Port 1cc416ab-7f60-449e-8b91-113111ff4aa3 cannot update to ACTIVE because it is not bound. {{(pid=91688) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 20 04:29:25.619013 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-150d256b-9b30-48ed-857b-c2b5b8e8b731 req-2461699c-1c03-47b3-8b7b-630ddb055ad4 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:25.621496 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-150d256b-9b30-48ed-857b-c2b5b8e8b731 req-2461699c-1c03-47b3-8b7b-630ddb055ad4 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 932 time: 0.0925391
May 20 04:29:25.669769 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [req-150d256b-9b30-48ed-857b-c2b5b8e8b731 req-eaa3c574-d019-4025-a256-a9fd48bad44f tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Synchronizing usage tracker for tenant:ef3bec4745b14484ac8e21cd16cbd11d on resource:security_group {{(pid=91686) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:29:25.676868 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.notifiers.nova [req-ca088f47-c98b-4101-b9da-cbbbe6124f5f req-dfe6a5e0-49de-4181-a0a4-7051dafa56dd service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 1cc416ab-7f60-449e-8b91-113111ff4aa3 {{(pid=91687) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 04:29:25.681940 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [req-150d256b-9b30-48ed-857b-c2b5b8e8b731 req-eaa3c574-d019-4025-a256-a9fd48bad44f tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Unset dirty status for tenant:ef3bec4745b14484ac8e21cd16cbd11d on resource:security_group {{(pid=91686) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:29:25.683110 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-150d256b-9b30-48ed-857b-c2b5b8e8b731 req-eaa3c574-d019-4025-a256-a9fd48bad44f tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=35bf24dc-8716-4edf-9f4f-f9d97739d7ef&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0565393
May 20 04:29:25.684698 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-ca088f47-c98b-4101-b9da-cbbbe6124f5f req-dfe6a5e0-49de-4181-a0a4-7051dafa56dd service neutron] Notify callbacks [] for port, precommit_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:25.701392 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.provisioning_blocks [req-ca088f47-c98b-4101-b9da-cbbbe6124f5f req-dfe6a5e0-49de-4181-a0a4-7051dafa56dd service neutron] Transition to ACTIVE for port object 1cc416ab-7f60-449e-8b91-113111ff4aa3 will not be triggered until provisioned by entity L2. {{(pid=91687) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:29:25.706784 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-ca088f47-c98b-4101-b9da-cbbbe6124f5f req-dfe6a5e0-49de-4181-a0a4-7051dafa56dd service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4162185'] for port, after_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:25.711014 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-ab525840-f3af-42be-8a2f-9c13348fae0f service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:29:25.864263 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfe6a5e0-49de-4181-a0a4-7051dafa56dd service neutron] Pushing event updated for resources: {'Port': ['ID=1cc416ab-7f60-449e-8b91-113111ff4aa3,revision_number=2']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:29:25.872080 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-dfe6a5e0-49de-4181-a0a4-7051dafa56dd service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.161s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:29:25.947489 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.managers [req-ca088f47-c98b-4101-b9da-cbbbe6124f5f req-dfe6a5e0-49de-4181-a0a4-7051dafa56dd service neutron] Attempting to bind port 1cc416ab-7f60-449e-8b91-113111ff4aa3 on host hv-cinder-79091 for vnic_type normal with profile  {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 04:29:25.947822 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.managers [req-ca088f47-c98b-4101-b9da-cbbbe6124f5f req-dfe6a5e0-49de-4181-a0a4-7051dafa56dd service neutron] Attempting to bind port 1cc416ab-7f60-449e-8b91-113111ff4aa3 by drivers openvswitch,hyperv on host hv-cinder-79091 at level 0 using segments [{'id': '9521f383-6017-4b4d-9f47-cff4ed54cb57', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 864, 'network_id': '21794e86-fda7-40a6-a5a8-db117c7eeb9d'}] {{(pid=91687) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 04:29:25.948141 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ca088f47-c98b-4101-b9da-cbbbe6124f5f req-dfe6a5e0-49de-4181-a0a4-7051dafa56dd service neutron] Attempting to bind port 1cc416ab-7f60-449e-8b91-113111ff4aa3 on network 21794e86-fda7-40a6-a5a8-db117c7eeb9d {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:29:25.953136 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ca088f47-c98b-4101-b9da-cbbbe6124f5f req-dfe6a5e0-49de-4181-a0a4-7051dafa56dd service neutron] Port 1cc416ab-7f60-449e-8b91-113111ff4aa3 on network 21794e86-fda7-40a6-a5a8-db117c7eeb9d not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79091 {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 20 04:29:25.953573 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ca088f47-c98b-4101-b9da-cbbbe6124f5f req-dfe6a5e0-49de-4181-a0a4-7051dafa56dd service neutron] Attempting to bind port 1cc416ab-7f60-449e-8b91-113111ff4aa3 on network 21794e86-fda7-40a6-a5a8-db117c7eeb9d {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:29:25.959014 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ca088f47-c98b-4101-b9da-cbbbe6124f5f req-dfe6a5e0-49de-4181-a0a4-7051dafa56dd service neutron] Checking agent: {'id': '7cc947fd-92eb-4d43-ad6b-ea002afff217', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79091', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 4, 19, 34), 'started_at': datetime.datetime(2021, 5, 20, 4, 19, 34), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 4, 29, 7), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 04:29:25.959334 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ca088f47-c98b-4101-b9da-cbbbe6124f5f req-dfe6a5e0-49de-4181-a0a4-7051dafa56dd service neutron] Checking segment: {'id': '9521f383-6017-4b4d-9f47-cff4ed54cb57', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 864, 'network_id': '21794e86-fda7-40a6-a5a8-db117c7eeb9d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91687) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:29:25.959731 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ca088f47-c98b-4101-b9da-cbbbe6124f5f req-dfe6a5e0-49de-4181-a0a4-7051dafa56dd service neutron] Bound using segment: {'id': '9521f383-6017-4b4d-9f47-cff4ed54cb57', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 864, 'network_id': '21794e86-fda7-40a6-a5a8-db117c7eeb9d'} {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 04:29:25.960158 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.managers [req-ca088f47-c98b-4101-b9da-cbbbe6124f5f req-dfe6a5e0-49de-4181-a0a4-7051dafa56dd service neutron] Bound port: 1cc416ab-7f60-449e-8b91-113111ff4aa3, host: hv-cinder-79091, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '9521f383-6017-4b4d-9f47-cff4ed54cb57', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 864, 'network_id': '21794e86-fda7-40a6-a5a8-db117c7eeb9d'}}] {{(pid=91687) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 04:29:25.960500 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-ca088f47-c98b-4101-b9da-cbbbe6124f5f req-dfe6a5e0-49de-4181-a0a4-7051dafa56dd service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:26.052590 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [req-ca088f47-c98b-4101-b9da-cbbbe6124f5f req-dfe6a5e0-49de-4181-a0a4-7051dafa56dd service neutron] For port 1cc416ab-7f60-449e-8b91-113111ff4aa3, host hv-cinder-79091, cleared binding levels {{(pid=91687) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 04:29:26.056051 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [req-ca088f47-c98b-4101-b9da-cbbbe6124f5f req-dfe6a5e0-49de-4181-a0a4-7051dafa56dd service neutron] For port 1cc416ab-7f60-449e-8b91-113111ff4aa3, host hv-cinder-79091, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=1cc416ab-7f60-449e-8b91-113111ff4aa3,segment=NetworkSegment(9521f383-6017-4b4d-9f47-cff4ed54cb57),segment_id=9521f383-6017-4b4d-9f47-cff4ed54cb57)] {{(pid=91687) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 04:29:26.060409 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-ca088f47-c98b-4101-b9da-cbbbe6124f5f req-dfe6a5e0-49de-4181-a0a4-7051dafa56dd service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4162185'] for port, after_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:26.064271 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-6e2e2d2d-b7bf-459b-a9db-ab914a7a69e7 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:29:26.123944 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca088f47-c98b-4101-b9da-cbbbe6124f5f req-dfe6a5e0-49de-4181-a0a4-7051dafa56dd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:26.124558 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-ca088f47-c98b-4101-b9da-cbbbe6124f5f req-dfe6a5e0-49de-4181-a0a4-7051dafa56dd service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for port, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:26.126451 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-ca088f47-c98b-4101-b9da-cbbbe6124f5f req-dfe6a5e0-49de-4181-a0a4-7051dafa56dd service neutron] 10.222.0.82 "PUT /v2.0/ports/1cc416ab-7f60-449e-8b91-113111ff4aa3 HTTP/1.1" status: 200  len: 1094 time: 0.9395063
May 20 04:29:26.126675 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7925b833-d836-40d7-81b2-48717d6da34b', 'tag': '1cc416ab-7f60-449e-8b91-113111ff4aa3'}] {{(pid=91687) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:29:26.147672 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfe6a5e0-49de-4181-a0a4-7051dafa56dd service neutron] Pushing event updated for resources: {'Port': ['ID=1cc416ab-7f60-449e-8b91-113111ff4aa3,revision_number=3']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:29:26.150707 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-dfe6a5e0-49de-4181-a0a4-7051dafa56dd service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:29:26.200804 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7925b833-d836-40d7-81b2-48717d6da34b', 'tag': '1cc416ab-7f60-449e-8b91-113111ff4aa3', 'status': 'completed', 'code': 200}
May 20 04:29:26.247070 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca088f47-c98b-4101-b9da-cbbbe6124f5f req-c8ca6894-0872-42ec-9519-bff1bf6ba973 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:26.248557 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-ca088f47-c98b-4101-b9da-cbbbe6124f5f req-c8ca6894-0872-42ec-9519-bff1bf6ba973 service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=ef3bec4745b14484ac8e21cd16cbd11d&device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 1097 time: 0.0815573
May 20 04:29:26.323581 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-ca088f47-c98b-4101-b9da-cbbbe6124f5f req-8f96d66c-f593-4e4c-812d-908f53c6f8c2 service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=1cc416ab-7f60-449e-8b91-113111ff4aa3 HTTP/1.1" status: 200  len: 217 time: 0.0664985
May 20 04:29:26.387584 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca088f47-c98b-4101-b9da-cbbbe6124f5f req-334a9eb0-d2f9-42d7-969f-987396e3ed76 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:26.388936 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-ca088f47-c98b-4101-b9da-cbbbe6124f5f req-334a9eb0-d2f9-42d7-969f-987396e3ed76 service neutron] 10.222.0.82 "GET /v2.0/subnets?id=06f38702-3d3c-4e25-8f84-85483d1ddf28 HTTP/1.1" status: 200  len: 856 time: 0.0589297
May 20 04:29:26.472855 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca088f47-c98b-4101-b9da-cbbbe6124f5f req-7421d5d2-0c35-41b1-a07f-6789c8ccc162 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:26.474431 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-ca088f47-c98b-4101-b9da-cbbbe6124f5f req-7421d5d2-0c35-41b1-a07f-6789c8ccc162 service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=21794e86-fda7-40a6-a5a8-db117c7eeb9d&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0787032
May 20 04:29:26.623300 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-ca088f47-c98b-4101-b9da-cbbbe6124f5f req-549719b5-f1ab-481e-98bd-ffce03eaf635 service neutron] 10.222.0.82 "GET /v2.0/networks/21794e86-fda7-40a6-a5a8-db117c7eeb9d?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1409531
May 20 04:29:26.859865 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-ca088f47-c98b-4101-b9da-cbbbe6124f5f req-f6af0521-2993-4499-b960-dfb259ba4e0f service neutron] 10.222.0.82 "GET /v2.0/networks/21794e86-fda7-40a6-a5a8-db117c7eeb9d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2290120
May 20 04:29:26.915825 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a628bd05-64df-4b07-8b88-8b929e110665 req-4d8bfd48-940b-4108-9dd2-151d04320d09 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:26.917470 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-a628bd05-64df-4b07-8b88-8b929e110665 req-4d8bfd48-940b-4108-9dd2-151d04320d09 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 944 time: 0.0998363
May 20 04:29:26.979588 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-a628bd05-64df-4b07-8b88-8b929e110665 req-34d63921-14f6-47a3-8bf2-2e2b7c9f9ec0 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=35bf24dc-8716-4edf-9f4f-f9d97739d7ef&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0503395
May 20 04:29:26.995788 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae3437b9-0f0a-4a68-a47a-2596da603024 req-8386b941-07c6-4166-9b95-6faa9c857280 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:26.997323 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-ae3437b9-0f0a-4a68-a47a-2596da603024 req-8386b941-07c6-4166-9b95-6faa9c857280 service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=ef3bec4745b14484ac8e21cd16cbd11d&device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 1097 time: 0.0787222
May 20 04:29:27.138100 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae3437b9-0f0a-4a68-a47a-2596da603024 req-be279937-7ab2-4227-9104-e6cc28782a15 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:27.139747 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-ae3437b9-0f0a-4a68-a47a-2596da603024 req-be279937-7ab2-4227-9104-e6cc28782a15 service neutron] 10.222.0.82 "GET /v2.0/networks?id=21794e86-fda7-40a6-a5a8-db117c7eeb9d HTTP/1.1" status: 200  len: 918 time: 0.1351957
May 20 04:29:27.214116 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-ae3437b9-0f0a-4a68-a47a-2596da603024 req-bb93f24d-2817-4311-810a-3b812eebb440 service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=1cc416ab-7f60-449e-8b91-113111ff4aa3 HTTP/1.1" status: 200  len: 217 time: 0.0647337
May 20 04:29:27.281431 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae3437b9-0f0a-4a68-a47a-2596da603024 req-f258456e-b6b2-42cf-b613-51bb46693ef8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:27.282884 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-ae3437b9-0f0a-4a68-a47a-2596da603024 req-f258456e-b6b2-42cf-b613-51bb46693ef8 service neutron] 10.222.0.82 "GET /v2.0/subnets?id=06f38702-3d3c-4e25-8f84-85483d1ddf28 HTTP/1.1" status: 200  len: 856 time: 0.0613921
May 20 04:29:27.363387 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae3437b9-0f0a-4a68-a47a-2596da603024 req-806db8bd-9aa0-48f7-aa96-5c06a1a1e9fe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:27.364929 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-ae3437b9-0f0a-4a68-a47a-2596da603024 req-806db8bd-9aa0-48f7-aa96-5c06a1a1e9fe service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=21794e86-fda7-40a6-a5a8-db117c7eeb9d&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0742862
May 20 04:29:27.508681 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-ae3437b9-0f0a-4a68-a47a-2596da603024 req-1022f0f0-de01-4aec-8692-f2199bb71e0b service neutron] 10.222.0.82 "GET /v2.0/networks/21794e86-fda7-40a6-a5a8-db117c7eeb9d?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1354716
May 20 04:29:27.651284 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcee24cd-e357-44a9-b60e-867409ef8ff4 req-d16a500a-00d0-4f20-a53d-8f564ec23007 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:27.653188 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-dcee24cd-e357-44a9-b60e-867409ef8ff4 req-d16a500a-00d0-4f20-a53d-8f564ec23007 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 946 time: 0.0898490
May 20 04:29:27.667567 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-ae3437b9-0f0a-4a68-a47a-2596da603024 req-2d6d3818-1597-4ac4-8890-a53c75aaad21 service neutron] 10.222.0.82 "GET /v2.0/networks/21794e86-fda7-40a6-a5a8-db117c7eeb9d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1389656
May 20 04:29:27.709461 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-dcee24cd-e357-44a9-b60e-867409ef8ff4 req-51e250fd-6347-4912-8091-781b84079653 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/security-groups?id=34e473fa-df05-422b-9abc-99aed131bade&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0497692
May 20 04:29:27.944476 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 45212) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:29:28.080204 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-a93e2006-7f00-4fa3-8cfc-769a7c836ad8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:28.096609 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-a93e2006-7f00-4fa3-8cfc-769a7c836ad8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:29:28.101146 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-a93e2006-7f00-4fa3-8cfc-769a7c836ad8 admin admin] Usage tracker for resource:security_group_rule and tenant:6e8b1834344949a8a475c883c6d7f41f is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:29:28.104322 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-a93e2006-7f00-4fa3-8cfc-769a7c836ad8 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:29:28.110466 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-a93e2006-7f00-4fa3-8cfc-769a7c836ad8 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:29:28.202540 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb662a4f-63e9-4056-9dcd-d4cb13915b4c req-e69d5844-7c05-4a64-920c-ad65c85873e5 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:28.203450 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-a93e2006-7f00-4fa3-8cfc-769a7c836ad8 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:28.203669 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-cb662a4f-63e9-4056-9dcd-d4cb13915b4c req-e69d5844-7c05-4a64-920c-ad65c85873e5 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Synchronizing usage tracker for tenant:ef3bec4745b14484ac8e21cd16cbd11d on resource:port {{(pid=91687) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:29:28.206836 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-a93e2006-7f00-4fa3-8cfc-769a7c836ad8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:28.218536 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-1aad96a7-c93d-4a6f-be42-2760f0d1b0c9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:29:28.220700 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-cb662a4f-63e9-4056-9dcd-d4cb13915b4c req-e69d5844-7c05-4a64-920c-ad65c85873e5 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Unset dirty status for tenant:ef3bec4745b14484ac8e21cd16cbd11d on resource:port {{(pid=91687) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:29:28.222723 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-cb662a4f-63e9-4056-9dcd-d4cb13915b4c req-e69d5844-7c05-4a64-920c-ad65c85873e5 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 944 time: 0.1030421
May 20 04:29:28.261684 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-a93e2006-7f00-4fa3-8cfc-769a7c836ad8 admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=6e8b1834344949a8a475c883c6d7f41f&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3160341
May 20 04:29:28.262465 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a93e2006-7f00-4fa3-8cfc-769a7c836ad8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c890b190-0959-4735-a407-187e229e1caf,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:29:28.265295 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 45220) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:29:28.266306 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-a93e2006-7f00-4fa3-8cfc-769a7c836ad8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:29:28.308811 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-cb662a4f-63e9-4056-9dcd-d4cb13915b4c req-eee23533-3457-4697-91e6-5808b973b782 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=35bf24dc-8716-4edf-9f4f-f9d97739d7ef&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0796847
May 20 04:29:28.349051 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-03e2bdfb-49e1-48e0-83a6-a3f4f453f7f5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:28.377491 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-03e2bdfb-49e1-48e0-83a6-a3f4f453f7f5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:28.435320 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-03e2bdfb-49e1-48e0-83a6-a3f4f453f7f5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:28.440053 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-304a7bf5-24fb-47a6-98f4-ffbd2dfe5a92 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:29:28.454412 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03e2bdfb-49e1-48e0-83a6-a3f4f453f7f5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c890b190-0959-4735-a407-187e229e1caf,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:29:28.457272 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-03e2bdfb-49e1-48e0-83a6-a3f4f453f7f5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:29:28.461826 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-03e2bdfb-49e1-48e0-83a6-a3f4f453f7f5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:28.462962 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-03e2bdfb-49e1-48e0-83a6-a3f4f453f7f5 admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/c890b190-0959-4735-a407-187e229e1caf HTTP/1.1" status: 204  len: 168 time: 0.1966662
May 20 04:29:28.908648 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7431944d-ca72-4bf6-a6cb-c464cf51fa4c req-baad9b73-29fd-497e-9fca-db52ec4ac3a4 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:28.910209 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-7431944d-ca72-4bf6-a6cb-c464cf51fa4c req-baad9b73-29fd-497e-9fca-db52ec4ac3a4 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 946 time: 0.0854552
May 20 04:29:28.960372 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-7431944d-ca72-4bf6-a6cb-c464cf51fa4c req-c6f5386e-df5f-477e-bb81-5dc7b87a3572 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/security-groups?id=34e473fa-df05-422b-9abc-99aed131bade&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0431719
May 20 04:29:29.293192 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 1cc416ab-7f60-449e-8b91-113111ff4aa3 details requested by agent hyperv_hv-cinder-79091 with host hv-cinder-79091 {{(pid=91688) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 20 04:29:29.464560 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port 1cc416ab-7f60-449e-8b91-113111ff4aa3, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=1cc416ab-7f60-449e-8b91-113111ff4aa3,segment=NetworkSegment(9521f383-6017-4b4d-9f47-cff4ed54cb57),segment_id=9521f383-6017-4b4d-9f47-cff4ed54cb57)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:29:29.481217 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Returning: {'device': '1cc416ab-7f60-449e-8b91-113111ff4aa3', 'network_id': '21794e86-fda7-40a6-a5a8-db117c7eeb9d', 'port_id': '1cc416ab-7f60-449e-8b91-113111ff4aa3', 'mac_address': 'fa:16:3e:76:fe:24', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 864, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '06f38702-3d3c-4e25-8f84-85483d1ddf28', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91688) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 20 04:29:29.505209 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11459e5b-8bae-49c6-b19d-6764647fab48 req-08d13c3b-8ade-49ef-80e8-f54ce7284b7e tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:29.506734 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-11459e5b-8bae-49c6-b19d-6764647fab48 req-08d13c3b-8ade-49ef-80e8-f54ce7284b7e tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 944 time: 0.0841002
May 20 04:29:29.542039 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:29.557386 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-11459e5b-8bae-49c6-b19d-6764647fab48 req-1904a001-983e-49b5-b0e8-f88b1c9ecf14 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=35bf24dc-8716-4edf-9f4f-f9d97739d7ef&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0433824
May 20 04:29:29.561937 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.notifiers.nova [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 1cc416ab-7f60-449e-8b91-113111ff4aa3 {{(pid=91688) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 04:29:29.581230 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port 1cc416ab-7f60-449e-8b91-113111ff4aa3, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=1cc416ab-7f60-449e-8b91-113111ff4aa3,segment=NetworkSegment(9521f383-6017-4b4d-9f47-cff4ed54cb57),segment_id=9521f383-6017-4b4d-9f47-cff4ed54cb57)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:29:29.585748 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:29.588690 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:29:29.653246 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Pushing event updated for resources: {'Port': ['ID=1cc416ab-7f60-449e-8b91-113111ff4aa3,revision_number=4']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:29:29.657280 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:29:29.865596 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-11346344-b39d-42c6-ae0d-cb53394579f2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:29.951304 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.agents_db [None req-92d61f12-17bc-4bf9-9eab-8a69b8c6da2f None None] Agent healthcheck: found 6 active agents {{(pid=91689) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 04:29:29.955725 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] get_ports_and_sgs() called for port_ids ['1cc416ab-7f60-449e-8b91-113111ff4aa3'] {{(pid=91688) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 04:29:30.172364 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f01c5b82-7f3b-4a8f-a90e-1650ef4a3eeb req-e6635918-35a8-4e8a-91b3-45bc9f927eef tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:30.173934 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-f01c5b82-7f3b-4a8f-a90e-1650ef4a3eeb req-e6635918-35a8-4e8a-91b3-45bc9f927eef tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 946 time: 0.0933936
May 20 04:29:30.224993 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-f01c5b82-7f3b-4a8f-a90e-1650ef4a3eeb req-e7c4a287-3092-4c08-81aa-aacfdcdf43c2 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/security-groups?id=34e473fa-df05-422b-9abc-99aed131bade&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0431695
May 20 04:29:30.814811 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b5ee0c2-7ac7-45e5-bd59-2a3d305671b0 req-e8d40dae-9ae1-4f8e-b24b-d3b21ee3a56b tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:30.817313 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9b5ee0c2-7ac7-45e5-bd59-2a3d305671b0 req-e8d40dae-9ae1-4f8e-b24b-d3b21ee3a56b tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 945 time: 0.1393938
May 20 04:29:30.867958 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9b5ee0c2-7ac7-45e5-bd59-2a3d305671b0 req-a4105524-4a4f-4765-a32f-3de672469f0c tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=35bf24dc-8716-4edf-9f4f-f9d97739d7ef&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0428798
May 20 04:29:31.289728 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 1cc416ab-7f60-449e-8b91-113111ff4aa3 up at agent hyperv_hv-cinder-79091 {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:29:31.365200 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Provisioning for port 1cc416ab-7f60-449e-8b91-113111ff4aa3 completed by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:29:31.371587 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Provisioning complete for port 1cc416ab-7f60-449e-8b91-113111ff4aa3 triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:29:31.372041 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:31.416415 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-746e6aa8-897e-41da-9d7e-dc377b9dd32d req-7f81ca9a-d9cc-4eb9-85c0-8d160eb44a9d tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:31.418016 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-746e6aa8-897e-41da-9d7e-dc377b9dd32d req-7f81ca9a-d9cc-4eb9-85c0-8d160eb44a9d tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 946 time: 0.0838065
May 20 04:29:31.468805 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-746e6aa8-897e-41da-9d7e-dc377b9dd32d req-c0175fc8-1abb-4e07-bd0d-6e1b3d70743b tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/security-groups?id=34e473fa-df05-422b-9abc-99aed131bade&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0443563
May 20 04:29:31.529713 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:31.559924 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7925b833-d836-40d7-81b2-48717d6da34b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1cc416ab-7f60-449e-8b91-113111ff4aa3'}] {{(pid=91688) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:29:31.570984 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port 1cc416ab-7f60-449e-8b91-113111ff4aa3, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=1cc416ab-7f60-449e-8b91-113111ff4aa3,segment=NetworkSegment(9521f383-6017-4b4d-9f47-cff4ed54cb57),segment_id=9521f383-6017-4b4d-9f47-cff4ed54cb57)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:29:31.576726 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:31.579784 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:29:31.622253 dv-cinder-790910-4-iscsi neutron-server[91688]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7925b833-d836-40d7-81b2-48717d6da34b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1cc416ab-7f60-449e-8b91-113111ff4aa3', 'code': 200}
May 20 04:29:31.671770 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Pushing event updated for resources: {'Port': ['ID=1cc416ab-7f60-449e-8b91-113111ff4aa3,revision_number=5']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:29:31.675030 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.096s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:29:31.880228 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7865215a-4d12-4f94-9561-609f4cd562d4 req-ea6b38b5-a8c7-4329-a546-38dab084e23a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:31.881675 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-7865215a-4d12-4f94-9561-609f4cd562d4 req-ea6b38b5-a8c7-4329-a546-38dab084e23a service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 1099 time: 0.0777283
May 20 04:29:31.926532 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-7865215a-4d12-4f94-9561-609f4cd562d4 req-77fb004f-9f41-448b-8d46-86cb2a153ceb service neutron] 10.222.0.82 "GET /v2.0/security-groups?id=35bf24dc-8716-4edf-9f4f-f9d97739d7ef&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0378957
May 20 04:29:32.089814 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e12dc15-9d51-4ed0-aa0b-1a2a73bab091 req-d54e8242-155e-4bd6-80ad-6c06428759e9 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:32.091384 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-1e12dc15-9d51-4ed0-aa0b-1a2a73bab091 req-d54e8242-155e-4bd6-80ad-6c06428759e9 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 946 time: 0.0836675
May 20 04:29:32.141952 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-1e12dc15-9d51-4ed0-aa0b-1a2a73bab091 req-4409e48e-06ec-4919-81ec-9c51fa8ee707 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=35bf24dc-8716-4edf-9f4f-f9d97739d7ef&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0418751
May 20 04:29:32.559586 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:32.664985 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5be8f4d-ed95-48b5-825a-667db3993c6f req-42d2555b-11f5-4cb3-a7e3-ceb122c4a773 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:32.666487 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-e5be8f4d-ed95-48b5-825a-667db3993c6f req-42d2555b-11f5-4cb3-a7e3-ceb122c4a773 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 946 time: 0.0869713
May 20 04:29:32.686465 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f6eec41c-dad6-4b9c-a5ea-4470aeeff582 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:32.717215 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-e5be8f4d-ed95-48b5-825a-667db3993c6f req-66011593-1bb3-48e6-8a11-2d20b7ea1180 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/security-groups?id=34e473fa-df05-422b-9abc-99aed131bade&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0443287
May 20 04:29:33.342512 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ea4803bd-878f-47d5-9084-1ec41953c9db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:33.342793 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ffad576-2f99-4735-a9fc-fd853defc03f req-8697df04-d811-4e52-9643-5c6b2df8f02c tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:33.344096 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-8ffad576-2f99-4735-a9fc-fd853defc03f req-8697df04-d811-4e52-9643-5c6b2df8f02c tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 946 time: 0.0893342
May 20 04:29:33.390942 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-8ffad576-2f99-4735-a9fc-fd853defc03f req-bd27dca9-1e94-44ed-80de-b617fdbe7ebc tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=35bf24dc-8716-4edf-9f4f-f9d97739d7ef&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0398784
May 20 04:29:33.598270 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c531245-72ee-4c47-a75f-db4e78020bc3 req-5708947a-2ae8-4b7b-9ad5-cba6e06b6a86 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:33.600524 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-3c531245-72ee-4c47-a75f-db4e78020bc3 req-5708947a-2ae8-4b7b-9ad5-cba6e06b6a86 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 946 time: 0.1001871
May 20 04:29:33.609199 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 45250) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:29:33.614284 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [None req-f4cd47f7-04aa-4de2-a83a-14e8cc84f9a0 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Request body: {'floatingip': {'port_id': '1cc416ab-7f60-449e-8b91-113111ff4aa3'}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:29:33.692765 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-f4cd47f7-04aa-4de2-a83a-14e8cc84f9a0 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks [] for floatingip, before_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:33.924906 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45d600c0-a593-4933-9780-a9fa1af12626 req-57513294-3da3-487a-a78f-484e69fbcf67 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:33.926431 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-45d600c0-a593-4933-9780-a9fa1af12626 req-57513294-3da3-487a-a78f-484e69fbcf67 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 946 time: 0.0985503
May 20 04:29:33.975175 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-45d600c0-a593-4933-9780-a9fa1af12626 req-ea0fc203-497d-4997-9510-7c34f939225c tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/security-groups?id=34e473fa-df05-422b-9abc-99aed131bade&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0410674
May 20 04:29:34.589170 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-f4cd47f7-04aa-4de2-a83a-14e8cc84f9a0 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks [] for floatingip, precommit_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:34.595849 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-f4cd47f7-04aa-4de2-a83a-14e8cc84f9a0 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1716406'] for floatingip, after_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:34.777861 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.db.l3_db [None req-f4cd47f7-04aa-4de2-a83a-14e8cc84f9a0 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Floating IP a73fb90d-bf4b-41bd-a01a-5fdf0d810c60 associated. External IP: 172.27.1.20, port: 1cc416ab-7f60-449e-8b91-113111ff4aa3.
May 20 04:29:35.198517 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f21320cc-6a25-4ec1-8a32-8b119b35fd55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:35.289469 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f4cd47f7-04aa-4de2-a83a-14e8cc84f9a0 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Router 34eeb764-2607-4d9f-96c4-89598b702500 has already been hosted by L3 agent 02733fc0-fc9c-4e29-bc03-c27a792d539d {{(pid=91687) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 04:29:35.376373 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0f23794-f25c-48d4-ba02-c2a1ae7f8eb9 req-fad4f559-107a-4b7a-8410-d0f8d45c48f9 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:35.378234 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-c0f23794-f25c-48d4-ba02-c2a1ae7f8eb9 req-fad4f559-107a-4b7a-8410-d0f8d45c48f9 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 946 time: 0.1852176
May 20 04:29:35.512218 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-c0f23794-f25c-48d4-ba02-c2a1ae7f8eb9 req-5ddd6307-5227-432c-8966-d06eef0cea56 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/security-groups?id=34e473fa-df05-422b-9abc-99aed131bade&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1233988
May 20 04:29:35.527328 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f4cd47f7-04aa-4de2-a83a-14e8cc84f9a0 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify agent at l3_agent.dv-cinder-790910-4-iscsi the message routers_updated {{(pid=91687) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 04:29:35.532156 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-f4cd47f7-04aa-4de2-a83a-14e8cc84f9a0 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for floatingip, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:35.542162 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a5563136-fa6e-46bd-9924-df6764539a75 None None] Sync routers for ids ['34eeb764-2607-4d9f-96c4-89598b702500'] in dv-cinder-790910-4-iscsi {{(pid=91688) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 04:29:35.561237 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a5563136-fa6e-46bd-9924-df6764539a75 None None] Routers {'34eeb764-2607-4d9f-96c4-89598b702500'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91688) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:29:35.562278 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-a5563136-fa6e-46bd-9924-df6764539a75 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced0cc39d0>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:29:33Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['34eeb764-2607-4d9f-96c4-89598b702500'], 'active': True} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:29:35.596078 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-f4cd47f7-04aa-4de2-a83a-14e8cc84f9a0 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "PUT /v2.0/floatingips/a73fb90d-bf4b-41bd-a01a-5fdf0d810c60 HTTP/1.1" status: 200  len: 991 time: 1.9858258
May 20 04:29:35.596817 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7925b833-d836-40d7-81b2-48717d6da34b', 'tag': '1cc416ab-7f60-449e-8b91-113111ff4aa3'}] {{(pid=91687) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:29:35.663353 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7925b833-d836-40d7-81b2-48717d6da34b', 'tag': '1cc416ab-7f60-449e-8b91-113111ff4aa3', 'status': 'completed', 'code': 200}
May 20 04:29:35.810501 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8628ba5f-e5f9-4200-9f0e-2953db9f5b5d req-d85ffe27-947f-44f2-9251-caa598fef928 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:35.812204 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-8628ba5f-e5f9-4200-9f0e-2953db9f5b5d req-d85ffe27-947f-44f2-9251-caa598fef928 service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=ef3bec4745b14484ac8e21cd16cbd11d&device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 1099 time: 0.1138680
May 20 04:29:35.837700 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvr_db [None req-a5563136-fa6e-46bd-9924-df6764539a75 None None] Set router 34eeb764-2607-4d9f-96c4-89598b702500 gateway port host: dv-cinder-790910-4-iscsi {{(pid=91688) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:29:35.957427 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8628ba5f-e5f9-4200-9f0e-2953db9f5b5d req-b2cecd0a-ecce-4b77-8c1e-f888a8a5f6e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:35.958876 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-8628ba5f-e5f9-4200-9f0e-2953db9f5b5d req-b2cecd0a-ecce-4b77-8c1e-f888a8a5f6e0 service neutron] 10.222.0.82 "GET /v2.0/networks?id=21794e86-fda7-40a6-a5a8-db117c7eeb9d HTTP/1.1" status: 200  len: 918 time: 0.1376395
May 20 04:29:36.129546 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-8628ba5f-e5f9-4200-9f0e-2953db9f5b5d req-7fe3fd17-1a80-42e6-b5fe-1d23771954f0 service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=1cc416ab-7f60-449e-8b91-113111ff4aa3 HTTP/1.1" status: 200  len: 999 time: 0.1627312
May 20 04:29:36.202321 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8628ba5f-e5f9-4200-9f0e-2953db9f5b5d req-82c9a813-baa5-4972-8126-11767ae8c515 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:36.203845 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-8628ba5f-e5f9-4200-9f0e-2953db9f5b5d req-82c9a813-baa5-4972-8126-11767ae8c515 service neutron] 10.222.0.82 "GET /v2.0/subnets?id=06f38702-3d3c-4e25-8f84-85483d1ddf28 HTTP/1.1" status: 200  len: 856 time: 0.0654194
May 20 04:29:36.235927 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-a5563136-fa6e-46bd-9924-df6764539a75 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced0cc39d0>, [{'id': '34eeb764-2607-4d9f-96c4-89598b702500', 'name': 'tempest-AttachVolumeShelveTestJSON-1895235554-router', 'tenant_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.72'}], 'enable_snat': True}, 'gw_port_id': '16508f6e-35a3-4301-9018-78e099969b00', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:21:10Z', 'updated_at': '2021-05-20T04:21:20Z', 'revision_number': 4, 'project_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'gw_port': {'id': '16508f6e-35a3-4301-9018-78e099969b00', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:e3:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '34eeb764-2607-4d9f-96c4-89598b702500', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:21:12Z', 'updated_at': '2021-05-20T04:21:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_floatingips': [{'id': 'a73fb90d-bf4b-41bd-a01a-5fdf0d810c60', 'tenant_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'floating_ip_address': '172.27.1.20', 'floating_network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'router_id': '34eeb764-2607-4d9f-96c4-89598b702500', 'port_id': '1cc416ab-7f60-449e-8b91-113111ff4aa3', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 588, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '21794e86-fda7-40a6-a5a8-db117c7eeb9d', 'mac_address': 'fa:16:3e:76:fe:24', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7925b833-d836-40d7-81b2-48717d6da34b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T04:29:19Z', 'updated_at': '2021-05-20T04:29:34Z', 'revision_number': 1, 'project_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'aad390e4-f9e2-4bbe-9e64-7b390cc7f3b3', 'name': '', 'network_id': '21794e86-fda7-40a6-a5a8-db117c7eeb9d', 'tenant_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'mac_address': 'fa:16:3e:b2:b9:f0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '34eeb764-2607-4d9f-96c4-89598b702500', 'device_owner': 'network:router_interface', 'standard_attr_id': 88, 'fixed_ips': [{'subnet_id': '06f38702-3d3c-4e25-8f84-85483d1ddf28', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:21:18Z', 'updated_at': '2021-05-20T04:21:40Z', 'revision_number': 5, 'project_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'subnets': [{'id': '06f38702-3d3c-4e25-8f84-85483d1ddf28', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:29:36.241085 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a5563136-fa6e-46bd-9924-df6764539a75 None None] Checking router: 34eeb764-2607-4d9f-96c4-89598b702500 for host: dv-cinder-790910-4-iscsi {{(pid=91688) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 04:29:36.251697 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a5563136-fa6e-46bd-9924-df6764539a75 None None] Routers {'34eeb764-2607-4d9f-96c4-89598b702500'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91688) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:29:36.252353 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-a5563136-fa6e-46bd-9924-df6764539a75 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced0cc39d0>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:29:33Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['34eeb764-2607-4d9f-96c4-89598b702500'], 'active': True} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:29:36.294128 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8628ba5f-e5f9-4200-9f0e-2953db9f5b5d req-c76e135a-9b3f-46e2-b642-5e285a281049 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:36.295606 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-8628ba5f-e5f9-4200-9f0e-2953db9f5b5d req-c76e135a-9b3f-46e2-b642-5e285a281049 service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=21794e86-fda7-40a6-a5a8-db117c7eeb9d&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0803499
May 20 04:29:36.454169 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-8628ba5f-e5f9-4200-9f0e-2953db9f5b5d req-b80b9a50-4a81-4063-8fbb-8d99b9c08fa1 service neutron] 10.222.0.82 "GET /v2.0/networks/21794e86-fda7-40a6-a5a8-db117c7eeb9d?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1492949
May 20 04:29:36.494737 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvr_db [None req-a5563136-fa6e-46bd-9924-df6764539a75 None None] Set router 34eeb764-2607-4d9f-96c4-89598b702500 gateway port host: dv-cinder-790910-4-iscsi {{(pid=91688) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:29:36.586294 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:36.624821 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-8628ba5f-e5f9-4200-9f0e-2953db9f5b5d req-601d4a45-7e8b-4bbd-9069-a6e00fbffe28 service neutron] 10.222.0.82 "GET /v2.0/networks/21794e86-fda7-40a6-a5a8-db117c7eeb9d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1612344
May 20 04:29:36.817873 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bb20158-5ed4-4797-b277-5db4bcb06233 req-f28583b0-014d-4381-bf7f-066e2db01ff6 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:36.819711 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-6bb20158-5ed4-4797-b277-5db4bcb06233 req-f28583b0-014d-4381-bf7f-066e2db01ff6 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 946 time: 0.1303225
May 20 04:29:36.879658 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-6bb20158-5ed4-4797-b277-5db4bcb06233 req-342de1b1-5ad6-459c-a240-9a6e9bbf213c tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/security-groups?id=34e473fa-df05-422b-9abc-99aed131bade&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0532289
May 20 04:29:36.959649 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-a5563136-fa6e-46bd-9924-df6764539a75 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced0cc39d0>, [{'id': '34eeb764-2607-4d9f-96c4-89598b702500', 'name': 'tempest-AttachVolumeShelveTestJSON-1895235554-router', 'tenant_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.72'}], 'enable_snat': True}, 'gw_port_id': '16508f6e-35a3-4301-9018-78e099969b00', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:21:10Z', 'updated_at': '2021-05-20T04:21:20Z', 'revision_number': 4, 'project_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'gw_port': {'id': '16508f6e-35a3-4301-9018-78e099969b00', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:e3:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '34eeb764-2607-4d9f-96c4-89598b702500', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:21:12Z', 'updated_at': '2021-05-20T04:21:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_floatingips': [{'id': 'a73fb90d-bf4b-41bd-a01a-5fdf0d810c60', 'tenant_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'floating_ip_address': '172.27.1.20', 'floating_network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'router_id': '34eeb764-2607-4d9f-96c4-89598b702500', 'port_id': '1cc416ab-7f60-449e-8b91-113111ff4aa3', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 588, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '21794e86-fda7-40a6-a5a8-db117c7eeb9d', 'mac_address': 'fa:16:3e:76:fe:24', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7925b833-d836-40d7-81b2-48717d6da34b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T04:29:19Z', 'updated_at': '2021-05-20T04:29:34Z', 'revision_number': 1, 'project_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'aad390e4-f9e2-4bbe-9e64-7b390cc7f3b3', 'name': '', 'network_id': '21794e86-fda7-40a6-a5a8-db117c7eeb9d', 'tenant_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'mac_address': 'fa:16:3e:b2:b9:f0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '34eeb764-2607-4d9f-96c4-89598b702500', 'device_owner': 'network:router_interface', 'standard_attr_id': 88, 'fixed_ips': [{'subnet_id': '06f38702-3d3c-4e25-8f84-85483d1ddf28', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:21:18Z', 'updated_at': '2021-05-20T04:21:40Z', 'revision_number': 5, 'project_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'subnets': [{'id': '06f38702-3d3c-4e25-8f84-85483d1ddf28', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:29:36.964646 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a5563136-fa6e-46bd-9924-df6764539a75 None None] The sync data for ids ['34eeb764-2607-4d9f-96c4-89598b702500'] in dv-cinder-790910-4-iscsi is: [{'id': '34eeb764-2607-4d9f-96c4-89598b702500', 'name': 'tempest-AttachVolumeShelveTestJSON-1895235554-router', 'tenant_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.72'}], 'enable_snat': True}, 'gw_port_id': '16508f6e-35a3-4301-9018-78e099969b00', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:21:10Z', 'updated_at': '2021-05-20T04:21:20Z', 'revision_number': 4, 'project_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'gw_port': {'id': '16508f6e-35a3-4301-9018-78e099969b00', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:e3:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '34eeb764-2607-4d9f-96c4-89598b702500', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:21:12Z', 'updated_at': '2021-05-20T04:21:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_floatingips': [{'id': 'a73fb90d-bf4b-41bd-a01a-5fdf0d810c60', 'tenant_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'floating_ip_address': '172.27.1.20', 'floating_network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'router_id': '34eeb764-2607-4d9f-96c4-89598b702500', 'port_id': '1cc416ab-7f60-449e-8b91-113111ff4aa3', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 588, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '21794e86-fda7-40a6-a5a8-db117c7eeb9d', 'mac_address': 'fa:16:3e:76:fe:24', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7925b833-d836-40d7-81b2-48717d6da34b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T04:29:19Z', 'updated_at': '2021-05-20T04:29:34Z', 'revision_number': 1, 'project_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'aad390e4-f9e2-4bbe-9e64-7b390cc7f3b3', 'name': '', 'network_id': '21794e86-fda7-40a6-a5a8-db117c7eeb9d', 'tenant_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'mac_address': 'fa:16:3e:b2:b9:f0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '34eeb764-2607-4d9f-96c4-89598b702500', 'device_owner': 'network:router_interface', 'standard_attr_id': 88, 'fixed_ips': [{'subnet_id': '06f38702-3d3c-4e25-8f84-85483d1ddf28', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:21:18Z', 'updated_at': '2021-05-20T04:21:40Z', 'revision_number': 5, 'project_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'subnets': [{'id': '06f38702-3d3c-4e25-8f84-85483d1ddf28', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91688) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 04:29:37.180668 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-99ac600f-88b9-4b69-ba5d-f6d787ee1668 None None] New status for floating IP a73fb90d-bf4b-41bd-a01a-5fdf0d810c60: ACTIVE {{(pid=91689) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 20 04:29:38.104747 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c43e976-291f-4c3e-bcfc-1bd9f32430af req-b06a7f10-f386-41e4-b5bd-d1d68e24300e tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:38.106374 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-1c43e976-291f-4c3e-bcfc-1bd9f32430af req-b06a7f10-f386-41e4-b5bd-d1d68e24300e tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 946 time: 0.1076121
May 20 04:29:38.158239 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-1c43e976-291f-4c3e-bcfc-1bd9f32430af req-a98ee32f-a42f-4a43-9e98-e1f2e86f44fe tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/security-groups?id=34e473fa-df05-422b-9abc-99aed131bade&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0439181
May 20 04:29:39.389909 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa7a7abb-429e-40b9-af25-eb8c845f3ae8 req-d056b124-435b-402d-a91e-56834a6c9a2e tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:39.391478 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-fa7a7abb-429e-40b9-af25-eb8c845f3ae8 req-d056b124-435b-402d-a91e-56834a6c9a2e tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 946 time: 0.1119506
May 20 04:29:39.444437 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-fa7a7abb-429e-40b9-af25-eb8c845f3ae8 req-3bfe943d-d4c1-451d-9580-60d7855e288e tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/security-groups?id=34e473fa-df05-422b-9abc-99aed131bade&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0464678
May 20 04:29:40.638582 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efb99414-5082-433d-a17b-cdbe4ee427e1 req-0a6b46fe-153c-4518-b6bd-fad6ce5e021e tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:40.640119 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-efb99414-5082-433d-a17b-cdbe4ee427e1 req-0a6b46fe-153c-4518-b6bd-fad6ce5e021e tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 946 time: 0.0852551
May 20 04:29:40.692260 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-efb99414-5082-433d-a17b-cdbe4ee427e1 req-9f93e753-9a15-4ea2-9c75-9d1a366060c9 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/security-groups?id=34e473fa-df05-422b-9abc-99aed131bade&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0426629
May 20 04:29:41.904304 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-513b7263-e4fa-49d6-82df-6e0ed7366a30 req-aeef1d35-5a4b-4df5-8cf1-c26ab93fb2f4 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:41.906220 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-513b7263-e4fa-49d6-82df-6e0ed7366a30 req-aeef1d35-5a4b-4df5-8cf1-c26ab93fb2f4 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 946 time: 0.0961361
May 20 04:29:42.070967 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-513b7263-e4fa-49d6-82df-6e0ed7366a30 req-2b32d7c8-7c55-4794-90d9-25a66470c1b2 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/security-groups?id=34e473fa-df05-422b-9abc-99aed131bade&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1583860
May 20 04:29:43.277552 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f89a7a66-8fdd-4a48-a8fc-149afc497676 req-afc11290-caca-4c9e-9c8b-e7b62ed6fdaf tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:43.280770 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-f89a7a66-8fdd-4a48-a8fc-149afc497676 req-afc11290-caca-4c9e-9c8b-e7b62ed6fdaf tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 946 time: 0.0935967
May 20 04:29:43.331522 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-f89a7a66-8fdd-4a48-a8fc-149afc497676 req-3f89c751-74ad-4aba-8c77-1292a6fb89e5 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/security-groups?id=34e473fa-df05-422b-9abc-99aed131bade&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0458832
May 20 04:29:44.543992 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04372552-e718-4b1f-b206-c966344d2f42 req-35fe2dcb-dbd0-49e6-86a7-0595ebb111d7 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:44.545539 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-04372552-e718-4b1f-b206-c966344d2f42 req-35fe2dcb-dbd0-49e6-86a7-0595ebb111d7 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 946 time: 0.0902224
May 20 04:29:44.594868 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-04372552-e718-4b1f-b206-c966344d2f42 req-6f76bff0-7488-4524-95b8-8e1de5414203 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/security-groups?id=34e473fa-df05-422b-9abc-99aed131bade&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0430758
May 20 04:29:45.806847 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b05ca45b-e5b1-42f5-96aa-2bc6e95c0dfd req-a1869258-e184-4bcd-ae4c-ae4d9499bf85 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:45.808456 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-b05ca45b-e5b1-42f5-96aa-2bc6e95c0dfd req-a1869258-e184-4bcd-ae4c-ae4d9499bf85 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 946 time: 0.0894725
May 20 04:29:45.868800 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-b05ca45b-e5b1-42f5-96aa-2bc6e95c0dfd req-d24eb015-4da9-4904-a048-654f315d5f9d tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/security-groups?id=34e473fa-df05-422b-9abc-99aed131bade&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0530498
May 20 04:29:47.094219 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5df7fab5-14ae-4b2b-9d82-aaba91ed0382 req-cd9e9169-f9da-4a8b-81a2-058a35e8805f tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:47.096205 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-5df7fab5-14ae-4b2b-9d82-aaba91ed0382 req-cd9e9169-f9da-4a8b-81a2-058a35e8805f tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 946 time: 0.1031537
May 20 04:29:47.148931 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-5df7fab5-14ae-4b2b-9d82-aaba91ed0382 req-fd30f3d5-749c-4631-9405-edf3227ef9b3 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/security-groups?id=34e473fa-df05-422b-9abc-99aed131bade&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0450625
May 20 04:29:47.902254 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1560588d-af15-4055-8c7b-ec09e6990931 req-c783b15f-1618-4c12-b549-8ad0edf84346 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:47.903816 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-1560588d-af15-4055-8c7b-ec09e6990931 req-c783b15f-1618-4c12-b549-8ad0edf84346 service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=a1319e4a0fc74f98ba4bb88d8a04086b&device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 1099 time: 0.0845568
May 20 04:29:48.066586 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1560588d-af15-4055-8c7b-ec09e6990931 req-b8cd5c6e-8c0f-4fee-82d4-e13f4e9e0907 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:48.068740 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-1560588d-af15-4055-8c7b-ec09e6990931 req-b8cd5c6e-8c0f-4fee-82d4-e13f4e9e0907 service neutron] 10.222.0.82 "GET /v2.0/networks?id=e31171ff-f097-446e-b691-bef7aad2fb3b HTTP/1.1" status: 200  len: 910 time: 0.1570678
May 20 04:29:48.184237 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-1560588d-af15-4055-8c7b-ec09e6990931 req-a4a58cde-3740-4702-abc5-312ceeb46473 service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=9c846663-c90b-41d4-a8d1-1086882ba27e HTTP/1.1" status: 200  len: 1002 time: 0.1044400
May 20 04:29:48.272126 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1560588d-af15-4055-8c7b-ec09e6990931 req-5d972246-daba-4b18-8e0d-21be3bb34db4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:48.274237 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-1560588d-af15-4055-8c7b-ec09e6990931 req-5d972246-daba-4b18-8e0d-21be3bb34db4 service neutron] 10.222.0.82 "GET /v2.0/subnets?id=410f59de-055d-4298-96bf-5d9a7712368d HTTP/1.1" status: 200  len: 848 time: 0.0825212
May 20 04:29:48.413134 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1560588d-af15-4055-8c7b-ec09e6990931 req-2f41c806-238a-46c1-9ab0-9bcdb044bc84 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:48.414571 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-1560588d-af15-4055-8c7b-ec09e6990931 req-2f41c806-238a-46c1-9ab0-9bcdb044bc84 service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=e31171ff-f097-446e-b691-bef7aad2fb3b&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1331923
May 20 04:29:48.428429 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86534a50-c072-4d0a-aeac-139a18c5494e req-20d7e6f8-e155-452a-9380-029cf56ba4b2 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:48.428897 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-86534a50-c072-4d0a-aeac-139a18c5494e req-20d7e6f8-e155-452a-9380-029cf56ba4b2 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 946 time: 0.1169190
May 20 04:29:48.552756 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-01fcf9e8-54fa-4be5-931d-aa038c8e7113 req-2e4f3604-762f-45e2-a213-41fa588739c1 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-358881961&fields=id&tenant_id=e6fe6bea38b946a5a97ea42bf787f1b3 HTTP/1.1" status: 200  len: 267 time: 0.0488851
May 20 04:29:48.569351 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-86534a50-c072-4d0a-aeac-139a18c5494e req-b9eab86b-614d-4388-97a2-b819a4fc0f41 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/security-groups?id=34e473fa-df05-422b-9abc-99aed131bade&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1204031
May 20 04:29:48.603280 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-1560588d-af15-4055-8c7b-ec09e6990931 req-711e3bca-3dd3-431f-bbb6-b553f1fc5e97 service neutron] 10.222.0.82 "GET /v2.0/networks/e31171ff-f097-446e-b691-bef7aad2fb3b?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1735198
May 20 04:29:48.642764 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01fcf9e8-54fa-4be5-931d-aa038c8e7113 req-1f78c530-d92c-49c9-aa22-155addcfe1ca tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:48.644309 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-01fcf9e8-54fa-4be5-931d-aa038c8e7113 req-1f78c530-d92c-49c9-aa22-155addcfe1ca tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 984 time: 0.0850136
May 20 04:29:48.658777 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.v2.base [req-01fcf9e8-54fa-4be5-931d-aa038c8e7113 req-6132a66e-db83-406d-88e8-7496df9df35a tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Request body: {'port': {'security_groups': ['c188bb94-d954-43bd-b580-a3037bfce567']}} {{(pid=91686) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:29:48.758900 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-1560588d-af15-4055-8c7b-ec09e6990931 req-d731475e-3cce-4956-8475-f76a862ff764 service neutron] 10.222.0.82 "GET /v2.0/networks/e31171ff-f097-446e-b691-bef7aad2fb3b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1484625
May 20 04:29:48.800666 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [req-01fcf9e8-54fa-4be5-931d-aa038c8e7113 req-6132a66e-db83-406d-88e8-7496df9df35a tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:49.140734 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.db [req-01fcf9e8-54fa-4be5-931d-aa038c8e7113 req-6132a66e-db83-406d-88e8-7496df9df35a tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] For port 11028190-b228-415d-b5ee-2da1d6800073, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=11028190-b228-415d-b5ee-2da1d6800073,segment=NetworkSegment(b84e1e85-c58b-4982-b59b-cb9584098e15),segment_id=b84e1e85-c58b-4982-b59b-cb9584098e15)] {{(pid=91686) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:29:49.170777 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [req-01fcf9e8-54fa-4be5-931d-aa038c8e7113 req-6132a66e-db83-406d-88e8-7496df9df35a tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Notify callbacks [] for port, precommit_update {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:49.176579 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [req-01fcf9e8-54fa-4be5-931d-aa038c8e7113 req-6132a66e-db83-406d-88e8-7496df9df35a tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2145029'] for port, after_update {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:49.183138 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:29:49.188860 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] get_ports_and_sgs() called for port_ids ['11028190-b228-415d-b5ee-2da1d6800073'] {{(pid=91688) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 04:29:49.247754 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01fcf9e8-54fa-4be5-931d-aa038c8e7113 req-6132a66e-db83-406d-88e8-7496df9df35a tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:49.248398 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [req-01fcf9e8-54fa-4be5-931d-aa038c8e7113 req-6132a66e-db83-406d-88e8-7496df9df35a tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for port, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:49.249937 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-01fcf9e8-54fa-4be5-931d-aa038c8e7113 req-6132a66e-db83-406d-88e8-7496df9df35a tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "PUT /v2.0/ports/11028190-b228-415d-b5ee-2da1d6800073 HTTP/1.1" status: 200  len: 942 time: 0.5967059
May 20 04:29:49.253863 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'badc13d9-1d9b-4a5d-a461-b96945f2edc9', 'tag': '11028190-b228-415d-b5ee-2da1d6800073'}] {{(pid=91686) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:29:49.263450 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 45318) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:29:49.287036 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6132a66e-db83-406d-88e8-7496df9df35a tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Pushing event updated for resources: {'Port': ['ID=11028190-b228-415d-b5ee-2da1d6800073,revision_number=7']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:29:49.293758 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-6132a66e-db83-406d-88e8-7496df9df35a tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:29:49.378821 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'badc13d9-1d9b-4a5d-a461-b96945f2edc9', 'tag': '11028190-b228-415d-b5ee-2da1d6800073', 'status': 'completed', 'code': 200}
May 20 04:29:49.386392 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-b9699f0a-fb67-4e2f-b135-0604944a57cf tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Notify callbacks [] for security_group, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:49.402456 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] get_ports_and_sgs() called for port_ids ['11028190-b228-415d-b5ee-2da1d6800073'] {{(pid=91688) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 04:29:49.466807 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-b9699f0a-fb67-4e2f-b135-0604944a57cf tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Notify callbacks [] for security_group, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:49.533840 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65e1f983-1c75-4819-9f62-fd47bca1b12d req-f6153edf-946b-4b19-92cd-41ab9e932d26 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:49.535223 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-65e1f983-1c75-4819-9f62-fd47bca1b12d req-f6153edf-946b-4b19-92cd-41ab9e932d26 service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=e6fe6bea38b946a5a97ea42bf787f1b3&device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 1098 time: 0.1276720
May 20 04:29:49.604171 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-6ea06267-0af8-4276-9d33-34466eda0786 None None] Provisioning complete for port 11028190-b228-415d-b5ee-2da1d6800073 triggered by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:29:49.604500 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-6ea06267-0af8-4276-9d33-34466eda0786 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:49.637853 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-b9699f0a-fb67-4e2f-b135-0604944a57cf tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:49.650455 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-0a1274b9-f2dd-4dda-9428-519f4e79853c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:29:49.671964 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9699f0a-fb67-4e2f-b135-0604944a57cf tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=84c434c2-401c-4319-a0ff-8ceaf7cae545,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:29:49.676711 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-b9699f0a-fb67-4e2f-b135-0604944a57cf tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:29:49.690687 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-b9699f0a-fb67-4e2f-b135-0604944a57cf tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Notify callbacks [] for security_group, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:49.695055 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-b9699f0a-fb67-4e2f-b135-0604944a57cf tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "DELETE /v2.0/security-groups/84c434c2-401c-4319-a0ff-8ceaf7cae545 HTTP/1.1" status: 204  len: 168 time: 0.4270868
May 20 04:29:49.695408 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 45326) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:29:49.716739 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65e1f983-1c75-4819-9f62-fd47bca1b12d req-fa3f9847-fa15-45c3-84c1-0afdf39908d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:49.718464 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-65e1f983-1c75-4819-9f62-fd47bca1b12d req-fa3f9847-fa15-45c3-84c1-0afdf39908d7 service neutron] 10.222.0.82 "GET /v2.0/networks?id=fdf92998-25fa-4179-ab1b-131af0ce059a HTTP/1.1" status: 200  len: 916 time: 0.1762424
May 20 04:29:49.933886 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-65e1f983-1c75-4819-9f62-fd47bca1b12d req-7aca5c73-7b6c-482f-a0e2-659590a870aa service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=11028190-b228-415d-b5ee-2da1d6800073 HTTP/1.1" status: 200  len: 1001 time: 0.2073524
May 20 04:29:50.000333 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65e1f983-1c75-4819-9f62-fd47bca1b12d req-edbd4866-7842-40ee-8fe5-ac30df3c9c2d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:50.001797 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-65e1f983-1c75-4819-9f62-fd47bca1b12d req-edbd4866-7842-40ee-8fe5-ac30df3c9c2d service neutron] 10.222.0.82 "GET /v2.0/subnets?id=e905ed23-00d1-4991-b3bb-e1a1e32b4c86 HTTP/1.1" status: 200  len: 854 time: 0.0598803
May 20 04:29:50.020348 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-709f2f42-7ef2-4ed2-826b-917d717807bb req-d13efc9b-cdc6-4885-8bee-e3dfcee090f4 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:50.022121 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-709f2f42-7ef2-4ed2-826b-917d717807bb req-d13efc9b-cdc6-4885-8bee-e3dfcee090f4 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 946 time: 0.2494409
May 20 04:29:50.084387 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-709f2f42-7ef2-4ed2-826b-917d717807bb req-948c355e-4bc7-4b5b-9a17-a897c101171e tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/security-groups?id=34e473fa-df05-422b-9abc-99aed131bade&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0560608
May 20 04:29:50.084911 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65e1f983-1c75-4819-9f62-fd47bca1b12d req-45e5814a-9e13-4036-95ab-8d6964efab15 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:50.087674 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-65e1f983-1c75-4819-9f62-fd47bca1b12d req-45e5814a-9e13-4036-95ab-8d6964efab15 service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=fdf92998-25fa-4179-ab1b-131af0ce059a&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0780478
May 20 04:29:50.104183 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.plugin [None req-4d3acaf5-dad8-492b-9930-5f5922aa88db tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Deleting port b0ccda3d-4db4-4d4c-9952-99d4400de3f8 {{(pid=91686) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 04:29:50.104578 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-4d3acaf5-dad8-492b-9930-5f5922aa88db tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8782892520551'] for port, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:50.231567 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-4d3acaf5-dad8-492b-9930-5f5922aa88db tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1718922'] for port, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:50.231819 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-4d3acaf5-dad8-492b-9930-5f5922aa88db tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:50.250305 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-65e1f983-1c75-4819-9f62-fd47bca1b12d req-ae1c9b0a-29ce-40a7-91e8-542cb1534494 service neutron] 10.222.0.82 "GET /v2.0/networks/fdf92998-25fa-4179-ab1b-131af0ce059a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1547151
May 20 04:29:50.368018 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.plugin [None req-4d3acaf5-dad8-492b-9930-5f5922aa88db tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Calling delete_port for b0ccda3d-4db4-4d4c-9952-99d4400de3f8 owned by network:floatingip {{(pid=91686) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 04:29:50.396374 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-65e1f983-1c75-4819-9f62-fd47bca1b12d req-300ce928-aa01-4e12-96ae-f081c47d7bec service neutron] 10.222.0.82 "GET /v2.0/networks/fdf92998-25fa-4179-ab1b-131af0ce059a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1389856
May 20 04:29:50.520242 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-4d3acaf5-dad8-492b-9930-5f5922aa88db tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8782892522936', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8782892108804', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2145052'] for port, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:50.525726 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-09871fe5-a064-470b-975b-e10431460f4f tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:29:50.573531 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d3acaf5-dad8-492b-9930-5f5922aa88db tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Pushing event deleted for resources: {'Port': ['ID=b0ccda3d-4db4-4d4c-9952-99d4400de3f8,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:29:50.577062 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-4d3acaf5-dad8-492b-9930-5f5922aa88db tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:29:50.689337 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-4d3acaf5-dad8-492b-9930-5f5922aa88db tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Notify callbacks [] for floatingip, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:50.690183 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.db.l3_db [None req-4d3acaf5-dad8-492b-9930-5f5922aa88db tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Floating IP cdf6f05c-2933-4ca5-ace6-6998562ef031 disassociated (deleted). External IP: 172.27.1.219, port: 11028190-b228-415d-b5ee-2da1d6800073.
May 20 04:29:51.202506 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4d3acaf5-dad8-492b-9930-5f5922aa88db tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Router 9c2e249a-3b4f-4271-8226-b44c455943cc has already been hosted by L3 agent 02733fc0-fc9c-4e29-bc03-c27a792d539d {{(pid=91686) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 04:29:51.448830 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4d3acaf5-dad8-492b-9930-5f5922aa88db tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Notify agent at l3_agent.dv-cinder-790910-4-iscsi the message routers_updated {{(pid=91686) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 04:29:51.457787 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae654bb5-505f-440c-9cff-28c817b7a120 req-96618cff-d2fa-4277-9676-686c5d3c1b1d tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:51.459498 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-ae654bb5-505f-440c-9cff-28c817b7a120 req-96618cff-d2fa-4277-9676-686c5d3c1b1d tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 946 time: 0.1963394
May 20 04:29:51.461169 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dc73c2d5-b3fa-4404-91ac-d958b890875b None None] Sync routers for ids ['9c2e249a-3b4f-4271-8226-b44c455943cc'] in dv-cinder-790910-4-iscsi {{(pid=91688) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 04:29:51.471703 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dc73c2d5-b3fa-4404-91ac-d958b890875b None None] Routers {'9c2e249a-3b4f-4271-8226-b44c455943cc'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91688) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:29:51.472608 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-dc73c2d5-b3fa-4404-91ac-d958b890875b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced15b4160>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:29:33Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['9c2e249a-3b4f-4271-8226-b44c455943cc'], 'active': True} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:29:51.528325 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-ae654bb5-505f-440c-9cff-28c817b7a120 req-a5a99fe9-3684-40da-a81b-f4fcc8bb73a9 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/security-groups?id=34e473fa-df05-422b-9abc-99aed131bade&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0583510
May 20 04:29:51.529395 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-4d3acaf5-dad8-492b-9930-5f5922aa88db tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for floatingip, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:51.592394 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-4d3acaf5-dad8-492b-9930-5f5922aa88db tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "DELETE /v2.0/floatingips/cdf6f05c-2933-4ca5-ace6-6998562ef031 HTTP/1.1" status: 204  len: 168 time: 1.8952096
May 20 04:29:51.593627 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'badc13d9-1d9b-4a5d-a461-b96945f2edc9', 'tag': '11028190-b228-415d-b5ee-2da1d6800073'}] {{(pid=91686) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:29:51.669356 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'badc13d9-1d9b-4a5d-a461-b96945f2edc9', 'tag': '11028190-b228-415d-b5ee-2da1d6800073', 'status': 'completed', 'code': 200}
May 20 04:29:51.717363 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvr_db [None req-dc73c2d5-b3fa-4404-91ac-d958b890875b None None] Set router 9c2e249a-3b4f-4271-8226-b44c455943cc gateway port host: dv-cinder-790910-4-iscsi {{(pid=91688) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:29:51.778627 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-508f3567-8dc1-47a1-81b0-1691cda551d5 req-c56e45aa-2161-4a2a-8d83-ee14223b5c22 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:51.780489 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-508f3567-8dc1-47a1-81b0-1691cda551d5 req-c56e45aa-2161-4a2a-8d83-ee14223b5c22 service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=e6fe6bea38b946a5a97ea42bf787f1b3&device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 1098 time: 0.0859308
May 20 04:29:51.935884 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-508f3567-8dc1-47a1-81b0-1691cda551d5 req-08618384-bf05-4bd8-82a2-92988d01fd5e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:51.937752 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-508f3567-8dc1-47a1-81b0-1691cda551d5 req-08618384-bf05-4bd8-82a2-92988d01fd5e service neutron] 10.222.0.82 "GET /v2.0/networks?id=fdf92998-25fa-4179-ab1b-131af0ce059a HTTP/1.1" status: 200  len: 916 time: 0.1512411
May 20 04:29:52.008080 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-508f3567-8dc1-47a1-81b0-1691cda551d5 req-a4382b4a-e2e5-47d7-9e79-4d4acc00d1cf service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=11028190-b228-415d-b5ee-2da1d6800073 HTTP/1.1" status: 200  len: 217 time: 0.0618341
May 20 04:29:52.071307 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-dc73c2d5-b3fa-4404-91ac-d958b890875b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced15b4160>, [{'id': '9c2e249a-3b4f-4271-8226-b44c455943cc', 'name': 'tempest-TestMinimumBasicScenario-1023892954-router', 'tenant_id': 'e6fe6bea38b946a5a97ea42bf787f1b3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.213'}], 'enable_snat': True}, 'gw_port_id': 'b4b174b3-1436-4e17-8fa3-97243bad59c3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:23:14Z', 'updated_at': '2021-05-20T04:23:21Z', 'revision_number': 4, 'project_id': 'e6fe6bea38b946a5a97ea42bf787f1b3', 'gw_port': {'id': 'b4b174b3-1436-4e17-8fa3-97243bad59c3', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:4d:2f:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c2e249a-3b4f-4271-8226-b44c455943cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 330, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:23:15Z', 'updated_at': '2021-05-20T04:23:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_interfaces': [{'id': '907a9337-b889-44b2-b856-48e472d2bc38', 'name': '', 'network_id': 'fdf92998-25fa-4179-ab1b-131af0ce059a', 'tenant_id': 'e6fe6bea38b946a5a97ea42bf787f1b3', 'mac_address': 'fa:16:3e:0f:d2:47', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c2e249a-3b4f-4271-8226-b44c455943cc', 'device_owner': 'network:router_interface', 'standard_attr_id': 333, 'fixed_ips': [{'subnet_id': 'e905ed23-00d1-4991-b3bb-e1a1e32b4c86', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:23:20Z', 'updated_at': '2021-05-20T04:23:36Z', 'revision_number': 5, 'project_id': 'e6fe6bea38b946a5a97ea42bf787f1b3', 'subnets': [{'id': 'e905ed23-00d1-4991-b3bb-e1a1e32b4c86', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:29:52.076206 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dc73c2d5-b3fa-4404-91ac-d958b890875b None None] Checking router: 9c2e249a-3b4f-4271-8226-b44c455943cc for host: dv-cinder-790910-4-iscsi {{(pid=91688) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 04:29:52.084983 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dc73c2d5-b3fa-4404-91ac-d958b890875b None None] Routers {'9c2e249a-3b4f-4271-8226-b44c455943cc'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91688) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:29:52.085597 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-dc73c2d5-b3fa-4404-91ac-d958b890875b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced15b4160>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:29:33Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['9c2e249a-3b4f-4271-8226-b44c455943cc'], 'active': True} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:29:52.087093 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-508f3567-8dc1-47a1-81b0-1691cda551d5 req-3a24cd76-a85c-4cbf-b4fe-86832c783412 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:52.088553 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-508f3567-8dc1-47a1-81b0-1691cda551d5 req-3a24cd76-a85c-4cbf-b4fe-86832c783412 service neutron] 10.222.0.82 "GET /v2.0/subnets?id=e905ed23-00d1-4991-b3bb-e1a1e32b4c86 HTTP/1.1" status: 200  len: 854 time: 0.0641930
May 20 04:29:52.170757 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-508f3567-8dc1-47a1-81b0-1691cda551d5 req-f82c7598-b5a1-42cf-816d-306699f3d9bf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:52.172218 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-508f3567-8dc1-47a1-81b0-1691cda551d5 req-f82c7598-b5a1-42cf-816d-306699f3d9bf service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=fdf92998-25fa-4179-ab1b-131af0ce059a&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0769954
May 20 04:29:52.297241 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvr_db [None req-dc73c2d5-b3fa-4404-91ac-d958b890875b None None] Set router 9c2e249a-3b4f-4271-8226-b44c455943cc gateway port host: dv-cinder-790910-4-iscsi {{(pid=91688) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:29:52.307338 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-508f3567-8dc1-47a1-81b0-1691cda551d5 req-c02b11d2-538c-4233-9f1f-e21bae4c3ec9 service neutron] 10.222.0.82 "GET /v2.0/networks/fdf92998-25fa-4179-ab1b-131af0ce059a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1273310
May 20 04:29:52.446621 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-508f3567-8dc1-47a1-81b0-1691cda551d5 req-45ced8da-deac-46bb-bb6d-2060d70f4393 service neutron] 10.222.0.82 "GET /v2.0/networks/fdf92998-25fa-4179-ab1b-131af0ce059a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1295037
May 20 04:29:52.619133 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-dc73c2d5-b3fa-4404-91ac-d958b890875b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced15b4160>, [{'id': '9c2e249a-3b4f-4271-8226-b44c455943cc', 'name': 'tempest-TestMinimumBasicScenario-1023892954-router', 'tenant_id': 'e6fe6bea38b946a5a97ea42bf787f1b3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.213'}], 'enable_snat': True}, 'gw_port_id': 'b4b174b3-1436-4e17-8fa3-97243bad59c3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:23:14Z', 'updated_at': '2021-05-20T04:23:21Z', 'revision_number': 4, 'project_id': 'e6fe6bea38b946a5a97ea42bf787f1b3', 'gw_port': {'id': 'b4b174b3-1436-4e17-8fa3-97243bad59c3', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:4d:2f:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c2e249a-3b4f-4271-8226-b44c455943cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 330, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:23:15Z', 'updated_at': '2021-05-20T04:23:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_interfaces': [{'id': '907a9337-b889-44b2-b856-48e472d2bc38', 'name': '', 'network_id': 'fdf92998-25fa-4179-ab1b-131af0ce059a', 'tenant_id': 'e6fe6bea38b946a5a97ea42bf787f1b3', 'mac_address': 'fa:16:3e:0f:d2:47', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c2e249a-3b4f-4271-8226-b44c455943cc', 'device_owner': 'network:router_interface', 'standard_attr_id': 333, 'fixed_ips': [{'subnet_id': 'e905ed23-00d1-4991-b3bb-e1a1e32b4c86', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:23:20Z', 'updated_at': '2021-05-20T04:23:36Z', 'revision_number': 5, 'project_id': 'e6fe6bea38b946a5a97ea42bf787f1b3', 'subnets': [{'id': 'e905ed23-00d1-4991-b3bb-e1a1e32b4c86', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:29:52.623383 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dc73c2d5-b3fa-4404-91ac-d958b890875b None None] The sync data for ids ['9c2e249a-3b4f-4271-8226-b44c455943cc'] in dv-cinder-790910-4-iscsi is: [{'id': '9c2e249a-3b4f-4271-8226-b44c455943cc', 'name': 'tempest-TestMinimumBasicScenario-1023892954-router', 'tenant_id': 'e6fe6bea38b946a5a97ea42bf787f1b3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.213'}], 'enable_snat': True}, 'gw_port_id': 'b4b174b3-1436-4e17-8fa3-97243bad59c3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:23:14Z', 'updated_at': '2021-05-20T04:23:21Z', 'revision_number': 4, 'project_id': 'e6fe6bea38b946a5a97ea42bf787f1b3', 'gw_port': {'id': 'b4b174b3-1436-4e17-8fa3-97243bad59c3', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:4d:2f:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c2e249a-3b4f-4271-8226-b44c455943cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 330, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:23:15Z', 'updated_at': '2021-05-20T04:23:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_interfaces': [{'id': '907a9337-b889-44b2-b856-48e472d2bc38', 'name': '', 'network_id': 'fdf92998-25fa-4179-ab1b-131af0ce059a', 'tenant_id': 'e6fe6bea38b946a5a97ea42bf787f1b3', 'mac_address': 'fa:16:3e:0f:d2:47', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c2e249a-3b4f-4271-8226-b44c455943cc', 'device_owner': 'network:router_interface', 'standard_attr_id': 333, 'fixed_ips': [{'subnet_id': 'e905ed23-00d1-4991-b3bb-e1a1e32b4c86', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:23:20Z', 'updated_at': '2021-05-20T04:23:36Z', 'revision_number': 5, 'project_id': 'e6fe6bea38b946a5a97ea42bf787f1b3', 'subnets': [{'id': 'e905ed23-00d1-4991-b3bb-e1a1e32b4c86', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91688) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 04:29:52.736395 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-808ec7e9-c7f0-4eb1-8d0c-d3af20b17c1f req-3f2d5e0b-89e3-4bf9-b8dd-63389bef29a2 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:52.737923 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-808ec7e9-c7f0-4eb1-8d0c-d3af20b17c1f req-3f2d5e0b-89e3-4bf9-b8dd-63389bef29a2 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 946 time: 0.0974994
May 20 04:29:52.785665 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-808ec7e9-c7f0-4eb1-8d0c-d3af20b17c1f req-90e6c208-d371-4612-af2e-f50679b14e14 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/security-groups?id=34e473fa-df05-422b-9abc-99aed131bade&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0415275
May 20 04:29:52.908010 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fac30d7d-c5d2-4de1-a9b1-86c6636eafc8 None None] New status for floating IP cdf6f05c-2933-4ca5-ace6-6998562ef031: DOWN {{(pid=91689) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 20 04:29:53.191459 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 45360) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:29:53.195695 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efc3e69b-2b7c-4010-90b9-c15a78568d42 req-25e57df6-a618-4496-ad43-de4e7d472381 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:53.196906 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-efc3e69b-2b7c-4010-90b9-c15a78568d42 req-25e57df6-a618-4496-ad43-de4e7d472381 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 946 time: 0.0951307
May 20 04:29:53.254634 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-efc3e69b-2b7c-4010-90b9-c15a78568d42 req-f6f41b7a-f9f8-4e9d-89a8-268ab0548043 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/security-groups?id=34e473fa-df05-422b-9abc-99aed131bade&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0474322
May 20 04:29:53.321494 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-9e548b17-3291-4c96-8c8d-9e4af70c2833 req-d939b767-2a48-4d32-8518-dee707a0d649 service neutron] 10.222.0.71 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18&fields=id&fields=resource_request HTTP/1.1" status: 200  len: 255 time: 0.1285789
May 20 04:29:53.416830 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 9c846663-c90b-41d4-a8d1-1086882ba27e no longer exists at agent hyperv_hv-cinder-79091 {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 04:29:53.553723 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:53.587374 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '9c846663-c90b-41d4-a8d1-1086882ba27e'}] {{(pid=91688) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:29:53.598695 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port 9c846663-c90b-41d4-a8d1-1086882ba27e, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=9c846663-c90b-41d4-a8d1-1086882ba27e,segment=NetworkSegment(e5874c72-d111-4955-a5aa-fbad5f078a34),segment_id=e5874c72-d111-4955-a5aa-fbad5f078a34)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:29:53.606219 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:53.610652 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:29:53.655754 dv-cinder-790910-4-iscsi neutron-server[91688]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': '940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': '9c846663-c90b-41d4-a8d1-1086882ba27e', 'code': 422} returned with failed status
May 20 04:29:53.700167 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Pushing event updated for resources: {'Port': ['ID=9c846663-c90b-41d4-a8d1-1086882ba27e,revision_number=6']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:29:53.703883 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:29:54.446747 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-213bf435-edb1-4012-b404-823769d22878 req-e4aafbfe-168f-49a7-a8fa-ede3edb4d2de tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:54.448783 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-213bf435-edb1-4012-b404-823769d22878 req-e4aafbfe-168f-49a7-a8fa-ede3edb4d2de tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 944 time: 0.0867546
May 20 04:29:54.494688 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-213bf435-edb1-4012-b404-823769d22878 req-69c26606-62e7-43c0-a315-2bdbf1e1d868 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/security-groups?id=34e473fa-df05-422b-9abc-99aed131bade&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0398359
May 20 04:29:55.062037 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35676b42-966d-4473-91ae-c661c59bc7ce req-c7dbf310-4df4-4b67-a308-66b2313ed282 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:55.063500 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-35676b42-966d-4473-91ae-c661c59bc7ce req-c7dbf310-4df4-4b67-a308-66b2313ed282 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 945 time: 0.0854607
May 20 04:29:55.200130 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-35676b42-966d-4473-91ae-c661c59bc7ce req-a6d3e9dc-45a9-4e80-b9f2-bb858aba24c2 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Synchronizing usage tracker for tenant:e6fe6bea38b946a5a97ea42bf787f1b3 on resource:security_group {{(pid=91687) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:29:55.217881 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-35676b42-966d-4473-91ae-c661c59bc7ce req-a6d3e9dc-45a9-4e80-b9f2-bb858aba24c2 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Unset dirty status for tenant:e6fe6bea38b946a5a97ea42bf787f1b3 on resource:security_group {{(pid=91687) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:29:55.219510 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-35676b42-966d-4473-91ae-c661c59bc7ce req-a6d3e9dc-45a9-4e80-b9f2-bb858aba24c2 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1480441
May 20 04:29:55.343394 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e548b17-3291-4c96-8c8d-9e4af70c2833 req-270fa349-5845-47ff-b6eb-1f9f7396c087 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:55.344877 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9e548b17-3291-4c96-8c8d-9e4af70c2833 req-270fa349-5845-47ff-b6eb-1f9f7396c087 service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18&tenant_id=a1319e4a0fc74f98ba4bb88d8a04086b HTTP/1.1" status: 200  len: 1097 time: 0.0727961
May 20 04:29:55.442773 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e548b17-3291-4c96-8c8d-9e4af70c2833 req-2ba78e34-d40c-4ddf-829e-d854dd704889 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:55.444311 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9e548b17-3291-4c96-8c8d-9e4af70c2833 req-2ba78e34-d40c-4ddf-829e-d854dd704889 service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=a1319e4a0fc74f98ba4bb88d8a04086b&device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 1097 time: 0.0752242
May 20 04:29:55.586227 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e548b17-3291-4c96-8c8d-9e4af70c2833 req-4af4c123-426e-4830-9c3d-9e05b7e96f9a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:55.587687 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9e548b17-3291-4c96-8c8d-9e4af70c2833 req-4af4c123-426e-4830-9c3d-9e05b7e96f9a service neutron] 10.222.0.82 "GET /v2.0/networks?id=e31171ff-f097-446e-b691-bef7aad2fb3b HTTP/1.1" status: 200  len: 910 time: 0.1356459
May 20 04:29:55.692944 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9e548b17-3291-4c96-8c8d-9e4af70c2833 req-e23b6c09-bdf2-4cf5-8aae-9bf114b8b991 service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=9c846663-c90b-41d4-a8d1-1086882ba27e HTTP/1.1" status: 200  len: 1000 time: 0.0983381
May 20 04:29:55.695084 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be1878ae-0308-483b-b58b-26c5ff6a70dc req-19dca3a9-bec5-4104-9435-d09cbaa2d571 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:55.696693 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-be1878ae-0308-483b-b58b-26c5ff6a70dc req-19dca3a9-bec5-4104-9435-d09cbaa2d571 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 944 time: 0.0927529
May 20 04:29:55.745339 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-be1878ae-0308-483b-b58b-26c5ff6a70dc req-6d9b633c-1624-4644-aaf9-bec86966d733 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/security-groups?id=34e473fa-df05-422b-9abc-99aed131bade&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0425413
May 20 04:29:55.766136 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e548b17-3291-4c96-8c8d-9e4af70c2833 req-eff902d5-7b4e-48a6-bb38-33a8e2d33b5e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:55.767589 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9e548b17-3291-4c96-8c8d-9e4af70c2833 req-eff902d5-7b4e-48a6-bb38-33a8e2d33b5e service neutron] 10.222.0.82 "GET /v2.0/subnets?id=410f59de-055d-4298-96bf-5d9a7712368d HTTP/1.1" status: 200  len: 848 time: 0.0661125
May 20 04:29:55.847142 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e548b17-3291-4c96-8c8d-9e4af70c2833 req-1b5d7665-09f1-4b77-a5ec-477d7348258d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:55.848546 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9e548b17-3291-4c96-8c8d-9e4af70c2833 req-1b5d7665-09f1-4b77-a5ec-477d7348258d service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=e31171ff-f097-446e-b691-bef7aad2fb3b&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0735049
May 20 04:29:55.986661 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9e548b17-3291-4c96-8c8d-9e4af70c2833 req-93b59704-1d61-455d-9d89-23f70eef9dff service neutron] 10.222.0.82 "GET /v2.0/networks/e31171ff-f097-446e-b691-bef7aad2fb3b?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1299102
May 20 04:29:56.165146 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9e548b17-3291-4c96-8c8d-9e4af70c2833 req-7ece2b9f-0ca8-42a5-b8d1-24fa0b2ca20d service neutron] 10.222.0.82 "GET /v2.0/networks/e31171ff-f097-446e-b691-bef7aad2fb3b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1702480
May 20 04:29:56.418795 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c466af86-3604-4664-9494-30511b14435c req-396b213b-758c-436c-a7a4-b58af15f10c1 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:56.419387 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [req-c466af86-3604-4664-9494-30511b14435c req-396b213b-758c-436c-a7a4-b58af15f10c1 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Synchronizing usage tracker for tenant:e6fe6bea38b946a5a97ea42bf787f1b3 on resource:port {{(pid=91686) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:29:56.438094 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [req-c466af86-3604-4664-9494-30511b14435c req-396b213b-758c-436c-a7a4-b58af15f10c1 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Unset dirty status for tenant:e6fe6bea38b946a5a97ea42bf787f1b3 on resource:port {{(pid=91686) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:29:56.439899 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-c466af86-3604-4664-9494-30511b14435c req-396b213b-758c-436c-a7a4-b58af15f10c1 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 945 time: 0.1043174
May 20 04:29:56.495512 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-c466af86-3604-4664-9494-30511b14435c req-7ba88406-6925-4c4d-b5dc-0c5e0daa90b5 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0430958
May 20 04:29:56.935697 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3f40d18-933f-4d14-af8a-1da09e6d418a req-ec6639b0-2a18-4ed7-9470-47a203f6e154 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:56.937250 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-e3f40d18-933f-4d14-af8a-1da09e6d418a req-ec6639b0-2a18-4ed7-9470-47a203f6e154 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 944 time: 0.0832202
May 20 04:29:56.989439 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-e3f40d18-933f-4d14-af8a-1da09e6d418a req-a722a5e4-685e-40db-ae53-ad72182711e2 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/security-groups?id=34e473fa-df05-422b-9abc-99aed131bade&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0453053
May 20 04:29:57.410198 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4235c250-48da-4715-99d3-3c76e7f40a43 req-1bbeb4cc-3e49-416d-88af-76239ad8d4e5 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:57.411654 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4235c250-48da-4715-99d3-3c76e7f40a43 req-1bbeb4cc-3e49-416d-88af-76239ad8d4e5 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.82 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 945 time: 0.0864975
May 20 04:29:57.556215 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [req-4235c250-48da-4715-99d3-3c76e7f40a43 req-39f8ca69-b5e1-4a03-b94a-82e618104966 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Deleting port 11028190-b228-415d-b5ee-2da1d6800073 {{(pid=91687) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 04:29:57.556574 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-4235c250-48da-4715-99d3-3c76e7f40a43 req-39f8ca69-b5e1-4a03-b94a-82e618104966 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8782892520551'] for port, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:57.744509 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [req-4235c250-48da-4715-99d3-3c76e7f40a43 req-39f8ca69-b5e1-4a03-b94a-82e618104966 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] For port 11028190-b228-415d-b5ee-2da1d6800073, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=11028190-b228-415d-b5ee-2da1d6800073,segment=NetworkSegment(b84e1e85-c58b-4982-b59b-cb9584098e15),segment_id=b84e1e85-c58b-4982-b59b-cb9584098e15)] {{(pid=91687) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:29:57.744866 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-4235c250-48da-4715-99d3-3c76e7f40a43 req-39f8ca69-b5e1-4a03-b94a-82e618104966 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1718922'] for port, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:57.878619 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [req-4235c250-48da-4715-99d3-3c76e7f40a43 req-39f8ca69-b5e1-4a03-b94a-82e618104966 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Calling delete_port for 11028190-b228-415d-b5ee-2da1d6800073 owned by compute:nova {{(pid=91687) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 04:29:57.896802 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07322616-79f3-44ec-8a70-a9a870b08055 req-3094f2e8-0651-48cb-861e-2afb481d6ef1 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:57.898499 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-07322616-79f3-44ec-8a70-a9a870b08055 req-3094f2e8-0651-48cb-861e-2afb481d6ef1 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/ports?device_id=badc13d9-1d9b-4a5d-a461-b96945f2edc9 HTTP/1.1" status: 200  len: 945 time: 0.2617984
May 20 04:29:57.961876 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-07322616-79f3-44ec-8a70-a9a870b08055 req-e3f8f71a-85eb-43bf-8475-d09ebd8e0368 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.71 "GET /v2.0/security-groups?id=c188bb94-d954-43bd-b580-a3037bfce567&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0515931
May 20 04:29:58.070927 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-4235c250-48da-4715-99d3-3c76e7f40a43 req-39f8ca69-b5e1-4a03-b94a-82e618104966 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8782892522936', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8782892108804', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4162192'] for port, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:58.079905 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-a081b454-f278-43ba-955f-0b89597da459 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:29:58.083568 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] get_ports_and_sgs() called for port_ids ['11028190-b228-415d-b5ee-2da1d6800073'] {{(pid=91688) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 04:29:58.232338 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7753f40-6e33-44d9-8671-afbaf2a60a7e req-93689e0c-60ef-4e42-b376-a8323e415a48 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:58.233913 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-b7753f40-6e33-44d9-8671-afbaf2a60a7e req-93689e0c-60ef-4e42-b376-a8323e415a48 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 944 time: 0.0939875
May 20 04:29:58.256914 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39f8ca69-b5e1-4a03-b94a-82e618104966 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Pushing event deleted for resources: {'Port': ['ID=11028190-b228-415d-b5ee-2da1d6800073,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:29:58.260343 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-39f8ca69-b5e1-4a03-b94a-82e618104966 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.181s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:29:58.289670 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-b7753f40-6e33-44d9-8671-afbaf2a60a7e req-77449df0-8062-45d3-860e-7d352b2dc74d tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/security-groups?id=34e473fa-df05-422b-9abc-99aed131bade&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0488238
May 20 04:29:58.332654 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.l3_dvrscheduler_db [req-4235c250-48da-4715-99d3-3c76e7f40a43 req-39f8ca69-b5e1-4a03-b94a-82e618104966 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] No DVR routers for this DVR port 11028190-b228-415d-b5ee-2da1d6800073 on host hv-cinder-79091 {{(pid=91687) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 04:29:58.335529 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-4235c250-48da-4715-99d3-3c76e7f40a43 req-39f8ca69-b5e1-4a03-b94a-82e618104966 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for port, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:29:58.338162 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'badc13d9-1d9b-4a5d-a461-b96945f2edc9', 'name': 'network-vif-deleted', 'tag': '11028190-b228-415d-b5ee-2da1d6800073'}] {{(pid=91687) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:29:58.354811 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4235c250-48da-4715-99d3-3c76e7f40a43 req-39f8ca69-b5e1-4a03-b94a-82e618104966 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] 10.222.0.82 "DELETE /v2.0/ports/11028190-b228-415d-b5ee-2da1d6800073 HTTP/1.1" status: 204  len: 173 time: 0.9348924
May 20 04:29:58.393813 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'badc13d9-1d9b-4a5d-a461-b96945f2edc9', 'name': 'network-vif-deleted', 'tag': '11028190-b228-415d-b5ee-2da1d6800073', 'status': 'completed', 'code': 200}
May 20 04:29:59.492374 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abe54d57-ef90-4a43-8114-5edc762246d6 req-0639e5dd-94f5-4350-aec8-020d58882a04 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:29:59.493353 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-abe54d57-ef90-4a43-8114-5edc762246d6 req-0639e5dd-94f5-4350-aec8-020d58882a04 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 944 time: 0.0864711
May 20 04:29:59.545398 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-abe54d57-ef90-4a43-8114-5edc762246d6 req-fb61c26d-92c6-448d-bc7a-aeee7eb2795a tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/security-groups?id=34e473fa-df05-422b-9abc-99aed131bade&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0459256
May 20 04:29:59.808193 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 45464) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:29:59.871469 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-3d2d3b8a-3050-470f-8f27-30a702abef15 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:00.485516 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-7d046e63-974f-402d-80e9-609f3a8651fc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1716300'] for router_interface, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:00.733839 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34b60b11-3446-4d10-9834-bba66e6ab455 req-54d3e4f7-cd66-495a-9238-fcaa2e428d08 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:30:00.735391 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-34b60b11-3446-4d10-9834-bba66e6ab455 req-54d3e4f7-cd66-495a-9238-fcaa2e428d08 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 944 time: 0.0804064
May 20 04:30:00.786658 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-34b60b11-3446-4d10-9834-bba66e6ab455 req-b7c32559-6652-473a-97a6-e0c017fb7eed tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/security-groups?id=34e473fa-df05-422b-9abc-99aed131bade&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0445304
May 20 04:30:01.012019 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.plugin [None req-7d046e63-974f-402d-80e9-609f3a8651fc admin admin] Deleting port 907a9337-b889-44b2-b856-48e472d2bc38 {{(pid=91686) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 04:30:01.012019 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-7d046e63-974f-402d-80e9-609f3a8651fc admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8782892520551'] for port, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:01.144909 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.db [None req-7d046e63-974f-402d-80e9-609f3a8651fc admin admin] For port 907a9337-b889-44b2-b856-48e472d2bc38, host dv-cinder-790910-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=907a9337-b889-44b2-b856-48e472d2bc38,segment=NetworkSegment(b84e1e85-c58b-4982-b59b-cb9584098e15),segment_id=b84e1e85-c58b-4982-b59b-cb9584098e15)] {{(pid=91686) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:30:01.145292 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-7d046e63-974f-402d-80e9-609f3a8651fc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1718922'] for port, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:01.269901 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.plugin [None req-7d046e63-974f-402d-80e9-609f3a8651fc admin admin] Calling delete_port for 907a9337-b889-44b2-b856-48e472d2bc38 owned by network:router_interface {{(pid=91686) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 04:30:01.451784 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 11028190-b228-415d-b5ee-2da1d6800073 no longer exists at agent hyperv_hv-cinder-79091 {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 04:30:01.490473 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] No Port match for: 11028190-b228-415d-b5ee-2da1d6800073 {{(pid=91688) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 04:30:01.490825 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 11028190-b228-415d-b5ee-2da1d6800073 not bound to the agent host hv-cinder-79091 {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 04:30:01.574519 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-7d046e63-974f-402d-80e9-609f3a8651fc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8782892522936', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8782892108804', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2145052'] for port, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:01.579319 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-db3e56b1-3fb2-4c33-911d-32c38ad6aee8 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:30:01.624718 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d046e63-974f-402d-80e9-609f3a8651fc admin admin] Pushing event deleted for resources: {'Port': ['ID=907a9337-b889-44b2-b856-48e472d2bc38,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:30:01.656104 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-7d046e63-974f-402d-80e9-609f3a8651fc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:30:01.911875 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-7d046e63-974f-402d-80e9-609f3a8651fc admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1781439', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1717212'] for router_interface, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:01.990866 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8a8f881-aeeb-41e9-b881-55d06c181abf req-a26bf8d5-4774-4af5-9396-c2cc82de9e9d tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:30:01.992850 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-f8a8f881-aeeb-41e9-b881-55d06c181abf req-a26bf8d5-4774-4af5-9396-c2cc82de9e9d tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 944 time: 0.0859802
May 20 04:30:02.045240 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-f8a8f881-aeeb-41e9-b881-55d06c181abf req-60aad332-3abc-4595-83a5-5c68d37248ab tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/security-groups?id=34e473fa-df05-422b-9abc-99aed131bade&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0455213
May 20 04:30:02.404268 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7d046e63-974f-402d-80e9-609f3a8651fc admin admin] Router 9c2e249a-3b4f-4271-8226-b44c455943cc has already been hosted by L3 agent 02733fc0-fc9c-4e29-bc03-c27a792d539d {{(pid=91686) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 04:30:02.563989 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:02.593198 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7d046e63-974f-402d-80e9-609f3a8651fc admin admin] Notify agent at l3_agent.dv-cinder-790910-4-iscsi the message routers_updated {{(pid=91686) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 04:30:02.602192 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c984580b-a5ff-48ae-84aa-90e2ff1d1a57 None None] Sync routers for ids ['9c2e249a-3b4f-4271-8226-b44c455943cc'] in dv-cinder-790910-4-iscsi {{(pid=91688) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 04:30:02.606966 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-7d046e63-974f-402d-80e9-609f3a8651fc admin admin] 10.222.0.71 "PUT /v2.0/routers/9c2e249a-3b4f-4271-8226-b44c455943cc/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.7971129
May 20 04:30:02.609790 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 45480) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:30:02.613296 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c984580b-a5ff-48ae-84aa-90e2ff1d1a57 None None] Routers {'9c2e249a-3b4f-4271-8226-b44c455943cc'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91688) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:30:02.614004 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-c984580b-a5ff-48ae-84aa-90e2ff1d1a57 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced0ab8a30>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:29:33Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['9c2e249a-3b4f-4271-8226-b44c455943cc'], 'active': True} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:30:02.720875 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-4237c630-c36e-4780-9718-f09a08e8ac4c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:02.800596 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-da9bf0a5-2da9-4ded-94e3-1761874afc0b admin admin] Notify callbacks [] for router, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:02.844302 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvr_db [None req-c984580b-a5ff-48ae-84aa-90e2ff1d1a57 None None] Set router 9c2e249a-3b4f-4271-8226-b44c455943cc gateway port host: dv-cinder-790910-4-iscsi {{(pid=91688) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:30:03.041208 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-da9bf0a5-2da9-4ded-94e3-1761874afc0b admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:03.114860 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.plugin [None req-da9bf0a5-2da9-4ded-94e3-1761874afc0b admin admin] Deleting port b4b174b3-1436-4e17-8fa3-97243bad59c3 {{(pid=91686) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 04:30:03.115067 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-da9bf0a5-2da9-4ded-94e3-1761874afc0b admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8782892520551'] for port, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:03.182678 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-c984580b-a5ff-48ae-84aa-90e2ff1d1a57 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced0ab8a30>, [{'id': '9c2e249a-3b4f-4271-8226-b44c455943cc', 'name': 'tempest-TestMinimumBasicScenario-1023892954-router', 'tenant_id': 'e6fe6bea38b946a5a97ea42bf787f1b3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.213'}], 'enable_snat': True}, 'gw_port_id': 'b4b174b3-1436-4e17-8fa3-97243bad59c3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:23:14Z', 'updated_at': '2021-05-20T04:30:01Z', 'revision_number': 5, 'project_id': 'e6fe6bea38b946a5a97ea42bf787f1b3', 'gw_port': {'id': 'b4b174b3-1436-4e17-8fa3-97243bad59c3', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:4d:2f:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c2e249a-3b4f-4271-8226-b44c455943cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 330, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:23:15Z', 'updated_at': '2021-05-20T04:23:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi'}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:30:03.186828 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c984580b-a5ff-48ae-84aa-90e2ff1d1a57 None None] Checking router: 9c2e249a-3b4f-4271-8226-b44c455943cc for host: dv-cinder-790910-4-iscsi {{(pid=91688) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 04:30:03.195896 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c984580b-a5ff-48ae-84aa-90e2ff1d1a57 None None] Routers {'9c2e249a-3b4f-4271-8226-b44c455943cc'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91688) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:30:03.196511 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-c984580b-a5ff-48ae-84aa-90e2ff1d1a57 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced0ab8a30>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:30:03Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['9c2e249a-3b4f-4271-8226-b44c455943cc'], 'active': True} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:30:03.245097 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a61fac79-8e9a-4213-b153-1c2ea1779851 req-249c0030-da7a-4947-915b-c4a04515ed98 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:30:03.246822 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a61fac79-8e9a-4213-b153-1c2ea1779851 req-249c0030-da7a-4947-915b-c4a04515ed98 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 944 time: 0.0886338
May 20 04:30:03.262547 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.db [None req-da9bf0a5-2da9-4ded-94e3-1761874afc0b admin admin] For port b4b174b3-1436-4e17-8fa3-97243bad59c3, host dv-cinder-790910-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=b4b174b3-1436-4e17-8fa3-97243bad59c3,segment=NetworkSegment(8df49ec5-3fb9-4715-bc9a-f4019a6b55f9),segment_id=8df49ec5-3fb9-4715-bc9a-f4019a6b55f9)] {{(pid=91686) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:30:03.263040 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-da9bf0a5-2da9-4ded-94e3-1761874afc0b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1718922'] for port, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:03.300577 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a61fac79-8e9a-4213-b153-1c2ea1779851 req-4b6fd976-1ebe-4dab-9ded-7273109f0129 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/security-groups?id=34e473fa-df05-422b-9abc-99aed131bade&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0463820
May 20 04:30:03.404006 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.plugin [None req-da9bf0a5-2da9-4ded-94e3-1761874afc0b admin admin] Calling delete_port for b4b174b3-1436-4e17-8fa3-97243bad59c3 owned by network:router_gateway {{(pid=91686) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 04:30:03.409451 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ea4803bd-878f-47d5-9084-1ec41953c9db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:03.421841 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvr_db [None req-c984580b-a5ff-48ae-84aa-90e2ff1d1a57 None None] Set router 9c2e249a-3b4f-4271-8226-b44c455943cc gateway port host: None {{(pid=91688) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:30:03.532551 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-c984580b-a5ff-48ae-84aa-90e2ff1d1a57 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced0ab8a30>, [{'id': '9c2e249a-3b4f-4271-8226-b44c455943cc', 'name': 'tempest-TestMinimumBasicScenario-1023892954-router', 'tenant_id': 'e6fe6bea38b946a5a97ea42bf787f1b3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:23:14Z', 'updated_at': '2021-05-20T04:30:03Z', 'revision_number': 6, 'project_id': 'e6fe6bea38b946a5a97ea42bf787f1b3', 'gw_port_host': None}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:30:03.539850 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c984580b-a5ff-48ae-84aa-90e2ff1d1a57 None None] The sync data for ids ['9c2e249a-3b4f-4271-8226-b44c455943cc'] in dv-cinder-790910-4-iscsi is: [{'id': '9c2e249a-3b4f-4271-8226-b44c455943cc', 'name': 'tempest-TestMinimumBasicScenario-1023892954-router', 'tenant_id': 'e6fe6bea38b946a5a97ea42bf787f1b3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:23:14Z', 'updated_at': '2021-05-20T04:30:03Z', 'revision_number': 6, 'project_id': 'e6fe6bea38b946a5a97ea42bf787f1b3', 'gw_port_host': None}] {{(pid=91688) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 04:30:03.547868 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-da9bf0a5-2da9-4ded-94e3-1761874afc0b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8782892522936', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8782892108804', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2145052'] for port, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:03.552613 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-03e7c26f-7d2e-4047-815e-dd4016e30f08 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:30:03.712765 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da9bf0a5-2da9-4ded-94e3-1761874afc0b admin admin] Pushing event deleted for resources: {'Port': ['ID=b4b174b3-1436-4e17-8fa3-97243bad59c3,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:30:03.715948 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-da9bf0a5-2da9-4ded-94e3-1761874afc0b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.164s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:30:03.806908 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-da9bf0a5-2da9-4ded-94e3-1761874afc0b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1714023'] for router_gateway, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:03.988237 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-da9bf0a5-2da9-4ded-94e3-1761874afc0b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1796572', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-6237'] for router, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:03.988237 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-da9bf0a5-2da9-4ded-94e3-1761874afc0b admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:04.071255 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-da9bf0a5-2da9-4ded-94e3-1761874afc0b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-1712688'] for router, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:04.071787 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-da9bf0a5-2da9-4ded-94e3-1761874afc0b admin admin] Fanout notify agent at l3_agent the message router_deleted on router 9c2e249a-3b4f-4271-8226-b44c455943cc {{(pid=91686) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 20 04:30:04.084781 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-da9bf0a5-2da9-4ded-94e3-1761874afc0b admin admin] Notify callbacks [] for router, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:04.085956 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-da9bf0a5-2da9-4ded-94e3-1761874afc0b admin admin] 10.222.0.71 "DELETE /v2.0/routers/9c2e249a-3b4f-4271-8226-b44c455943cc HTTP/1.1" status: 204  len: 168 time: 1.4752858
May 20 04:30:04.088640 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 45490) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:30:04.154693 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.db_base_plugin_v2 [None req-eb891b67-fc57-46b8-bed4-d416d556bf53 admin admin] Deleting subnet e905ed23-00d1-4991-b3bb-e1a1e32b4c86 {{(pid=91686) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 20 04:30:04.158782 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-eb891b67-fc57-46b8-bed4-d416d556bf53 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:04.206892 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-eb891b67-fc57-46b8-bed4-d416d556bf53 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4081462'] for subnet, precommit_delete_associations {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:04.336254 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-eb891b67-fc57-46b8-bed4-d416d556bf53 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1504133'] for subnet, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:04.502981 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8292afc-8d40-4c1b-8008-da1bca3309f6 req-e8e0387d-f259-4f4d-bbb9-df2182f70510 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:30:04.504566 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-f8292afc-8d40-4c1b-8008-da1bca3309f6 req-e8e0387d-f259-4f4d-bbb9-df2182f70510 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 944 time: 0.0862336
May 20 04:30:04.561090 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-f8292afc-8d40-4c1b-8008-da1bca3309f6 req-169cd566-9491-4599-914c-e50e7121287b tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/security-groups?id=34e473fa-df05-422b-9abc-99aed131bade&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0502753
May 20 04:30:04.615583 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-eb891b67-fc57-46b8-bed4-d416d556bf53 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1504178', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-255887', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2114755', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2442237'] for subnet, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:04.624040 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:30:04.675793 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb891b67-fc57-46b8-bed4-d416d556bf53 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=e905ed23-00d1-4991-b3bb-e1a1e32b4c86,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:30:04.678375 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-eb891b67-fc57-46b8-bed4-d416d556bf53 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:30:04.681141 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-eb891b67-fc57-46b8-bed4-d416d556bf53 admin admin] Notify callbacks [] for subnet, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:04.687847 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fb4a154d-d84a-40ec-bddb-c60ead770a31 None None] Network fdf92998-25fa-4179-ab1b-131af0ce059a requested from dv-cinder-790910-4-iscsi {{(pid=91688) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 04:30:04.688899 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-eb891b67-fc57-46b8-bed4-d416d556bf53 admin admin] 10.222.0.71 "DELETE /v2.0/subnets/e905ed23-00d1-4991-b3bb-e1a1e32b4c86 HTTP/1.1" status: 204  len: 168 time: 0.5991032
May 20 04:30:04.691278 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 45498) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:30:04.806189 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-8d4860ca-8f2c-407a-9ca0-b360fbe3b115 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-593149'] for network, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:04.885466 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [None req-8d4860ca-8f2c-407a-9ca0-b360fbe3b115 admin admin] Deleting port f0e53282-814b-4fe9-93f9-cb2ba47962df {{(pid=91687) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 04:30:04.885810 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-8d4860ca-8f2c-407a-9ca0-b360fbe3b115 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8782892520551'] for port, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:04.962213 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-367a9012-d4ac-4d51-b70e-0eca26cbf9f0 None None] DHCP port deletion for fdf92998-25fa-4179-ab1b-131af0ce059a request from dv-cinder-790910-4-iscsi {{(pid=91688) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
May 20 04:30:05.004708 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [None req-8d4860ca-8f2c-407a-9ca0-b360fbe3b115 admin admin] For port f0e53282-814b-4fe9-93f9-cb2ba47962df, host dv-cinder-790910-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=f0e53282-814b-4fe9-93f9-cb2ba47962df,segment=NetworkSegment(b84e1e85-c58b-4982-b59b-cb9584098e15),segment_id=b84e1e85-c58b-4982-b59b-cb9584098e15)] {{(pid=91687) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:30:05.005233 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-8d4860ca-8f2c-407a-9ca0-b360fbe3b115 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1718922'] for port, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:05.036708 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-367a9012-d4ac-4d51-b70e-0eca26cbf9f0 None None] Deleting port f0e53282-814b-4fe9-93f9-cb2ba47962df {{(pid=91688) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 04:30:05.037132 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-367a9012-d4ac-4d51-b70e-0eca26cbf9f0 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8782892520551'] for port, before_delete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:05.051332 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device f0e53282-814b-4fe9-93f9-cb2ba47962df no longer exists at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 04:30:05.136945 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [None req-8d4860ca-8f2c-407a-9ca0-b360fbe3b115 admin admin] Calling delete_port for f0e53282-814b-4fe9-93f9-cb2ba47962df owned by network:dhcp {{(pid=91687) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 04:30:05.192026 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-8d4860ca-8f2c-407a-9ca0-b360fbe3b115 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8782892522936', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8782892108804', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4162192'] for port, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:05.192299 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-367a9012-d4ac-4d51-b70e-0eca26cbf9f0 None None] For port f0e53282-814b-4fe9-93f9-cb2ba47962df, host dv-cinder-790910-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=f0e53282-814b-4fe9-93f9-cb2ba47962df,segment=NetworkSegment(b84e1e85-c58b-4982-b59b-cb9584098e15),segment_id=b84e1e85-c58b-4982-b59b-cb9584098e15)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:30:05.192776 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-367a9012-d4ac-4d51-b70e-0eca26cbf9f0 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1718922'] for port, precommit_delete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:05.197174 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-a0717b7b-9c8d-4b0f-b43a-dbc08a748ec8 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:30:05.212118 dv-cinder-790910-4-iscsi neutron-server[91688]: INFO neutron.plugins.ml2.db [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] No ports have port_id starting with f0e53282-814b-4fe9-93f9-cb2ba47962df
May 20 04:30:05.243730 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8d4860ca-8f2c-407a-9ca0-b360fbe3b115 admin admin] No DVR routers for this DVR port f0e53282-814b-4fe9-93f9-cb2ba47962df on host dv-cinder-790910-4-iscsi {{(pid=91687) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 04:30:05.246288 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d4860ca-8f2c-407a-9ca0-b360fbe3b115 admin admin] Pushing event deleted for resources: {'Port': ['ID=f0e53282-814b-4fe9-93f9-cb2ba47962df,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:30:05.262813 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 907a9337-b889-44b2-b856-48e472d2bc38 no longer exists at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 04:30:05.287279 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d4860ca-8f2c-407a-9ca0-b360fbe3b115 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:30:05.287647 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d4860ca-8f2c-407a-9ca0-b360fbe3b115 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:30:05.287994 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d4860ca-8f2c-407a-9ca0-b360fbe3b115 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:30:05.288435 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d4860ca-8f2c-407a-9ca0-b360fbe3b115 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:30:05.288807 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d4860ca-8f2c-407a-9ca0-b360fbe3b115 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:30:05.289189 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d4860ca-8f2c-407a-9ca0-b360fbe3b115 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:30:05.289524 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d4860ca-8f2c-407a-9ca0-b360fbe3b115 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:30:05.289881 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d4860ca-8f2c-407a-9ca0-b360fbe3b115 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:30:05.290226 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d4860ca-8f2c-407a-9ca0-b360fbe3b115 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:30:05.290567 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d4860ca-8f2c-407a-9ca0-b360fbe3b115 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:30:05.290906 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d4860ca-8f2c-407a-9ca0-b360fbe3b115 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:30:05.291259 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d4860ca-8f2c-407a-9ca0-b360fbe3b115 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:30:05.294967 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-8d4860ca-8f2c-407a-9ca0-b360fbe3b115 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:30:05.355313 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-367a9012-d4ac-4d51-b70e-0eca26cbf9f0 None None] Calling delete_port for f0e53282-814b-4fe9-93f9-cb2ba47962df owned by network:dhcp {{(pid=91688) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 04:30:05.364278 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f21320cc-6a25-4ec1-8a32-8b119b35fd55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:05.366065 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] No Port match for: 907a9337-b889-44b2-b856-48e472d2bc38 {{(pid=91688) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 04:30:05.366418 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 907a9337-b889-44b2-b856-48e472d2bc38 not bound to the agent host dv-cinder-790910-4-iscsi {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 04:30:05.366896 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device b4b174b3-1436-4e17-8fa3-97243bad59c3 no longer exists at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 04:30:05.380075 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-8d4860ca-8f2c-407a-9ca0-b360fbe3b115 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1505550', 'neutron.services.segments.db._delete_segments_for_network-8782892550274'] for network, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:05.400709 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.services.segments.db [None req-8d4860ca-8f2c-407a-9ca0-b360fbe3b115 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fced131b820>,) {'filters': {'network_id': ['fdf92998-25fa-4179-ab1b-131af0ce059a']}} {{(pid=91687) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:30:05.405929 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] No Port match for: b4b174b3-1436-4e17-8fa3-97243bad59c3 {{(pid=91688) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 04:30:05.406282 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device b4b174b3-1436-4e17-8fa3-97243bad59c3 not bound to the agent host dv-cinder-790910-4-iscsi {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 04:30:05.418779 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.services.segments.db [None req-8d4860ca-8f2c-407a-9ca0-b360fbe3b115 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fced131b820>, 'b84e1e85-c58b-4982-b59b-cb9584098e15') {'for_net_delete': True} {{(pid=91687) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:30:05.419094 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.services.segments.db [None req-8d4860ca-8f2c-407a-9ca0-b360fbe3b115 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fced131b820>, 'b84e1e85-c58b-4982-b59b-cb9584098e15') {} {{(pid=91687) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:30:05.432694 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-8d4860ca-8f2c-407a-9ca0-b360fbe3b115 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8782892560523', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-936621'] for segment, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:05.453014 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-8d4860ca-8f2c-407a-9ca0-b360fbe3b115 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1501910'] for segment, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:05.461367 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8d4860ca-8f2c-407a-9ca0-b360fbe3b115 admin admin] Releasing vlan 893 on physical network physnet1 to pool {{(pid=91687) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 20 04:30:05.461803 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-8d4860ca-8f2c-407a-9ca0-b360fbe3b115 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1501910', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-4162285'] for segment, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:05.471405 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 9c846663-c90b-41d4-a8d1-1086882ba27e details requested by agent hyperv_hv-cinder-79091 with host hv-cinder-79091 {{(pid=91688) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 20 04:30:05.475709 dv-cinder-790910-4-iscsi neutron-server[91687]: Traceback (most recent call last):
May 20 04:30:05.475709 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 20 04:30:05.475709 dv-cinder-790910-4-iscsi neutron-server[91687]:     timer()
May 20 04:30:05.475709 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 20 04:30:05.475709 dv-cinder-790910-4-iscsi neutron-server[91687]:     cb(*args, **kw)
May 20 04:30:05.475709 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 20 04:30:05.475709 dv-cinder-790910-4-iscsi neutron-server[91687]:     return func(*args, **kwargs)
May 20 04:30:05.475709 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 20 04:30:05.475709 dv-cinder-790910-4-iscsi neutron-server[91687]:     self._notify()
May 20 04:30:05.475709 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 20 04:30:05.475709 dv-cinder-790910-4-iscsi neutron-server[91687]:     self.callback(batched_events)
May 20 04:30:05.475709 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 20 04:30:05.475709 dv-cinder-790910-4-iscsi neutron-server[91687]:     event.method(event)
May 20 04:30:05.475709 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 20 04:30:05.475709 dv-cinder-790910-4-iscsi neutron-server[91687]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 20 04:30:05.475709 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 20 04:30:05.475709 dv-cinder-790910-4-iscsi neutron-server[91687]:     aggregate_uuid = self.p_client.list_aggregates(
May 20 04:30:05.475709 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 20 04:30:05.475709 dv-cinder-790910-4-iscsi neutron-server[91687]:     return f(self, *a, **k)
May 20 04:30:05.475709 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 20 04:30:05.475709 dv-cinder-790910-4-iscsi neutron-server[91687]:     return self._get(url).json()
May 20 04:30:05.475709 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 20 04:30:05.475709 dv-cinder-790910-4-iscsi neutron-server[91687]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 20 04:30:05.475709 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 20 04:30:05.475709 dv-cinder-790910-4-iscsi neutron-server[91687]:     return self.request(url, 'GET', **kwargs)
May 20 04:30:05.475709 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 20 04:30:05.475709 dv-cinder-790910-4-iscsi neutron-server[91687]:     base_url = self.get_endpoint(auth, allow=allow,
May 20 04:30:05.475709 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 20 04:30:05.475709 dv-cinder-790910-4-iscsi neutron-server[91687]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 20 04:30:05.475709 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 20 04:30:05.475709 dv-cinder-790910-4-iscsi neutron-server[91687]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 20 04:30:05.475709 dv-cinder-790910-4-iscsi neutron-server[91687]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 20 04:30:05.552235 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-8d4860ca-8f2c-407a-9ca0-b360fbe3b115 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1505543', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1590664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1781430', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1713996'] for network, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:05.557756 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-57d6e772-476f-4bfd-9416-1c8b269c497d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:30:05.582904 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-8d4860ca-8f2c-407a-9ca0-b360fbe3b115 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for network, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:05.601655 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-8d4860ca-8f2c-407a-9ca0-b360fbe3b115 admin admin] 10.222.0.71 "DELETE /v2.0/networks/fdf92998-25fa-4179-ab1b-131af0ce059a HTTP/1.1" status: 204  len: 168 time: 0.9046376
May 20 04:30:05.601655 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d4860ca-8f2c-407a-9ca0-b360fbe3b115 admin admin] Pushing event deleted for resources: {'Network': ['ID=fdf92998-25fa-4179-ab1b-131af0ce059a,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:30:05.602136 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 45506) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:30:05.609201 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-8d4860ca-8f2c-407a-9ca0-b360fbe3b115 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:30:05.629338 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-367a9012-d4ac-4d51-b70e-0eca26cbf9f0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8782892522936', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8782892108804'] for port, after_delete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:05.635280 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:30:05.680009 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-367a9012-d4ac-4d51-b70e-0eca26cbf9f0 None None] Network fdf92998-25fa-4179-ab1b-131af0ce059a is not hosted by any dhcp agent {{(pid=91688) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:231}}
May 20 04:30:05.681196 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-367a9012-d4ac-4d51-b70e-0eca26cbf9f0 None None] No DVR routers for this DVR port f0e53282-814b-4fe9-93f9-cb2ba47962df on host dv-cinder-790910-4-iscsi {{(pid=91688) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 04:30:05.685733 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-367a9012-d4ac-4d51-b70e-0eca26cbf9f0 None None] Pushing event deleted for resources: {'Port': ['ID=f0e53282-814b-4fe9-93f9-cb2ba47962df,revision_number=None']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:30:05.690640 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-367a9012-d4ac-4d51-b70e-0eca26cbf9f0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:30:05.711439 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port 9c846663-c90b-41d4-a8d1-1086882ba27e, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=9c846663-c90b-41d4-a8d1-1086882ba27e,segment=NetworkSegment(e5874c72-d111-4955-a5aa-fbad5f078a34),segment_id=e5874c72-d111-4955-a5aa-fbad5f078a34)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:30:05.731448 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Returning: {'device': '9c846663-c90b-41d4-a8d1-1086882ba27e', 'network_id': 'e31171ff-f097-446e-b691-bef7aad2fb3b', 'port_id': '9c846663-c90b-41d4-a8d1-1086882ba27e', 'mac_address': 'fa:16:3e:ee:c7:b4', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 880, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '410f59de-055d-4298-96bf-5d9a7712368d', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91688) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 20 04:30:05.797674 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:05.813070 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86e105ba-4a4d-4708-a96b-801253dcfee8 req-0bc7a3db-c9fe-4c96-9346-d11ebd9ec537 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:30:05.815613 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-86e105ba-4a4d-4708-a96b-801253dcfee8 req-0bc7a3db-c9fe-4c96-9346-d11ebd9ec537 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 944 time: 0.1122172
May 20 04:30:05.824357 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.notifiers.nova [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 9c846663-c90b-41d4-a8d1-1086882ba27e {{(pid=91688) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 04:30:05.848309 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port 9c846663-c90b-41d4-a8d1-1086882ba27e, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=9c846663-c90b-41d4-a8d1-1086882ba27e,segment=NetworkSegment(e5874c72-d111-4955-a5aa-fbad5f078a34),segment_id=e5874c72-d111-4955-a5aa-fbad5f078a34)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:30:05.853675 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:05.856936 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-367a9012-d4ac-4d51-b70e-0eca26cbf9f0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:30:05.873707 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-86e105ba-4a4d-4708-a96b-801253dcfee8 req-68a37e6c-3c7f-4f49-bd56-7d73d5f1a9b8 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/security-groups?id=34e473fa-df05-422b-9abc-99aed131bade&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0467901
May 20 04:30:05.927168 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Pushing event updated for resources: {'Port': ['ID=9c846663-c90b-41d4-a8d1-1086882ba27e,revision_number=7']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:30:05.931072 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:30:06.182217 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] get_ports_and_sgs() called for port_ids ['9c846663-c90b-41d4-a8d1-1086882ba27e'] {{(pid=91688) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 04:30:06.330088 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-a04b00de-b3db-46e0-a180-d76321946619 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1716300'] for router_interface, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:06.559222 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:06.759175 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.plugin [None req-a04b00de-b3db-46e0-a180-d76321946619 admin admin] Deleting port 1a9566c0-910b-4abb-b1c3-865c2789dc16 {{(pid=91686) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 04:30:06.759526 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-a04b00de-b3db-46e0-a180-d76321946619 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8782892520551'] for port, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:06.892927 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.db [None req-a04b00de-b3db-46e0-a180-d76321946619 admin admin] For port 1a9566c0-910b-4abb-b1c3-865c2789dc16, host dv-cinder-790910-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=1a9566c0-910b-4abb-b1c3-865c2789dc16,segment=NetworkSegment(f495c6da-d858-4d7b-a7ae-2c30d9f73111),segment_id=f495c6da-d858-4d7b-a7ae-2c30d9f73111)] {{(pid=91686) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:30:06.893314 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-a04b00de-b3db-46e0-a180-d76321946619 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1718922'] for port, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:06.951487 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.agents_db [None req-92d61f12-17bc-4bf9-9eab-8a69b8c6da2f None None] Agent healthcheck: found 6 active agents {{(pid=91689) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 04:30:07.018041 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.plugin [None req-a04b00de-b3db-46e0-a180-d76321946619 admin admin] Calling delete_port for 1a9566c0-910b-4abb-b1c3-865c2789dc16 owned by network:router_interface {{(pid=91686) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 04:30:07.076792 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-620bb6c7-7774-441e-bb64-fb498f22f565 req-56d365f6-78ce-4198-9b67-ae0ac4208917 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:30:07.078365 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-620bb6c7-7774-441e-bb64-fb498f22f565 req-56d365f6-78ce-4198-9b67-ae0ac4208917 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 945 time: 0.0853262
May 20 04:30:07.122700 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-620bb6c7-7774-441e-bb64-fb498f22f565 req-dfdc85d9-4216-4a84-b14a-8878cf2ab413 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/security-groups?id=34e473fa-df05-422b-9abc-99aed131bade&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0382812
May 20 04:30:07.178328 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-a04b00de-b3db-46e0-a180-d76321946619 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8782892522936', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8782892108804', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2145052'] for port, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:07.181479 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:30:07.224392 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a04b00de-b3db-46e0-a180-d76321946619 admin admin] Pushing event deleted for resources: {'Port': ['ID=1a9566c0-910b-4abb-b1c3-865c2789dc16,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:30:07.227699 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-a04b00de-b3db-46e0-a180-d76321946619 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:30:07.475229 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 9c846663-c90b-41d4-a8d1-1086882ba27e up at agent hyperv_hv-cinder-79091 {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:30:07.498947 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-a04b00de-b3db-46e0-a180-d76321946619 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1781439', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1717212'] for router_interface, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:07.551198 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Provisioning complete for port 9c846663-c90b-41d4-a8d1-1086882ba27e triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:30:07.551572 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:07.686805 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:07.717544 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9c846663-c90b-41d4-a8d1-1086882ba27e'}] {{(pid=91688) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:30:07.727783 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port 9c846663-c90b-41d4-a8d1-1086882ba27e, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=9c846663-c90b-41d4-a8d1-1086882ba27e,segment=NetworkSegment(e5874c72-d111-4955-a5aa-fbad5f078a34),segment_id=e5874c72-d111-4955-a5aa-fbad5f078a34)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:30:07.748727 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:07.751521 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:30:07.827530 dv-cinder-790910-4-iscsi neutron-server[91688]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9c846663-c90b-41d4-a8d1-1086882ba27e', 'code': 200}
May 20 04:30:07.840144 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Pushing event updated for resources: {'Port': ['ID=9c846663-c90b-41d4-a8d1-1086882ba27e,revision_number=8']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:30:07.844029 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:30:08.046079 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a04b00de-b3db-46e0-a180-d76321946619 admin admin] Router 516c54ae-e378-44de-a7bf-14b9bb646228 has already been hosted by L3 agent 02733fc0-fc9c-4e29-bc03-c27a792d539d {{(pid=91686) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 04:30:08.110475 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25aa2efb-11e2-499e-b94b-a0a824a5da43 req-09ec4088-8040-47f1-8a88-a42829333bf0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:30:08.112044 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-25aa2efb-11e2-499e-b94b-a0a824a5da43 req-09ec4088-8040-47f1-8a88-a42829333bf0 service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 1099 time: 0.0731964
May 20 04:30:08.155934 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-25aa2efb-11e2-499e-b94b-a0a824a5da43 req-48cacedd-fdf2-4997-a2ed-32155764190c service neutron] 10.222.0.82 "GET /v2.0/security-groups?id=34e473fa-df05-422b-9abc-99aed131bade&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0365827
May 20 04:30:08.223144 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a04b00de-b3db-46e0-a180-d76321946619 admin admin] Notify agent at l3_agent.dv-cinder-790910-4-iscsi the message routers_updated {{(pid=91686) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 04:30:08.231438 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9ee49906-6eab-49ed-b347-fe034b15ee2d None None] Sync routers for ids ['516c54ae-e378-44de-a7bf-14b9bb646228'] in dv-cinder-790910-4-iscsi {{(pid=91689) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 04:30:08.242744 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9ee49906-6eab-49ed-b347-fe034b15ee2d None None] Routers {'516c54ae-e378-44de-a7bf-14b9bb646228'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91689) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:30:08.245750 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-a04b00de-b3db-46e0-a180-d76321946619 admin admin] 10.222.0.71 "PUT /v2.0/routers/516c54ae-e378-44de-a7bf-14b9bb646228/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.6402953
May 20 04:30:08.245871 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-9ee49906-6eab-49ed-b347-fe034b15ee2d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced1766c40>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:30:03Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['516c54ae-e378-44de-a7bf-14b9bb646228'], 'active': True} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:30:08.246187 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 45520) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:30:08.337258 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91870d10-eba9-4d1f-b16a-6cc1dde5e138 req-3234e7b2-6afe-4e8e-9fd5-c01b8de5ac63 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:30:08.338592 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-91870d10-eba9-4d1f-b16a-6cc1dde5e138 req-3234e7b2-6afe-4e8e-9fd5-c01b8de5ac63 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 946 time: 0.0924420
May 20 04:30:08.386723 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-91870d10-eba9-4d1f-b16a-6cc1dde5e138 req-813103fe-f33f-43c8-babd-def41bbdccf4 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/security-groups?id=34e473fa-df05-422b-9abc-99aed131bade&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0418673
May 20 04:30:08.424592 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvr_db [None req-9ee49906-6eab-49ed-b347-fe034b15ee2d None None] Set router 516c54ae-e378-44de-a7bf-14b9bb646228 gateway port host: dv-cinder-790910-4-iscsi {{(pid=91689) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:30:08.515065 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-92f6027b-1196-45b3-880e-014689c17643 admin admin] Notify callbacks [] for router, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:08.694990 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-92f6027b-1196-45b3-880e-014689c17643 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:08.708804 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-9ee49906-6eab-49ed-b347-fe034b15ee2d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced1766c40>, [{'id': '516c54ae-e378-44de-a7bf-14b9bb646228', 'name': 'tempest-TestMinimumBasicScenario-943774282-router', 'tenant_id': 'a588c51341504beda6a1803a15cc919c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.92'}], 'enable_snat': True}, 'gw_port_id': 'a73b9449-b261-4c62-b13c-b2c797730593', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:23:27Z', 'updated_at': '2021-05-20T04:30:07Z', 'revision_number': 5, 'project_id': 'a588c51341504beda6a1803a15cc919c', 'gw_port': {'id': 'a73b9449-b261-4c62-b13c-b2c797730593', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:bb:ad:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '516c54ae-e378-44de-a7bf-14b9bb646228', 'device_owner': 'network:router_gateway', 'standard_attr_id': 362, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.92', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:23:29Z', 'updated_at': '2021-05-20T04:23:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi'}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:30:08.716241 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9ee49906-6eab-49ed-b347-fe034b15ee2d None None] Checking router: 516c54ae-e378-44de-a7bf-14b9bb646228 for host: dv-cinder-790910-4-iscsi {{(pid=91689) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 04:30:08.730376 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9ee49906-6eab-49ed-b347-fe034b15ee2d None None] Routers {'516c54ae-e378-44de-a7bf-14b9bb646228'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91689) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:30:08.731369 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-9ee49906-6eab-49ed-b347-fe034b15ee2d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced1766c40>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:30:03Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['516c54ae-e378-44de-a7bf-14b9bb646228'], 'active': True} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:30:08.771236 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [None req-92f6027b-1196-45b3-880e-014689c17643 admin admin] Deleting port a73b9449-b261-4c62-b13c-b2c797730593 {{(pid=91687) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 04:30:08.771626 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-92f6027b-1196-45b3-880e-014689c17643 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8782892520551'] for port, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:08.894932 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvr_db [None req-9ee49906-6eab-49ed-b347-fe034b15ee2d None None] Set router 516c54ae-e378-44de-a7bf-14b9bb646228 gateway port host: None {{(pid=91689) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:30:08.903274 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [None req-92f6027b-1196-45b3-880e-014689c17643 admin admin] For port a73b9449-b261-4c62-b13c-b2c797730593, host dv-cinder-790910-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=a73b9449-b261-4c62-b13c-b2c797730593,segment=NetworkSegment(8df49ec5-3fb9-4715-bc9a-f4019a6b55f9),segment_id=8df49ec5-3fb9-4715-bc9a-f4019a6b55f9)] {{(pid=91687) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:30:08.903666 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-92f6027b-1196-45b3-880e-014689c17643 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1718922'] for port, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:09.003198 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-9ee49906-6eab-49ed-b347-fe034b15ee2d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced1766c40>, [{'id': '516c54ae-e378-44de-a7bf-14b9bb646228', 'name': 'tempest-TestMinimumBasicScenario-943774282-router', 'tenant_id': 'a588c51341504beda6a1803a15cc919c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:23:27Z', 'updated_at': '2021-05-20T04:30:08Z', 'revision_number': 6, 'project_id': 'a588c51341504beda6a1803a15cc919c', 'gw_port_host': None}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:30:09.010669 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9ee49906-6eab-49ed-b347-fe034b15ee2d None None] The sync data for ids ['516c54ae-e378-44de-a7bf-14b9bb646228'] in dv-cinder-790910-4-iscsi is: [{'id': '516c54ae-e378-44de-a7bf-14b9bb646228', 'name': 'tempest-TestMinimumBasicScenario-943774282-router', 'tenant_id': 'a588c51341504beda6a1803a15cc919c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:23:27Z', 'updated_at': '2021-05-20T04:30:08Z', 'revision_number': 6, 'project_id': 'a588c51341504beda6a1803a15cc919c', 'gw_port_host': None}] {{(pid=91689) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 04:30:09.031901 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [None req-92f6027b-1196-45b3-880e-014689c17643 admin admin] Calling delete_port for a73b9449-b261-4c62-b13c-b2c797730593 owned by network:router_gateway {{(pid=91687) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 04:30:09.303746 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-92f6027b-1196-45b3-880e-014689c17643 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8782892522936', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8782892108804', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4162192'] for port, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:09.307603 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-2016da6e-91f2-4a78-b1e7-2ec273ca939f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:30:09.355267 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92f6027b-1196-45b3-880e-014689c17643 admin admin] Pushing event deleted for resources: {'Port': ['ID=a73b9449-b261-4c62-b13c-b2c797730593,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:30:09.358963 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-92f6027b-1196-45b3-880e-014689c17643 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:30:09.460651 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-92f6027b-1196-45b3-880e-014689c17643 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1714023'] for router_gateway, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:09.588122 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6dac733-6029-425e-a875-05eb3224106a req-27ce9be4-7972-45fa-9f92-3b4aea746f0e tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:30:09.590088 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-e6dac733-6029-425e-a875-05eb3224106a req-27ce9be4-7972-45fa-9f92-3b4aea746f0e tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 946 time: 0.0875893
May 20 04:30:09.646486 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-e6dac733-6029-425e-a875-05eb3224106a req-3c56dd06-6541-4439-b4f4-389a61d55ece tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/security-groups?id=34e473fa-df05-422b-9abc-99aed131bade&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0486720
May 20 04:30:09.735534 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-92f6027b-1196-45b3-880e-014689c17643 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1796572', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-6237'] for router, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:09.737712 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-92f6027b-1196-45b3-880e-014689c17643 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:09.761466 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-92f6027b-1196-45b3-880e-014689c17643 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-1712688'] for router, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:09.762002 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-92f6027b-1196-45b3-880e-014689c17643 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 516c54ae-e378-44de-a7bf-14b9bb646228 {{(pid=91687) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 20 04:30:09.776920 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-92f6027b-1196-45b3-880e-014689c17643 admin admin] Notify callbacks [] for router, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:09.781342 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-92f6027b-1196-45b3-880e-014689c17643 admin admin] 10.222.0.71 "DELETE /v2.0/routers/516c54ae-e378-44de-a7bf-14b9bb646228 HTTP/1.1" status: 204  len: 168 time: 1.5307913
May 20 04:30:09.781672 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 45530) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:30:09.847414 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.db_base_plugin_v2 [None req-2258929c-6e00-413c-9c2a-7856c9e7750f admin admin] Deleting subnet a34998b9-6684-4ced-a2bb-9b229ae96845 {{(pid=91687) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 20 04:30:09.851093 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-2258929c-6e00-413c-9c2a-7856c9e7750f admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:09.905755 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-2258929c-6e00-413c-9c2a-7856c9e7750f admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-936634'] for subnet, precommit_delete_associations {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:10.025875 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-2258929c-6e00-413c-9c2a-7856c9e7750f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1504133'] for subnet, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:10.284193 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-2258929c-6e00-413c-9c2a-7856c9e7750f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1504178', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-255887', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-4160847', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-692244'] for subnet, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:10.290662 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-402b9c9c-32d9-4b61-aada-e84b874ae708 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:30:10.325210 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2258929c-6e00-413c-9c2a-7856c9e7750f admin admin] Pushing event deleted for resources: {'Subnet': ['ID=a34998b9-6684-4ced-a2bb-9b229ae96845,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:30:10.327213 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-2258929c-6e00-413c-9c2a-7856c9e7750f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for subnet, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:10.330531 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-2258929c-6e00-413c-9c2a-7856c9e7750f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:30:10.332554 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5c638fde-88bf-45cd-b8ba-06bb37a0c294 None None] Network fc681196-7d83-4764-b760-89961b7ffe54 requested from dv-cinder-790910-4-iscsi {{(pid=91688) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 04:30:10.334482 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-2258929c-6e00-413c-9c2a-7856c9e7750f admin admin] 10.222.0.71 "DELETE /v2.0/subnets/a34998b9-6684-4ced-a2bb-9b229ae96845 HTTP/1.1" status: 204  len: 168 time: 0.5518441
May 20 04:30:10.337057 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 45536) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:30:10.443510 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-c5dc61f5-9524-48e1-a16e-7d689db23333 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-593149'] for network, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:10.525285 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [None req-c5dc61f5-9524-48e1-a16e-7d689db23333 admin admin] Deleting port 7c96d7de-6e5c-4184-9fe2-72490748c224 {{(pid=91687) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 04:30:10.525839 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-c5dc61f5-9524-48e1-a16e-7d689db23333 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8782892520551'] for port, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:10.585138 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5d1fad46-8d7f-4005-9e5c-f7fa607c792a None None] DHCP port deletion for fc681196-7d83-4764-b760-89961b7ffe54 request from dv-cinder-790910-4-iscsi {{(pid=91688) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
May 20 04:30:10.625474 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [None req-c5dc61f5-9524-48e1-a16e-7d689db23333 admin admin] For port 7c96d7de-6e5c-4184-9fe2-72490748c224, host dv-cinder-790910-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=7c96d7de-6e5c-4184-9fe2-72490748c224,segment=NetworkSegment(f495c6da-d858-4d7b-a7ae-2c30d9f73111),segment_id=f495c6da-d858-4d7b-a7ae-2c30d9f73111)] {{(pid=91687) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:30:10.625824 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-c5dc61f5-9524-48e1-a16e-7d689db23333 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1718922'] for port, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:10.653671 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-5d1fad46-8d7f-4005-9e5c-f7fa607c792a None None] Deleting port 7c96d7de-6e5c-4184-9fe2-72490748c224 {{(pid=91688) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 04:30:10.654069 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-5d1fad46-8d7f-4005-9e5c-f7fa607c792a None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8782892520551'] for port, before_delete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:10.752113 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [None req-c5dc61f5-9524-48e1-a16e-7d689db23333 admin admin] Calling delete_port for 7c96d7de-6e5c-4184-9fe2-72490748c224 owned by network:dhcp {{(pid=91687) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 04:30:10.753217 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-5d1fad46-8d7f-4005-9e5c-f7fa607c792a None None] For port 7c96d7de-6e5c-4184-9fe2-72490748c224, host dv-cinder-790910-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=7c96d7de-6e5c-4184-9fe2-72490748c224,segment=NetworkSegment(f495c6da-d858-4d7b-a7ae-2c30d9f73111),segment_id=f495c6da-d858-4d7b-a7ae-2c30d9f73111)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:30:10.753645 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-5d1fad46-8d7f-4005-9e5c-f7fa607c792a None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1718922'] for port, precommit_delete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:10.803456 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-c5dc61f5-9524-48e1-a16e-7d689db23333 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8782892522936', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8782892108804', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4162192'] for port, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:10.807659 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-5b0ac852-a377-43c1-999b-db2de911388d tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:30:10.853506 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5dc61f5-9524-48e1-a16e-7d689db23333 admin admin] Pushing event deleted for resources: {'Port': ['ID=7c96d7de-6e5c-4184-9fe2-72490748c224,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:30:10.855383 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c5dc61f5-9524-48e1-a16e-7d689db23333 admin admin] No DVR routers for this DVR port 7c96d7de-6e5c-4184-9fe2-72490748c224 on host dv-cinder-790910-4-iscsi {{(pid=91687) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 04:30:10.856848 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-c5dc61f5-9524-48e1-a16e-7d689db23333 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:30:10.882582 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-5d1fad46-8d7f-4005-9e5c-f7fa607c792a None None] Calling delete_port for 7c96d7de-6e5c-4184-9fe2-72490748c224 owned by network:dhcp {{(pid=91688) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 04:30:10.930841 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-5d1fad46-8d7f-4005-9e5c-f7fa607c792a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8782892522936', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8782892108804'] for port, after_delete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:10.937083 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-df1ec6ec-42ca-4cbb-9e00-7da8c44f9851 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:30:10.974627 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-c5dc61f5-9524-48e1-a16e-7d689db23333 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1505550', 'neutron.services.segments.db._delete_segments_for_network-8782892550274'] for network, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:10.981189 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5d1fad46-8d7f-4005-9e5c-f7fa607c792a None None] No DVR routers for this DVR port 7c96d7de-6e5c-4184-9fe2-72490748c224 on host dv-cinder-790910-4-iscsi {{(pid=91688) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 04:30:10.992544 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d1fad46-8d7f-4005-9e5c-f7fa607c792a None None] Pushing event deleted for resources: {'Port': ['ID=7c96d7de-6e5c-4184-9fe2-72490748c224,revision_number=None']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:30:10.993556 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-5d1fad46-8d7f-4005-9e5c-f7fa607c792a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.057s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:30:10.995071 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.services.segments.db [None req-c5dc61f5-9524-48e1-a16e-7d689db23333 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fced10d7d90>,) {'filters': {'network_id': ['fc681196-7d83-4764-b760-89961b7ffe54']}} {{(pid=91687) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:30:11.009390 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.services.segments.db [None req-c5dc61f5-9524-48e1-a16e-7d689db23333 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fced10d7d90>, 'f495c6da-d858-4d7b-a7ae-2c30d9f73111') {'for_net_delete': True} {{(pid=91687) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:30:11.009688 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.services.segments.db [None req-c5dc61f5-9524-48e1-a16e-7d689db23333 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fced10d7d90>, 'f495c6da-d858-4d7b-a7ae-2c30d9f73111') {} {{(pid=91687) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:30:11.021964 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-c5dc61f5-9524-48e1-a16e-7d689db23333 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8782892560523', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-936621'] for segment, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:11.044176 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 1a9566c0-910b-4abb-b1c3-865c2789dc16 no longer exists at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 04:30:11.044439 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-c5dc61f5-9524-48e1-a16e-7d689db23333 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1501910'] for segment, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:11.050883 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c5dc61f5-9524-48e1-a16e-7d689db23333 admin admin] Releasing vlan 894 on physical network physnet1 to pool {{(pid=91687) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 20 04:30:11.051371 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-c5dc61f5-9524-48e1-a16e-7d689db23333 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1501910', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-4162285'] for segment, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:11.064906 dv-cinder-790910-4-iscsi neutron-server[91687]: Traceback (most recent call last):
May 20 04:30:11.064906 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 20 04:30:11.064906 dv-cinder-790910-4-iscsi neutron-server[91687]:     timer()
May 20 04:30:11.064906 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 20 04:30:11.064906 dv-cinder-790910-4-iscsi neutron-server[91687]:     cb(*args, **kw)
May 20 04:30:11.064906 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 20 04:30:11.064906 dv-cinder-790910-4-iscsi neutron-server[91687]:     return func(*args, **kwargs)
May 20 04:30:11.064906 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 20 04:30:11.064906 dv-cinder-790910-4-iscsi neutron-server[91687]:     self._notify()
May 20 04:30:11.064906 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 20 04:30:11.064906 dv-cinder-790910-4-iscsi neutron-server[91687]:     self.callback(batched_events)
May 20 04:30:11.064906 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 20 04:30:11.064906 dv-cinder-790910-4-iscsi neutron-server[91687]:     event.method(event)
May 20 04:30:11.064906 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 20 04:30:11.064906 dv-cinder-790910-4-iscsi neutron-server[91687]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 20 04:30:11.064906 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 20 04:30:11.064906 dv-cinder-790910-4-iscsi neutron-server[91687]:     aggregate_uuid = self.p_client.list_aggregates(
May 20 04:30:11.064906 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 20 04:30:11.064906 dv-cinder-790910-4-iscsi neutron-server[91687]:     return f(self, *a, **k)
May 20 04:30:11.064906 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 20 04:30:11.064906 dv-cinder-790910-4-iscsi neutron-server[91687]:     return self._get(url).json()
May 20 04:30:11.064906 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 20 04:30:11.064906 dv-cinder-790910-4-iscsi neutron-server[91687]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 20 04:30:11.064906 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 20 04:30:11.064906 dv-cinder-790910-4-iscsi neutron-server[91687]:     return self.request(url, 'GET', **kwargs)
May 20 04:30:11.064906 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 20 04:30:11.064906 dv-cinder-790910-4-iscsi neutron-server[91687]:     base_url = self.get_endpoint(auth, allow=allow,
May 20 04:30:11.064906 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 20 04:30:11.064906 dv-cinder-790910-4-iscsi neutron-server[91687]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 20 04:30:11.064906 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 20 04:30:11.064906 dv-cinder-790910-4-iscsi neutron-server[91687]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 20 04:30:11.064906 dv-cinder-790910-4-iscsi neutron-server[91687]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 20 04:30:11.078913 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] No Port match for: 1a9566c0-910b-4abb-b1c3-865c2789dc16 {{(pid=91688) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 04:30:11.079258 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 1a9566c0-910b-4abb-b1c3-865c2789dc16 not bound to the agent host dv-cinder-790910-4-iscsi {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 04:30:11.079664 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 7c96d7de-6e5c-4184-9fe2-72490748c224 no longer exists at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 04:30:11.115514 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] No Port match for: 7c96d7de-6e5c-4184-9fe2-72490748c224 {{(pid=91688) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 04:30:11.115857 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 7c96d7de-6e5c-4184-9fe2-72490748c224 not bound to the agent host dv-cinder-790910-4-iscsi {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 04:30:11.116279 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device a73b9449-b261-4c62-b13c-b2c797730593 no longer exists at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 04:30:11.138649 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-c5dc61f5-9524-48e1-a16e-7d689db23333 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1505543', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1590664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1781430', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1713996'] for network, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:11.143884 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-c5dc61f5-9524-48e1-a16e-7d689db23333 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for network, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:11.149162 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-acbeb02f-8a19-4c61-99bf-0ca812d59d50 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:30:11.151013 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] No Port match for: a73b9449-b261-4c62-b13c-b2c797730593 {{(pid=91688) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 04:30:11.151365 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device a73b9449-b261-4c62-b13c-b2c797730593 not bound to the agent host dv-cinder-790910-4-iscsi {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 04:30:11.175199 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5dc61f5-9524-48e1-a16e-7d689db23333 admin admin] Pushing event deleted for resources: {'Network': ['ID=fc681196-7d83-4764-b760-89961b7ffe54,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:30:11.177767 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-c5dc61f5-9524-48e1-a16e-7d689db23333 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:30:11.181025 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-c5dc61f5-9524-48e1-a16e-7d689db23333 admin admin] 10.222.0.71 "DELETE /v2.0/networks/fc681196-7d83-4764-b760-89961b7ffe54 HTTP/1.1" status: 204  len: 168 time: 0.8416700
May 20 04:30:11.317246 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 45544) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:30:11.367923 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-4115df9a-989c-4b53-a20f-cbfd9203b0ed admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=e6fe6bea38b946a5a97ea42bf787f1b3&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0492413
May 20 04:30:11.370576 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 45548) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:30:11.436416 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-208a32b8-9770-4150-94d5-aa30dd619139 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:11.462412 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-208a32b8-9770-4150-94d5-aa30dd619139 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:11.525046 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-208a32b8-9770-4150-94d5-aa30dd619139 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:11.530915 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-0ba8177e-aecb-4f86-9859-12c3ee5a556b tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:30:11.547436 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-208a32b8-9770-4150-94d5-aa30dd619139 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c188bb94-d954-43bd-b580-a3037bfce567,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:30:11.550185 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-208a32b8-9770-4150-94d5-aa30dd619139 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:30:11.561167 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-208a32b8-9770-4150-94d5-aa30dd619139 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:11.562297 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-208a32b8-9770-4150-94d5-aa30dd619139 admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/c188bb94-d954-43bd-b580-a3037bfce567 HTTP/1.1" status: 204  len: 168 time: 0.1906822
May 20 04:30:11.947299 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 45556) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:30:11.998326 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-50575bc1-4aad-410f-9cf0-bf8b1f44342e admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=a588c51341504beda6a1803a15cc919c&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0496895
May 20 04:30:12.001337 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 45560) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:30:12.062282 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-5b86bee3-2ff0-4f25-8da6-7a7235cf9289 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:12.092454 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-5b86bee3-2ff0-4f25-8da6-7a7235cf9289 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:12.244641 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-5b86bee3-2ff0-4f25-8da6-7a7235cf9289 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:12.248575 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-776395ae-3df9-4a02-b7b1-3bfde1657b0a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:30:12.259868 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b86bee3-2ff0-4f25-8da6-7a7235cf9289 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=861e7b78-d952-4f46-aada-ea2d5d5cb8ab,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:30:12.262468 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-5b86bee3-2ff0-4f25-8da6-7a7235cf9289 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:30:12.268512 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-5b86bee3-2ff0-4f25-8da6-7a7235cf9289 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:12.274337 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-5b86bee3-2ff0-4f25-8da6-7a7235cf9289 admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/861e7b78-d952-4f46-aada-ea2d5d5cb8ab HTTP/1.1" status: 204  len: 168 time: 0.2674487
May 20 04:30:29.868140 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-6330dd6b-74ce-4dd9-bab2-6ffb69084d97 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:32.571062 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:32.698282 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-14194f7f-10c1-4a6f-a2dd-a0616da40ac3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:33.353825 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ea4803bd-878f-47d5-9084-1ec41953c9db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:35.212016 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f21320cc-6a25-4ec1-8a32-8b119b35fd55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:35.546128 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-685517e4-bb89-4dd0-957d-9ecfbcae1540 req-cb59500f-5767-4ade-a0f6-b4fe4679373a service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0952790
May 20 04:30:35.700706 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-685517e4-bb89-4dd0-957d-9ecfbcae1540 req-8d4bc390-a449-4ba4-a97e-42f93f7ecc7d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:30:35.702650 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-685517e4-bb89-4dd0-957d-9ecfbcae1540 req-8d4bc390-a449-4ba4-a97e-42f93f7ecc7d service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=a1319e4a0fc74f98ba4bb88d8a04086b&device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 1099 time: 0.0802543
May 20 04:30:35.872374 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-685517e4-bb89-4dd0-957d-9ecfbcae1540 req-76153a57-cc21-466a-ab56-dcb100883e7b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:30:35.873702 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-685517e4-bb89-4dd0-957d-9ecfbcae1540 req-76153a57-cc21-466a-ab56-dcb100883e7b service neutron] 10.222.0.82 "GET /v2.0/networks?id=e31171ff-f097-446e-b691-bef7aad2fb3b HTTP/1.1" status: 200  len: 910 time: 0.1458108
May 20 04:30:35.996007 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-685517e4-bb89-4dd0-957d-9ecfbcae1540 req-626f6ce1-8f3d-44f2-a2ef-808d469d2d41 service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=9c846663-c90b-41d4-a8d1-1086882ba27e HTTP/1.1" status: 200  len: 1002 time: 0.1138880
May 20 04:30:36.063893 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-685517e4-bb89-4dd0-957d-9ecfbcae1540 req-718649d4-1db5-4266-8a48-1ba7276651dd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:30:36.065406 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-685517e4-bb89-4dd0-957d-9ecfbcae1540 req-718649d4-1db5-4266-8a48-1ba7276651dd service neutron] 10.222.0.82 "GET /v2.0/subnets?id=410f59de-055d-4298-96bf-5d9a7712368d HTTP/1.1" status: 200  len: 848 time: 0.0619137
May 20 04:30:36.151583 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-685517e4-bb89-4dd0-957d-9ecfbcae1540 req-8e858f94-c2df-4716-821e-773a50db0892 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:30:36.153068 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-685517e4-bb89-4dd0-957d-9ecfbcae1540 req-8e858f94-c2df-4716-821e-773a50db0892 service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=e31171ff-f097-446e-b691-bef7aad2fb3b&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0804987
May 20 04:30:36.322001 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-685517e4-bb89-4dd0-957d-9ecfbcae1540 req-68ad6eae-ae6f-4c17-b8d1-33922893fb21 service neutron] 10.222.0.82 "GET /v2.0/networks/e31171ff-f097-446e-b691-bef7aad2fb3b?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1616204
May 20 04:30:36.494246 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-685517e4-bb89-4dd0-957d-9ecfbcae1540 req-a947d7ad-f910-47df-8876-2a01d94328d3 service neutron] 10.222.0.82 "GET /v2.0/networks/e31171ff-f097-446e-b691-bef7aad2fb3b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1649640
May 20 04:30:36.559785 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:30:43.952152 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.agents_db [None req-92d61f12-17bc-4bf9-9eab-8a69b8c6da2f None None] Agent healthcheck: found 6 active agents {{(pid=91689) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 04:30:56.631667 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87819072-e4e2-4c5c-afa2-cd96d4e7b00f req-d8adb1eb-3187-4423-bba2-58d7f260f9a7 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:30:56.632974 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-87819072-e4e2-4c5c-afa2-cd96d4e7b00f req-d8adb1eb-3187-4423-bba2-58d7f260f9a7 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 946 time: 0.0878439
May 20 04:30:56.679988 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-87819072-e4e2-4c5c-afa2-cd96d4e7b00f req-d87fab5d-5ca9-4e2e-b42a-d0eb62b1fe87 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=35bf24dc-8716-4edf-9f4f-f9d97739d7ef&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0409389
May 20 04:30:57.892402 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-972b964b-0267-4e36-b3fb-02435081b814 req-55ad1eb4-56af-40a2-9c70-c186af12ee4c tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:30:57.893893 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-972b964b-0267-4e36-b3fb-02435081b814 req-55ad1eb4-56af-40a2-9c70-c186af12ee4c tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 946 time: 0.1024833
May 20 04:30:57.943834 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-972b964b-0267-4e36-b3fb-02435081b814 req-2dcc91bc-0a31-4a61-a127-5f5cf6a1e6a9 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=35bf24dc-8716-4edf-9f4f-f9d97739d7ef&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0440507
May 20 04:30:59.160333 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f149f44-4882-45a6-9941-b5c0aa68aa4c req-272c60f5-5c13-4632-b61b-0bd487fb1de3 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:30:59.161741 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-7f149f44-4882-45a6-9941-b5c0aa68aa4c req-272c60f5-5c13-4632-b61b-0bd487fb1de3 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 946 time: 0.0965004
May 20 04:30:59.208762 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-7f149f44-4882-45a6-9941-b5c0aa68aa4c req-ee1f4940-ea9e-4a6d-a131-6662f941dabe tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=35bf24dc-8716-4edf-9f4f-f9d97739d7ef&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0412185
May 20 04:30:59.865297 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-a441b412-54d9-4dd9-8a4e-78c4a00839e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:00.422084 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f881e4a-8d3d-441a-a3ed-9bb775f2e01d req-529a2fc5-eec2-427d-ae31-161748d5a557 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:00.424253 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-8f881e4a-8d3d-441a-a3ed-9bb775f2e01d req-529a2fc5-eec2-427d-ae31-161748d5a557 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 946 time: 0.0966544
May 20 04:31:00.473721 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-8f881e4a-8d3d-441a-a3ed-9bb775f2e01d req-a21d1db9-3aeb-4002-b796-3e8c38c623bc tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=35bf24dc-8716-4edf-9f4f-f9d97739d7ef&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0432522
May 20 04:31:01.668437 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-856a0ad6-91c5-4609-94c8-7fdd273e5e3e req-088ec40f-5dab-4bc1-b875-93da43067e53 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:01.669935 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-856a0ad6-91c5-4609-94c8-7fdd273e5e3e req-088ec40f-5dab-4bc1-b875-93da43067e53 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 946 time: 0.0830636
May 20 04:31:01.722554 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-856a0ad6-91c5-4609-94c8-7fdd273e5e3e req-0b9f91c8-7f5e-4171-8524-91698780d06c tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=35bf24dc-8716-4edf-9f4f-f9d97739d7ef&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0467620
May 20 04:31:02.567658 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:02.693897 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-560c278f-b14d-45a4-9fdc-2c35ca1726db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:02.919521 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45d2027e-418c-4d61-8005-b94664f672f4 req-64b2a01a-607c-4e64-a96c-3a0162e3e9f0 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:02.921016 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-45d2027e-418c-4d61-8005-b94664f672f4 req-64b2a01a-607c-4e64-a96c-3a0162e3e9f0 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 946 time: 0.0849349
May 20 04:31:02.972614 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-45d2027e-418c-4d61-8005-b94664f672f4 req-0406e76a-6de3-4a55-97fd-56ffb1c6c91b tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=35bf24dc-8716-4edf-9f4f-f9d97739d7ef&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0408039
May 20 04:31:03.356560 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ea4803bd-878f-47d5-9084-1ec41953c9db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:04.172134 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-410a52cb-74ac-4710-9b26-bb6983cbb6b8 req-6fd23b32-6399-4d44-95ea-619c986346a4 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:04.173517 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-410a52cb-74ac-4710-9b26-bb6983cbb6b8 req-6fd23b32-6399-4d44-95ea-619c986346a4 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 946 time: 0.0821552
May 20 04:31:04.223979 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-410a52cb-74ac-4710-9b26-bb6983cbb6b8 req-88c424fa-8495-42ef-890d-82735ed0525f tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=35bf24dc-8716-4edf-9f4f-f9d97739d7ef&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0420272
May 20 04:31:05.211464 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f21320cc-6a25-4ec1-8a32-8b119b35fd55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:05.420942 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6612fd28-01a3-4755-9d3e-0b5956f60248 req-932c5f2e-f59b-43fb-a717-7d916452664b tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:05.422406 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-6612fd28-01a3-4755-9d3e-0b5956f60248 req-932c5f2e-f59b-43fb-a717-7d916452664b tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 946 time: 0.0863841
May 20 04:31:05.484844 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-6612fd28-01a3-4755-9d3e-0b5956f60248 req-1310def8-aae0-409a-8079-4d5d9135a57b tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=35bf24dc-8716-4edf-9f4f-f9d97739d7ef&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0530260
May 20 04:31:06.576786 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:06.689218 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-379f0ad1-a205-4dbf-9788-5f0f2c8493de req-624dc926-28d0-4d8a-bd7e-bfc00e3ba93d tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:06.690669 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-379f0ad1-a205-4dbf-9788-5f0f2c8493de req-624dc926-28d0-4d8a-bd7e-bfc00e3ba93d tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 946 time: 0.0900445
May 20 04:31:06.738429 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-379f0ad1-a205-4dbf-9788-5f0f2c8493de req-096a3cd6-17f7-4564-8341-b3f12e8d2509 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=35bf24dc-8716-4edf-9f4f-f9d97739d7ef&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0389144
May 20 04:31:07.816311 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 1cc416ab-7f60-449e-8b91-113111ff4aa3 details requested by agent hyperv_hv-cinder-79091 with host hv-cinder-79091 {{(pid=91688) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 20 04:31:07.948440 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-670e6c5c-66bf-4319-87fb-7f84de412d94 req-a91883fe-2309-4607-a3b6-5e857b5e1abb tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:07.949993 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-670e6c5c-66bf-4319-87fb-7f84de412d94 req-a91883fe-2309-4607-a3b6-5e857b5e1abb tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 946 time: 0.0800900
May 20 04:31:07.985582 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port 1cc416ab-7f60-449e-8b91-113111ff4aa3, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=1cc416ab-7f60-449e-8b91-113111ff4aa3,segment=NetworkSegment(9521f383-6017-4b4d-9f47-cff4ed54cb57),segment_id=9521f383-6017-4b4d-9f47-cff4ed54cb57)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:31:07.999362 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Returning: {'device': '1cc416ab-7f60-449e-8b91-113111ff4aa3', 'network_id': '21794e86-fda7-40a6-a5a8-db117c7eeb9d', 'port_id': '1cc416ab-7f60-449e-8b91-113111ff4aa3', 'mac_address': 'fa:16:3e:76:fe:24', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 864, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '06f38702-3d3c-4e25-8f84-85483d1ddf28', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91688) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 20 04:31:08.001006 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-670e6c5c-66bf-4319-87fb-7f84de412d94 req-30250ef5-14e3-4e07-872d-eb9ce7827588 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=35bf24dc-8716-4edf-9f4f-f9d97739d7ef&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0447090
May 20 04:31:08.052830 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:08.069362 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.notifiers.nova [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 1cc416ab-7f60-449e-8b91-113111ff4aa3 {{(pid=91688) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 04:31:08.084769 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port 1cc416ab-7f60-449e-8b91-113111ff4aa3, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=1cc416ab-7f60-449e-8b91-113111ff4aa3,segment=NetworkSegment(9521f383-6017-4b4d-9f47-cff4ed54cb57),segment_id=9521f383-6017-4b4d-9f47-cff4ed54cb57)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:31:08.093003 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:08.094954 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:31:08.163308 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Pushing event updated for resources: {'Port': ['ID=1cc416ab-7f60-449e-8b91-113111ff4aa3,revision_number=6']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:31:08.170689 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:31:08.171033 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:31:08.171370 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:31:08.171685 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:31:08.172020 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:31:08.172339 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:31:08.172645 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:31:08.172982 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:31:08.173318 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:31:08.173630 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:31:08.173945 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:31:08.174260 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:31:08.178186 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:31:08.181497 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] get_ports_and_sgs() called for port_ids ['1cc416ab-7f60-449e-8b91-113111ff4aa3'] {{(pid=91688) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 04:31:09.208218 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ba3766e-f4be-4f2b-a150-70f337dc8e2a req-e52ebd76-c81d-4742-840a-32a1790020ea tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:09.209722 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-0ba3766e-f4be-4f2b-a150-70f337dc8e2a req-e52ebd76-c81d-4742-840a-32a1790020ea tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 945 time: 0.0871110
May 20 04:31:09.256049 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-0ba3766e-f4be-4f2b-a150-70f337dc8e2a req-11e82349-608c-4e24-981c-0f6b9e0c362b tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=35bf24dc-8716-4edf-9f4f-f9d97739d7ef&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0402637
May 20 04:31:09.852711 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 1cc416ab-7f60-449e-8b91-113111ff4aa3 up at agent hyperv_hv-cinder-79091 {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:31:09.924866 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Provisioning complete for port 1cc416ab-7f60-449e-8b91-113111ff4aa3 triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:31:09.925264 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:10.042924 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:10.069941 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7925b833-d836-40d7-81b2-48717d6da34b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1cc416ab-7f60-449e-8b91-113111ff4aa3'}] {{(pid=91688) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:31:10.081149 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port 1cc416ab-7f60-449e-8b91-113111ff4aa3, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=1cc416ab-7f60-449e-8b91-113111ff4aa3,segment=NetworkSegment(9521f383-6017-4b4d-9f47-cff4ed54cb57),segment_id=9521f383-6017-4b4d-9f47-cff4ed54cb57)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:31:10.086874 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:10.089107 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:31:10.118062 dv-cinder-790910-4-iscsi neutron-server[91688]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7925b833-d836-40d7-81b2-48717d6da34b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1cc416ab-7f60-449e-8b91-113111ff4aa3', 'code': 200}
May 20 04:31:10.158792 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Pushing event updated for resources: {'Port': ['ID=1cc416ab-7f60-449e-8b91-113111ff4aa3,revision_number=7']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:31:10.163719 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:31:10.461162 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e6ad568-1b25-442e-b091-efedf1cc4cc9 req-64385ff3-c1bd-4c98-9aad-73ba5a6c390a tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:10.462543 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-0e6ad568-1b25-442e-b091-efedf1cc4cc9 req-64385ff3-c1bd-4c98-9aad-73ba5a6c390a tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 946 time: 0.0916672
May 20 04:31:10.508970 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-0e6ad568-1b25-442e-b091-efedf1cc4cc9 req-1dc5b64d-2d70-45a0-ba68-d0afe0d08491 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=35bf24dc-8716-4edf-9f4f-f9d97739d7ef&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0406005
May 20 04:31:11.947261 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b474c928-198f-4222-bc38-0c48a3e56638 req-c38c645d-0d97-4aea-a029-4ffd474adf10 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:11.948763 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-b474c928-198f-4222-bc38-0c48a3e56638 req-c38c645d-0d97-4aea-a029-4ffd474adf10 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 946 time: 0.3240514
May 20 04:31:11.995688 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-b474c928-198f-4222-bc38-0c48a3e56638 req-d818c6c9-23bf-496a-b783-33804a11ba30 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=35bf24dc-8716-4edf-9f4f-f9d97739d7ef&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0402017
May 20 04:31:13.268438 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45a43258-f5e4-41f7-8524-70dc8caf164f req-92c9872d-7bab-4ce1-9184-cb4b34014bde tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:13.269954 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-45a43258-f5e4-41f7-8524-70dc8caf164f req-92c9872d-7bab-4ce1-9184-cb4b34014bde tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 946 time: 0.1608188
May 20 04:31:13.319348 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-45a43258-f5e4-41f7-8524-70dc8caf164f req-7694e98a-837e-41a5-876a-8d530fd66678 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=35bf24dc-8716-4edf-9f4f-f9d97739d7ef&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0432782
May 20 04:31:14.532381 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08435add-e0cd-40ef-9ec1-bac37bb904b0 req-2f371cc5-72ee-4406-b848-a2dc644ee1c7 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:14.534848 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-08435add-e0cd-40ef-9ec1-bac37bb904b0 req-2f371cc5-72ee-4406-b848-a2dc644ee1c7 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 946 time: 0.0916193
May 20 04:31:14.589585 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-08435add-e0cd-40ef-9ec1-bac37bb904b0 req-981e98f8-4544-4c23-9a43-9bfd25a7dc08 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=35bf24dc-8716-4edf-9f4f-f9d97739d7ef&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0475152
May 20 04:31:15.777532 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c82f13f-fb2b-4c5f-89a8-e5872df765e0 req-48d9087e-8cf8-471b-9114-a67edc110896 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:15.779552 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-0c82f13f-fb2b-4c5f-89a8-e5872df765e0 req-48d9087e-8cf8-471b-9114-a67edc110896 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 946 time: 0.0825119
May 20 04:31:15.831005 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-0c82f13f-fb2b-4c5f-89a8-e5872df765e0 req-ae2bd58d-d107-46cd-b8bc-648cef90a4ce tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=35bf24dc-8716-4edf-9f4f-f9d97739d7ef&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0457420
May 20 04:31:17.058161 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04bfbe13-8a7b-4ace-becd-f41ea5220e76 req-455d7bcb-e2b3-4347-8c63-a8f0d5f1998e tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:17.061151 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-04bfbe13-8a7b-4ace-becd-f41ea5220e76 req-455d7bcb-e2b3-4347-8c63-a8f0d5f1998e tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 946 time: 0.0867558
May 20 04:31:17.111982 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-04bfbe13-8a7b-4ace-becd-f41ea5220e76 req-e799219f-87e3-498f-b902-0810fdebc52a tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=35bf24dc-8716-4edf-9f4f-f9d97739d7ef&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0423403
May 20 04:31:18.462732 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e09ee08-cb3f-43d0-b275-7ade7f9dac8d req-f89f0b7c-750a-4182-967f-2466e03e21f7 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:18.464400 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-1e09ee08-cb3f-43d0-b275-7ade7f9dac8d req-f89f0b7c-750a-4182-967f-2466e03e21f7 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 946 time: 0.2287838
May 20 04:31:18.516233 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-1e09ee08-cb3f-43d0-b275-7ade7f9dac8d req-6ecdfe41-c06f-41bd-808d-21a5f51ac19d tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=35bf24dc-8716-4edf-9f4f-f9d97739d7ef&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0447035
May 20 04:31:19.833720 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3506d5fd-4607-4efb-a460-98d3584aefe9 req-ddaf42c8-0a96-41bb-aa6f-ce4b61d3c1e1 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:19.835172 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-3506d5fd-4607-4efb-a460-98d3584aefe9 req-ddaf42c8-0a96-41bb-aa6f-ce4b61d3c1e1 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 946 time: 0.1930444
May 20 04:31:19.887543 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-3506d5fd-4607-4efb-a460-98d3584aefe9 req-5c0ab526-71c0-4d9f-a554-2031376b65c4 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=35bf24dc-8716-4edf-9f4f-f9d97739d7ef&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0433207
May 20 04:31:20.956350 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.agents_db [None req-92d61f12-17bc-4bf9-9eab-8a69b8c6da2f None None] Agent healthcheck: found 6 active agents {{(pid=91689) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 04:31:21.097277 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30955c62-1745-44ce-800c-4e45b3859dc6 req-f37dc264-6ca3-4f2f-bd00-db11b7e8aac0 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:21.098764 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-30955c62-1745-44ce-800c-4e45b3859dc6 req-f37dc264-6ca3-4f2f-bd00-db11b7e8aac0 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 946 time: 0.0911634
May 20 04:31:21.151159 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-30955c62-1745-44ce-800c-4e45b3859dc6 req-6f02b7bd-7904-4857-862b-5f8fe61edf77 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=35bf24dc-8716-4edf-9f4f-f9d97739d7ef&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0455534
May 20 04:31:22.375080 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-731e6244-fed3-41e9-8d4f-365d9cf9ecee req-3c43b8d1-4ca5-487e-b008-c1e718a4f21d tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:22.377284 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-731e6244-fed3-41e9-8d4f-365d9cf9ecee req-3c43b8d1-4ca5-487e-b008-c1e718a4f21d tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 946 time: 0.0889554
May 20 04:31:22.428195 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-731e6244-fed3-41e9-8d4f-365d9cf9ecee req-4b76edae-2a7f-4d3b-a003-5978b660d180 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=35bf24dc-8716-4edf-9f4f-f9d97739d7ef&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0443041
May 20 04:31:23.630652 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f27bfdb6-1a96-4732-968e-78365b337b78 req-c7015239-f74e-4442-9900-f3aa9c39a9a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:23.631399 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-989445b3-6791-41a7-9a4f-d7163f004544 req-f5beca55-4b50-4300-b016-89f17f0ffb63 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:23.632161 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-f27bfdb6-1a96-4732-968e-78365b337b78 req-c7015239-f74e-4442-9900-f3aa9c39a9a9 service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=ef3bec4745b14484ac8e21cd16cbd11d&device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 1099 time: 0.0741856
May 20 04:31:23.632472 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-989445b3-6791-41a7-9a4f-d7163f004544 req-f5beca55-4b50-4300-b016-89f17f0ffb63 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 946 time: 0.0825741
May 20 04:31:23.678597 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-989445b3-6791-41a7-9a4f-d7163f004544 req-62fb46fa-7f3b-4f7c-9457-0db9b3ad592f tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=35bf24dc-8716-4edf-9f4f-f9d97739d7ef&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0400767
May 20 04:31:23.765030 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f27bfdb6-1a96-4732-968e-78365b337b78 req-43b94edb-fc80-4ea2-bf5c-90e5f9bf9d3c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:23.766463 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-f27bfdb6-1a96-4732-968e-78365b337b78 req-43b94edb-fc80-4ea2-bf5c-90e5f9bf9d3c service neutron] 10.222.0.82 "GET /v2.0/networks?id=21794e86-fda7-40a6-a5a8-db117c7eeb9d HTTP/1.1" status: 200  len: 918 time: 0.1279669
May 20 04:31:23.881261 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-f27bfdb6-1a96-4732-968e-78365b337b78 req-782a55b9-edc4-4ab7-a3f3-15b8d7b639c7 service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=1cc416ab-7f60-449e-8b91-113111ff4aa3 HTTP/1.1" status: 200  len: 1001 time: 0.1076822
May 20 04:31:23.948492 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f27bfdb6-1a96-4732-968e-78365b337b78 req-a4d50678-9fa8-4c4d-a325-76cfaefdba74 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:23.949957 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-f27bfdb6-1a96-4732-968e-78365b337b78 req-a4d50678-9fa8-4c4d-a325-76cfaefdba74 service neutron] 10.222.0.82 "GET /v2.0/subnets?id=06f38702-3d3c-4e25-8f84-85483d1ddf28 HTTP/1.1" status: 200  len: 856 time: 0.0619979
May 20 04:31:24.030903 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f27bfdb6-1a96-4732-968e-78365b337b78 req-7956f059-eeb9-4b61-a97e-4e1ac843f059 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:24.032285 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-f27bfdb6-1a96-4732-968e-78365b337b78 req-7956f059-eeb9-4b61-a97e-4e1ac843f059 service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=21794e86-fda7-40a6-a5a8-db117c7eeb9d&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0758905
May 20 04:31:24.164728 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-f27bfdb6-1a96-4732-968e-78365b337b78 req-4114e95d-34eb-4f4e-9cde-e12832d6495a service neutron] 10.222.0.82 "GET /v2.0/networks/21794e86-fda7-40a6-a5a8-db117c7eeb9d?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1254032
May 20 04:31:24.297126 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-f27bfdb6-1a96-4732-968e-78365b337b78 req-54806f57-a7d0-474f-90b5-71ae9fb83c9e service neutron] 10.222.0.82 "GET /v2.0/networks/21794e86-fda7-40a6-a5a8-db117c7eeb9d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1252267
May 20 04:31:24.890653 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22731705-f2fe-45f6-807d-3ba883f959e7 req-9f051318-b3e1-4d8d-a9be-583118c21ae8 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:24.892112 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-22731705-f2fe-45f6-807d-3ba883f959e7 req-9f051318-b3e1-4d8d-a9be-583118c21ae8 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 946 time: 0.0878136
May 20 04:31:25.088796 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-22731705-f2fe-45f6-807d-3ba883f959e7 req-afef880d-33ce-4a05-8e9f-90c385eee865 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=35bf24dc-8716-4edf-9f4f-f9d97739d7ef&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1906068
May 20 04:31:25.957955 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 1cc416ab-7f60-449e-8b91-113111ff4aa3 no longer exists at agent hyperv_hv-cinder-79091 {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 04:31:26.075449 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:26.102047 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7925b833-d836-40d7-81b2-48717d6da34b', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '1cc416ab-7f60-449e-8b91-113111ff4aa3'}] {{(pid=91688) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:31:26.111988 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port 1cc416ab-7f60-449e-8b91-113111ff4aa3, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=1cc416ab-7f60-449e-8b91-113111ff4aa3,segment=NetworkSegment(9521f383-6017-4b4d-9f47-cff4ed54cb57),segment_id=9521f383-6017-4b4d-9f47-cff4ed54cb57)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:31:26.117015 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:26.117862 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:31:26.151120 dv-cinder-790910-4-iscsi neutron-server[91688]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7925b833-d836-40d7-81b2-48717d6da34b', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '1cc416ab-7f60-449e-8b91-113111ff4aa3', 'code': 200}
May 20 04:31:26.182179 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Pushing event updated for resources: {'Port': ['ID=1cc416ab-7f60-449e-8b91-113111ff4aa3,revision_number=8']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:31:26.185342 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.067s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:31:26.309885 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a30c205a-b68c-4a86-9cbb-06244a965520 req-b8acd422-5327-413a-becb-83255b8f5632 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:26.311337 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a30c205a-b68c-4a86-9cbb-06244a965520 req-b8acd422-5327-413a-becb-83255b8f5632 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 944 time: 0.1052029
May 20 04:31:26.359581 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a30c205a-b68c-4a86-9cbb-06244a965520 req-c2458e55-6fed-4bfa-a0b7-a1e0350b2268 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=35bf24dc-8716-4edf-9f4f-f9d97739d7ef&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0419643
May 20 04:31:27.808964 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13636731-4fe4-4e43-8b26-885b7165eb03 req-8a7f4195-cd40-409e-b234-2698d337915b tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:27.810458 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-13636731-4fe4-4e43-8b26-885b7165eb03 req-8a7f4195-cd40-409e-b234-2698d337915b tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 944 time: 0.0814843
May 20 04:31:27.863174 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-13636731-4fe4-4e43-8b26-885b7165eb03 req-fe992b3a-9e0c-447d-9c3f-39a914ada233 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=35bf24dc-8716-4edf-9f4f-f9d97739d7ef&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0467591
May 20 04:31:27.981469 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-a2ac3724-e6e8-4aaa-89b7-3533d8ad3e95 req-6dc74241-6418-4611-8734-749bc136a8d0 service neutron] 10.222.0.71 "GET /v2.0/ports?device_id=7925b833-d836-40d7-81b2-48717d6da34b&fields=id&fields=resource_request HTTP/1.1" status: 200  len: 255 time: 0.1258430
May 20 04:31:28.950252 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2ac3724-e6e8-4aaa-89b7-3533d8ad3e95 req-d056cfbe-7b40-4a4b-b1d2-65abe36fb4a8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:28.951747 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a2ac3724-e6e8-4aaa-89b7-3533d8ad3e95 req-d056cfbe-7b40-4a4b-b1d2-65abe36fb4a8 service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=7925b833-d836-40d7-81b2-48717d6da34b&tenant_id=ef3bec4745b14484ac8e21cd16cbd11d HTTP/1.1" status: 200  len: 1097 time: 0.1191533
May 20 04:31:29.048660 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2ac3724-e6e8-4aaa-89b7-3533d8ad3e95 req-d3aa972c-eb57-4f0e-ba56-4f1118f276bd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:29.050357 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a2ac3724-e6e8-4aaa-89b7-3533d8ad3e95 req-d3aa972c-eb57-4f0e-ba56-4f1118f276bd service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=ef3bec4745b14484ac8e21cd16cbd11d&device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 1097 time: 0.0710773
May 20 04:31:29.055496 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ca41d74-5013-4d78-9828-0abddac65186 req-8b5f75e4-f52d-4167-bded-a99c535c28d1 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:29.057095 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-1ca41d74-5013-4d78-9828-0abddac65186 req-8b5f75e4-f52d-4167-bded-a99c535c28d1 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 944 time: 0.0828836
May 20 04:31:29.104241 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-1ca41d74-5013-4d78-9828-0abddac65186 req-573388b2-53bc-4d0e-bd29-669133d47588 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=35bf24dc-8716-4edf-9f4f-f9d97739d7ef&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0412364
May 20 04:31:29.186256 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2ac3724-e6e8-4aaa-89b7-3533d8ad3e95 req-eb9e825b-725c-408a-95eb-2ae575da5557 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:29.187704 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a2ac3724-e6e8-4aaa-89b7-3533d8ad3e95 req-eb9e825b-725c-408a-95eb-2ae575da5557 service neutron] 10.222.0.82 "GET /v2.0/networks?id=21794e86-fda7-40a6-a5a8-db117c7eeb9d HTTP/1.1" status: 200  len: 918 time: 0.1307282
May 20 04:31:29.291819 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a2ac3724-e6e8-4aaa-89b7-3533d8ad3e95 req-c69843d8-af63-4a51-9423-a260375c59f1 service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=1cc416ab-7f60-449e-8b91-113111ff4aa3 HTTP/1.1" status: 200  len: 999 time: 0.0970790
May 20 04:31:29.459879 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2ac3724-e6e8-4aaa-89b7-3533d8ad3e95 req-11bee1ee-fc41-45af-9cc2-b9a5c1ee6dc9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:29.461909 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a2ac3724-e6e8-4aaa-89b7-3533d8ad3e95 req-11bee1ee-fc41-45af-9cc2-b9a5c1ee6dc9 service neutron] 10.222.0.82 "GET /v2.0/subnets?id=06f38702-3d3c-4e25-8f84-85483d1ddf28 HTTP/1.1" status: 200  len: 856 time: 0.1621189
May 20 04:31:29.543551 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2ac3724-e6e8-4aaa-89b7-3533d8ad3e95 req-5e31d890-8fbe-4070-9c4b-c06829fcc70a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:29.545070 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a2ac3724-e6e8-4aaa-89b7-3533d8ad3e95 req-5e31d890-8fbe-4070-9c4b-c06829fcc70a service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=21794e86-fda7-40a6-a5a8-db117c7eeb9d&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0762856
May 20 04:31:29.557123 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [req-a2ac3724-e6e8-4aaa-89b7-3533d8ad3e95 req-596ba2e6-fc2b-4e49-b697-0ef28a47ac45 service neutron] http://10.222.0.71:9696/v2.0/extensions returned with HTTP 200 {{(pid=91687) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 20 04:31:29.558042 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a2ac3724-e6e8-4aaa-89b7-3533d8ad3e95 req-596ba2e6-fc2b-4e49-b697-0ef28a47ac45 service neutron] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0049448
May 20 04:31:29.691635 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a2ac3724-e6e8-4aaa-89b7-3533d8ad3e95 req-d1de3132-a62c-4afc-ae4c-58f474198da6 service neutron] 10.222.0.82 "GET /v2.0/networks/21794e86-fda7-40a6-a5a8-db117c7eeb9d?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1267138
May 20 04:31:29.827151 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a2ac3724-e6e8-4aaa-89b7-3533d8ad3e95 req-8f975df2-9c11-4e53-8d1e-2c2258440db9 service neutron] 10.222.0.82 "GET /v2.0/networks/21794e86-fda7-40a6-a5a8-db117c7eeb9d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1289084
May 20 04:31:29.859868 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-28edcf51-ee78-40d8-ae3e-08f9f25b8fc4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:29.992922 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 1cc416ab-7f60-449e-8b91-113111ff4aa3 no longer exists at agent hyperv_hv-cinder-79091 {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 04:31:30.350846 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-883df637-3d44-41e4-8f60-36a4ba02375d req-dec51b77-7fe0-4b86-beda-38fb4d1c1a50 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:30.352689 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-883df637-3d44-41e4-8f60-36a4ba02375d req-dec51b77-7fe0-4b86-beda-38fb4d1c1a50 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 944 time: 0.1270587
May 20 04:31:30.417638 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-883df637-3d44-41e4-8f60-36a4ba02375d req-773a4d4f-3f74-4795-a93e-bdfcb82dfb26 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=35bf24dc-8716-4edf-9f4f-f9d97739d7ef&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0583618
May 20 04:31:31.627666 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b937c4c-4164-4648-82f2-a49872704201 req-5e45970f-41a2-4429-8bc1-781058c93b13 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:31.629483 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-8b937c4c-4164-4648-82f2-a49872704201 req-5e45970f-41a2-4429-8bc1-781058c93b13 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 944 time: 0.0899482
May 20 04:31:31.687804 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-8b937c4c-4164-4648-82f2-a49872704201 req-21f75168-a35f-4d17-9d29-a906513abe44 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=35bf24dc-8716-4edf-9f4f-f9d97739d7ef&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0516024
May 20 04:31:32.572420 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:32.699500 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f856b0a5-ad34-40df-91f7-d235a461b4f5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:32.899646 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b9e520a-076a-4f51-a091-5533f376934c req-b0298e85-607f-4a61-927a-f3e0e129fb5c tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:32.901166 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4b9e520a-076a-4f51-a091-5533f376934c req-b0298e85-607f-4a61-927a-f3e0e129fb5c tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 944 time: 0.0973511
May 20 04:31:32.963609 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4b9e520a-076a-4f51-a091-5533f376934c req-4e1aa0b1-d34e-4766-b7fd-e894200f94b5 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=35bf24dc-8716-4edf-9f4f-f9d97739d7ef&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0557899
May 20 04:31:33.358865 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ea4803bd-878f-47d5-9084-1ec41953c9db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:34.161921 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6269074-6bcf-494a-a7c8-77fd701a47f8 req-82443487-4b92-4e55-85f6-3cf16d040dfd tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:34.163995 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-e6269074-6bcf-494a-a7c8-77fd701a47f8 req-82443487-4b92-4e55-85f6-3cf16d040dfd tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 944 time: 0.0901487
May 20 04:31:34.215189 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-e6269074-6bcf-494a-a7c8-77fd701a47f8 req-4292a47d-0ff0-4b3d-9cdf-8f4e57a8b579 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=35bf24dc-8716-4edf-9f4f-f9d97739d7ef&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0449591
May 20 04:31:34.586935 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71e64524-8c61-4bb2-b06f-79cbc6d10139 req-6cd41013-8e81-4eac-9557-8682b2e11793 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:34.588304 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-71e64524-8c61-4bb2-b06f-79cbc6d10139 req-6cd41013-8e81-4eac-9557-8682b2e11793 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/ports?device_id=9e9ac66e-ff2b-4295-8476-471c42fe11a5 HTTP/1.1" status: 200  len: 946 time: 0.0914855
May 20 04:31:34.635141 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-71e64524-8c61-4bb2-b06f-79cbc6d10139 req-5ead00b1-e4d8-4aef-9b66-1265e62c2091 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/security-groups?id=ef28d688-789b-4282-a30c-d7d731615fbf&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0381956
May 20 04:31:35.213333 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f21320cc-6a25-4ec1-8a32-8b119b35fd55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:35.418674 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70cfa711-4e4a-422f-8fb0-b25c3e084cac req-2a2098cc-5188-41d6-8fce-5c3fa4614553 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:35.420402 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-70cfa711-4e4a-422f-8fb0-b25c3e084cac req-2a2098cc-5188-41d6-8fce-5c3fa4614553 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 944 time: 0.0856674
May 20 04:31:35.468102 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-70cfa711-4e4a-422f-8fb0-b25c3e084cac req-ea1c1d51-ca40-4a8e-8a40-49dbe837ed5b tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=35bf24dc-8716-4edf-9f4f-f9d97739d7ef&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0412414
May 20 04:31:35.836508 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-313a4ba0-a802-4c4c-b229-9aaebf75f4dd req-fb3bd218-3b17-43fc-9a18-06850e8bb7ae tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:35.838047 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-313a4ba0-a802-4c4c-b229-9aaebf75f4dd req-fb3bd218-3b17-43fc-9a18-06850e8bb7ae tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/ports?device_id=9e9ac66e-ff2b-4295-8476-471c42fe11a5 HTTP/1.1" status: 200  len: 946 time: 0.0894475
May 20 04:31:35.896707 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-313a4ba0-a802-4c4c-b229-9aaebf75f4dd req-0f78570a-34a4-49ee-8ac8-e11f85903b7d tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/security-groups?id=ef28d688-789b-4282-a30c-d7d731615fbf&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0522745
May 20 04:31:36.591837 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:36.680809 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0bd72bf-6054-4fb0-babd-87c2e55faf1e req-a3fd982d-ce9d-4087-ae08-dcdbc1db2cd0 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:36.682349 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a0bd72bf-6054-4fb0-babd-87c2e55faf1e req-a3fd982d-ce9d-4087-ae08-dcdbc1db2cd0 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 944 time: 0.0949037
May 20 04:31:36.730519 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a0bd72bf-6054-4fb0-babd-87c2e55faf1e req-0d7f1ff2-a25c-4886-8d6e-d17200826e86 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=35bf24dc-8716-4edf-9f4f-f9d97739d7ef&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0421858
May 20 04:31:37.094334 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98496d6b-66c2-4620-bdce-004c259dbc9e req-fdece3b3-538e-43f8-8c3e-326a325ff753 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:37.095841 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-98496d6b-66c2-4620-bdce-004c259dbc9e req-fdece3b3-538e-43f8-8c3e-326a325ff753 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/ports?device_id=9e9ac66e-ff2b-4295-8476-471c42fe11a5 HTTP/1.1" status: 200  len: 946 time: 0.0833852
May 20 04:31:37.145008 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-98496d6b-66c2-4620-bdce-004c259dbc9e req-493a7575-718b-4115-a3ca-8ce9987c91d5 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/security-groups?id=ef28d688-789b-4282-a30c-d7d731615fbf&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0425899
May 20 04:31:37.928053 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb90a31a-a705-476f-a85b-baf15792d0ec req-7c9c003a-b5f0-4a56-971e-0403dac67183 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:37.929521 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-eb90a31a-a705-476f-a85b-baf15792d0ec req-7c9c003a-b5f0-4a56-971e-0403dac67183 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 944 time: 0.0864449
May 20 04:31:37.977114 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-eb90a31a-a705-476f-a85b-baf15792d0ec req-cd734811-df1c-4e48-8b41-bbff1ca7315a tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=35bf24dc-8716-4edf-9f4f-f9d97739d7ef&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0416002
May 20 04:31:38.340934 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e3f3e90-687f-4f35-bc5c-ecc2719071f8 req-f2878d47-3ffb-438d-88fb-80f78f8ff27f tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:38.342435 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-3e3f3e90-687f-4f35-bc5c-ecc2719071f8 req-f2878d47-3ffb-438d-88fb-80f78f8ff27f tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/ports?device_id=9e9ac66e-ff2b-4295-8476-471c42fe11a5 HTTP/1.1" status: 200  len: 946 time: 0.0915072
May 20 04:31:38.396555 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-3e3f3e90-687f-4f35-bc5c-ecc2719071f8 req-0b60ba78-efea-4672-b79d-0ec453d3108f tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/security-groups?id=ef28d688-789b-4282-a30c-d7d731615fbf&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0451105
May 20 04:31:38.767150 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 45886) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:31:39.059364 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [None req-80144644-4f54-4e2b-993b-0f3628c73fa4 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Deleting port 27ae22f3-8866-4345-b3d1-45c6d78ab856 {{(pid=91687) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 04:31:39.060083 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-80144644-4f54-4e2b-993b-0f3628c73fa4 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8782892520551'] for port, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:39.253360 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-80144644-4f54-4e2b-993b-0f3628c73fa4 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1718922'] for port, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:39.253701 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-80144644-4f54-4e2b-993b-0f3628c73fa4 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:39.322554 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97bd5ec9-f6a2-42b6-b530-23b8f4d451f9 req-5bfc2208-e4f9-4bfc-9b03-72de676fcbab tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:39.324101 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-97bd5ec9-f6a2-42b6-b530-23b8f4d451f9 req-5bfc2208-e4f9-4bfc-9b03-72de676fcbab tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 944 time: 0.2240281
May 20 04:31:39.389089 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [None req-80144644-4f54-4e2b-993b-0f3628c73fa4 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Calling delete_port for 27ae22f3-8866-4345-b3d1-45c6d78ab856 owned by network:floatingip {{(pid=91687) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 04:31:39.444422 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-97bd5ec9-f6a2-42b6-b530-23b8f4d451f9 req-045c709d-1ee2-4b7f-8b8d-68f0a6a18a9f tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=35bf24dc-8716-4edf-9f4f-f9d97739d7ef&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0630379
May 20 04:31:39.623342 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c179837-b661-4598-8022-dd7ee74b54dc req-891f9ef3-44b8-46a9-9c81-06c13092a40d tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:39.624989 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-0c179837-b661-4598-8022-dd7ee74b54dc req-891f9ef3-44b8-46a9-9c81-06c13092a40d tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/ports?device_id=9e9ac66e-ff2b-4295-8476-471c42fe11a5 HTTP/1.1" status: 200  len: 946 time: 0.0931129
May 20 04:31:39.674527 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-0c179837-b661-4598-8022-dd7ee74b54dc req-ce712f71-3916-419e-bd98-2d5996053b03 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/security-groups?id=ef28d688-789b-4282-a30c-d7d731615fbf&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0430989
May 20 04:31:39.676755 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-80144644-4f54-4e2b-993b-0f3628c73fa4 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8782892522936', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8782892108804', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4162192'] for port, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:39.681786 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-34d40daa-7289-4965-8f90-fdde9b6f3d56 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:31:39.726100 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80144644-4f54-4e2b-993b-0f3628c73fa4 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Pushing event deleted for resources: {'Port': ['ID=27ae22f3-8866-4345-b3d1-45c6d78ab856,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:31:39.768075 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80144644-4f54-4e2b-993b-0f3628c73fa4 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:31:39.768453 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80144644-4f54-4e2b-993b-0f3628c73fa4 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:31:39.768820 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80144644-4f54-4e2b-993b-0f3628c73fa4 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:31:39.769281 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80144644-4f54-4e2b-993b-0f3628c73fa4 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:31:39.769640 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80144644-4f54-4e2b-993b-0f3628c73fa4 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:31:39.770003 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80144644-4f54-4e2b-993b-0f3628c73fa4 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:31:39.770349 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80144644-4f54-4e2b-993b-0f3628c73fa4 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:31:39.770719 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80144644-4f54-4e2b-993b-0f3628c73fa4 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:31:39.771049 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80144644-4f54-4e2b-993b-0f3628c73fa4 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:31:39.771397 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80144644-4f54-4e2b-993b-0f3628c73fa4 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:31:39.771709 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80144644-4f54-4e2b-993b-0f3628c73fa4 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:31:39.772065 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80144644-4f54-4e2b-993b-0f3628c73fa4 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:31:39.798942 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-80144644-4f54-4e2b-993b-0f3628c73fa4 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:31:39.832215 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-80144644-4f54-4e2b-993b-0f3628c73fa4 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Notify callbacks [] for floatingip, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:39.832649 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.db.l3_db [None req-80144644-4f54-4e2b-993b-0f3628c73fa4 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Floating IP e653a34a-b881-4576-9118-d5b4aa3d0533 disassociated (deleted). External IP: 172.27.1.154, port: 9c846663-c90b-41d4-a8d1-1086882ba27e.
May 20 04:31:40.195260 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-80144644-4f54-4e2b-993b-0f3628c73fa4 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Router 093b6879-26f9-4912-a2fc-dab73a0df7cb has already been hosted by L3 agent 02733fc0-fc9c-4e29-bc03-c27a792d539d {{(pid=91687) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 04:31:40.374673 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-80144644-4f54-4e2b-993b-0f3628c73fa4 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Notify agent at l3_agent.dv-cinder-790910-4-iscsi the message routers_updated {{(pid=91687) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 04:31:40.385171 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1d77e365-89de-4ccd-af56-a5a98a36dcf3 None None] Sync routers for ids ['093b6879-26f9-4912-a2fc-dab73a0df7cb'] in dv-cinder-790910-4-iscsi {{(pid=91688) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 04:31:40.398915 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1d77e365-89de-4ccd-af56-a5a98a36dcf3 None None] Routers {'093b6879-26f9-4912-a2fc-dab73a0df7cb'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91688) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:31:40.399495 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-80144644-4f54-4e2b-993b-0f3628c73fa4 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for floatingip, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:40.399638 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-1d77e365-89de-4ccd-af56-a5a98a36dcf3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced17e17f0>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:31:33Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['093b6879-26f9-4912-a2fc-dab73a0df7cb'], 'active': True} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:31:40.454163 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-80144644-4f54-4e2b-993b-0f3628c73fa4 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "DELETE /v2.0/floatingips/e653a34a-b881-4576-9118-d5b4aa3d0533 HTTP/1.1" status: 204  len: 168 time: 1.6857648
May 20 04:31:40.454926 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18', 'tag': '9c846663-c90b-41d4-a8d1-1086882ba27e'}] {{(pid=91687) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:31:40.510277 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18', 'tag': '9c846663-c90b-41d4-a8d1-1086882ba27e', 'status': 'completed', 'code': 200}
May 20 04:31:40.578461 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvr_db [None req-1d77e365-89de-4ccd-af56-a5a98a36dcf3 None None] Set router 093b6879-26f9-4912-a2fc-dab73a0df7cb gateway port host: dv-cinder-790910-4-iscsi {{(pid=91688) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:31:40.679566 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bff012a5-5857-4ca8-be55-161cb0115d6e req-0fb44289-4398-4c4e-8243-d2779808e387 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:40.681317 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-bff012a5-5857-4ca8-be55-161cb0115d6e req-0fb44289-4398-4c4e-8243-d2779808e387 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 944 time: 0.0890851
May 20 04:31:40.727802 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-bff012a5-5857-4ca8-be55-161cb0115d6e req-38cfe916-66aa-4e8e-ae8f-959a3e554fdb tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=35bf24dc-8716-4edf-9f4f-f9d97739d7ef&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0395513
May 20 04:31:40.839514 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a87cbd8b-b7bd-4865-a7f9-8dc11d6aff56 req-7152452f-d088-4e8d-877e-d0a36e9924dd tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:40.840212 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-a87cbd8b-b7bd-4865-a7f9-8dc11d6aff56 req-7152452f-d088-4e8d-877e-d0a36e9924dd tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Synchronizing usage tracker for tenant:a1319e4a0fc74f98ba4bb88d8a04086b on resource:port {{(pid=91687) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:31:40.858351 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-a87cbd8b-b7bd-4865-a7f9-8dc11d6aff56 req-7152452f-d088-4e8d-877e-d0a36e9924dd tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Unset dirty status for tenant:a1319e4a0fc74f98ba4bb88d8a04086b on resource:port {{(pid=91687) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:31:40.859752 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a87cbd8b-b7bd-4865-a7f9-8dc11d6aff56 req-7152452f-d088-4e8d-877e-d0a36e9924dd tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 946 time: 0.1067374
May 20 04:31:40.900456 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-1d77e365-89de-4ccd-af56-a5a98a36dcf3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced17e17f0>, [{'id': '093b6879-26f9-4912-a2fc-dab73a0df7cb', 'name': 'tempest-TestShelveInstance-1799598596-router', 'tenant_id': 'a1319e4a0fc74f98ba4bb88d8a04086b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.187'}], 'enable_snat': True}, 'gw_port_id': '283f3ebf-83f3-4e30-ae78-4ec7e8841e26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:24:02Z', 'updated_at': '2021-05-20T04:24:12Z', 'revision_number': 4, 'project_id': 'a1319e4a0fc74f98ba4bb88d8a04086b', 'gw_port': {'id': '283f3ebf-83f3-4e30-ae78-4ec7e8841e26', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:d2:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '093b6879-26f9-4912-a2fc-dab73a0df7cb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 395, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.187', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:24:03Z', 'updated_at': '2021-05-20T04:24:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_interfaces': [{'id': 'a97d355e-c698-41a6-8ed6-aaec93b83e2a', 'name': '', 'network_id': 'e31171ff-f097-446e-b691-bef7aad2fb3b', 'tenant_id': 'a1319e4a0fc74f98ba4bb88d8a04086b', 'mac_address': 'fa:16:3e:8e:5a:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '093b6879-26f9-4912-a2fc-dab73a0df7cb', 'device_owner': 'network:router_interface', 'standard_attr_id': 401, 'fixed_ips': [{'subnet_id': '410f59de-055d-4298-96bf-5d9a7712368d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:24:11Z', 'updated_at': '2021-05-20T04:24:21Z', 'revision_number': 5, 'project_id': 'a1319e4a0fc74f98ba4bb88d8a04086b', 'subnets': [{'id': '410f59de-055d-4298-96bf-5d9a7712368d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:31:40.906331 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1d77e365-89de-4ccd-af56-a5a98a36dcf3 None None] Checking router: 093b6879-26f9-4912-a2fc-dab73a0df7cb for host: dv-cinder-790910-4-iscsi {{(pid=91688) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 04:31:40.913487 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a87cbd8b-b7bd-4865-a7f9-8dc11d6aff56 req-d26fa34e-5f61-4c01-8310-cdf308b22d36 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/security-groups?id=34e473fa-df05-422b-9abc-99aed131bade&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0470743
May 20 04:31:40.915969 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1d77e365-89de-4ccd-af56-a5a98a36dcf3 None None] Routers {'093b6879-26f9-4912-a2fc-dab73a0df7cb'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91688) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:31:40.916577 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-1d77e365-89de-4ccd-af56-a5a98a36dcf3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced17e17f0>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:31:33Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['093b6879-26f9-4912-a2fc-dab73a0df7cb'], 'active': True} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:31:40.930155 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bc8529f-7303-45e4-a992-71effc0f2833 req-31fd4524-c72d-4d4d-abd2-056f28116ab2 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:40.931740 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-5bc8529f-7303-45e4-a992-71effc0f2833 req-31fd4524-c72d-4d4d-abd2-056f28116ab2 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/ports?device_id=9e9ac66e-ff2b-4295-8476-471c42fe11a5 HTTP/1.1" status: 200  len: 946 time: 0.0943928
May 20 04:31:40.976306 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-5bc8529f-7303-45e4-a992-71effc0f2833 req-86ebd78c-d65d-47e0-b1df-91c5a96a47f3 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/security-groups?id=ef28d688-789b-4282-a30c-d7d731615fbf&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0386753
May 20 04:31:41.128245 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvr_db [None req-1d77e365-89de-4ccd-af56-a5a98a36dcf3 None None] Set router 093b6879-26f9-4912-a2fc-dab73a0df7cb gateway port host: dv-cinder-790910-4-iscsi {{(pid=91688) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:31:41.437824 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-1d77e365-89de-4ccd-af56-a5a98a36dcf3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced17e17f0>, [{'id': '093b6879-26f9-4912-a2fc-dab73a0df7cb', 'name': 'tempest-TestShelveInstance-1799598596-router', 'tenant_id': 'a1319e4a0fc74f98ba4bb88d8a04086b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.187'}], 'enable_snat': True}, 'gw_port_id': '283f3ebf-83f3-4e30-ae78-4ec7e8841e26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:24:02Z', 'updated_at': '2021-05-20T04:24:12Z', 'revision_number': 4, 'project_id': 'a1319e4a0fc74f98ba4bb88d8a04086b', 'gw_port': {'id': '283f3ebf-83f3-4e30-ae78-4ec7e8841e26', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:d2:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '093b6879-26f9-4912-a2fc-dab73a0df7cb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 395, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.187', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:24:03Z', 'updated_at': '2021-05-20T04:24:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_interfaces': [{'id': 'a97d355e-c698-41a6-8ed6-aaec93b83e2a', 'name': '', 'network_id': 'e31171ff-f097-446e-b691-bef7aad2fb3b', 'tenant_id': 'a1319e4a0fc74f98ba4bb88d8a04086b', 'mac_address': 'fa:16:3e:8e:5a:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '093b6879-26f9-4912-a2fc-dab73a0df7cb', 'device_owner': 'network:router_interface', 'standard_attr_id': 401, 'fixed_ips': [{'subnet_id': '410f59de-055d-4298-96bf-5d9a7712368d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:24:11Z', 'updated_at': '2021-05-20T04:24:21Z', 'revision_number': 5, 'project_id': 'a1319e4a0fc74f98ba4bb88d8a04086b', 'subnets': [{'id': '410f59de-055d-4298-96bf-5d9a7712368d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:31:41.442066 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1d77e365-89de-4ccd-af56-a5a98a36dcf3 None None] The sync data for ids ['093b6879-26f9-4912-a2fc-dab73a0df7cb'] in dv-cinder-790910-4-iscsi is: [{'id': '093b6879-26f9-4912-a2fc-dab73a0df7cb', 'name': 'tempest-TestShelveInstance-1799598596-router', 'tenant_id': 'a1319e4a0fc74f98ba4bb88d8a04086b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.187'}], 'enable_snat': True}, 'gw_port_id': '283f3ebf-83f3-4e30-ae78-4ec7e8841e26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:24:02Z', 'updated_at': '2021-05-20T04:24:12Z', 'revision_number': 4, 'project_id': 'a1319e4a0fc74f98ba4bb88d8a04086b', 'gw_port': {'id': '283f3ebf-83f3-4e30-ae78-4ec7e8841e26', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:d2:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '093b6879-26f9-4912-a2fc-dab73a0df7cb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 395, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.187', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:24:03Z', 'updated_at': '2021-05-20T04:24:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_interfaces': [{'id': 'a97d355e-c698-41a6-8ed6-aaec93b83e2a', 'name': '', 'network_id': 'e31171ff-f097-446e-b691-bef7aad2fb3b', 'tenant_id': 'a1319e4a0fc74f98ba4bb88d8a04086b', 'mac_address': 'fa:16:3e:8e:5a:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '093b6879-26f9-4912-a2fc-dab73a0df7cb', 'device_owner': 'network:router_interface', 'standard_attr_id': 401, 'fixed_ips': [{'subnet_id': '410f59de-055d-4298-96bf-5d9a7712368d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:24:11Z', 'updated_at': '2021-05-20T04:24:21Z', 'revision_number': 5, 'project_id': 'a1319e4a0fc74f98ba4bb88d8a04086b', 'subnets': [{'id': '410f59de-055d-4298-96bf-5d9a7712368d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91688) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 04:31:41.660856 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-16eab1e5-63f5-4f97-a53c-a6e734eb1b04 None None] New status for floating IP e653a34a-b881-4576-9118-d5b4aa3d0533: DOWN {{(pid=91689) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 20 04:31:41.934334 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3c0bb69-a0a1-4b8a-997b-613dc9e44296 req-ff10ec6e-3c73-4bdf-9dda-9af02a812edd tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:41.937580 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-d3c0bb69-a0a1-4b8a-997b-613dc9e44296 req-ff10ec6e-3c73-4bdf-9dda-9af02a812edd tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 944 time: 0.0971849
May 20 04:31:42.031501 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-d3c0bb69-a0a1-4b8a-997b-613dc9e44296 req-4e87b9c5-bfbe-4983-a1d8-9be0f8edfea8 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=35bf24dc-8716-4edf-9f4f-f9d97739d7ef&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0721667
May 20 04:31:42.124765 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1508c20c-bfd1-40bf-8014-f34e69fddf05 req-63d8afae-4b9f-4e59-90a9-f1ebe2b5388d tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:42.126289 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-1508c20c-bfd1-40bf-8014-f34e69fddf05 req-63d8afae-4b9f-4e59-90a9-f1ebe2b5388d tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 946 time: 0.0820277
May 20 04:31:42.170934 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-1508c20c-bfd1-40bf-8014-f34e69fddf05 req-f3eaaff3-3986-44f3-9ac5-2d8e381103df tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/security-groups?id=34e473fa-df05-422b-9abc-99aed131bade&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0389359
May 20 04:31:42.208935 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4140593e-d187-4399-a25c-e217698d7bd6 req-22cd66cc-c6fd-46f3-9681-6bb3a4b2107f tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:42.210406 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4140593e-d187-4399-a25c-e217698d7bd6 req-22cd66cc-c6fd-46f3-9681-6bb3a4b2107f tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/ports?device_id=9e9ac66e-ff2b-4295-8476-471c42fe11a5 HTTP/1.1" status: 200  len: 946 time: 0.0791900
May 20 04:31:42.255126 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4140593e-d187-4399-a25c-e217698d7bd6 req-03960a2a-0fc1-4d8f-a20a-96952e34b67b tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/security-groups?id=ef28d688-789b-4282-a30c-d7d731615fbf&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0389323
May 20 04:31:42.884147 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a34cf287-3429-4146-bed0-4a9bcb4a140f req-c98e0e36-959a-4b6f-8a3e-344bac94e7cf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:42.885728 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a34cf287-3429-4146-bed0-4a9bcb4a140f req-c98e0e36-959a-4b6f-8a3e-344bac94e7cf service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=a1319e4a0fc74f98ba4bb88d8a04086b&device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 1099 time: 0.1381953
May 20 04:31:42.982918 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f896b035-fe2a-410f-92b4-bec7f224c505 req-91a250ae-cfb5-4dde-b60d-84532265780d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:42.984365 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-f896b035-fe2a-410f-92b4-bec7f224c505 req-91a250ae-cfb5-4dde-b60d-84532265780d service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=ef3bec4745b14484ac8e21cd16cbd11d&device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 1097 time: 0.1647468
May 20 04:31:43.215731 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a34cf287-3429-4146-bed0-4a9bcb4a140f req-fbd1dd00-5e3a-463e-90a3-896e80ba8e70 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:43.217185 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a34cf287-3429-4146-bed0-4a9bcb4a140f req-fbd1dd00-5e3a-463e-90a3-896e80ba8e70 service neutron] 10.222.0.82 "GET /v2.0/networks?id=e31171ff-f097-446e-b691-bef7aad2fb3b HTTP/1.1" status: 200  len: 910 time: 0.3234370
May 20 04:31:43.254693 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2481ef69-730f-429c-a611-eaeec730e646 req-545a7143-905f-46c2-9960-4fa00edc733c tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:43.256214 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-2481ef69-730f-429c-a611-eaeec730e646 req-545a7143-905f-46c2-9960-4fa00edc733c tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 944 time: 0.1042504
May 20 04:31:43.307458 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-2481ef69-730f-429c-a611-eaeec730e646 req-fd761324-2677-4096-9d0a-a77568d08711 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=35bf24dc-8716-4edf-9f4f-f9d97739d7ef&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0405543
May 20 04:31:43.329343 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a34cf287-3429-4146-bed0-4a9bcb4a140f req-bcce7f86-f169-474e-ae67-a1390e72301f service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=9c846663-c90b-41d4-a8d1-1086882ba27e HTTP/1.1" status: 200  len: 217 time: 0.0977218
May 20 04:31:43.418020 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f896b035-fe2a-410f-92b4-bec7f224c505 req-58805a02-9fa5-47a3-8efc-33d58e51be62 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:43.419438 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-f896b035-fe2a-410f-92b4-bec7f224c505 req-58805a02-9fa5-47a3-8efc-33d58e51be62 service neutron] 10.222.0.82 "GET /v2.0/networks?id=21794e86-fda7-40a6-a5a8-db117c7eeb9d HTTP/1.1" status: 200  len: 918 time: 0.4115791
May 20 04:31:43.491002 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60ece451-649c-46d6-88c6-c9102f750f5b req-e4ccd108-e789-46d7-a523-5e799309f9c3 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:43.492527 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-60ece451-649c-46d6-88c6-c9102f750f5b req-e4ccd108-e789-46d7-a523-5e799309f9c3 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/ports?device_id=9e9ac66e-ff2b-4295-8476-471c42fe11a5 HTTP/1.1" status: 200  len: 946 time: 0.0850370
May 20 04:31:43.511067 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a34cf287-3429-4146-bed0-4a9bcb4a140f req-e78249eb-c29f-45ca-8cda-e6392f120570 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:43.512485 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a34cf287-3429-4146-bed0-4a9bcb4a140f req-e78249eb-c29f-45ca-8cda-e6392f120570 service neutron] 10.222.0.82 "GET /v2.0/subnets?id=410f59de-055d-4298-96bf-5d9a7712368d HTTP/1.1" status: 200  len: 848 time: 0.1710045
May 20 04:31:43.542676 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-60ece451-649c-46d6-88c6-c9102f750f5b req-a8974d66-8c21-427f-8124-39cafa12589e tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/security-groups?id=ef28d688-789b-4282-a30c-d7d731615fbf&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0438533
May 20 04:31:43.580376 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-f896b035-fe2a-410f-92b4-bec7f224c505 req-f3d4e46c-271a-4800-8feb-d1bf71632c90 service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=1cc416ab-7f60-449e-8b91-113111ff4aa3 HTTP/1.1" status: 200  len: 999 time: 0.1521437
May 20 04:31:43.590633 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd9d8d80-0636-42e1-9f53-00600b5ff520 req-efcf93aa-69a4-4793-98ae-f9282a82231c tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:43.592024 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-cd9d8d80-0636-42e1-9f53-00600b5ff520 req-efcf93aa-69a4-4793-98ae-f9282a82231c tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 946 time: 0.3085275
May 20 04:31:43.697471 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f896b035-fe2a-410f-92b4-bec7f224c505 req-f046549f-3885-4513-9699-9211bb956ea4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:43.698884 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-f896b035-fe2a-410f-92b4-bec7f224c505 req-f046549f-3885-4513-9699-9211bb956ea4 service neutron] 10.222.0.82 "GET /v2.0/subnets?id=06f38702-3d3c-4e25-8f84-85483d1ddf28 HTTP/1.1" status: 200  len: 856 time: 0.1060400
May 20 04:31:43.701585 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-cd9d8d80-0636-42e1-9f53-00600b5ff520 req-19aafd38-060a-4c91-9564-a6620048856e tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/security-groups?id=34e473fa-df05-422b-9abc-99aed131bade&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1025240
May 20 04:31:43.750048 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a34cf287-3429-4146-bed0-4a9bcb4a140f req-3efa7730-21d5-47f7-9fe0-48316ced1a0f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:43.751416 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a34cf287-3429-4146-bed0-4a9bcb4a140f req-3efa7730-21d5-47f7-9fe0-48316ced1a0f service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=e31171ff-f097-446e-b691-bef7aad2fb3b&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.2280200
May 20 04:31:43.880847 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f896b035-fe2a-410f-92b4-bec7f224c505 req-89a2bbf4-8b2a-407f-9090-8debb9098069 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:43.882747 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-f896b035-fe2a-410f-92b4-bec7f224c505 req-89a2bbf4-8b2a-407f-9090-8debb9098069 service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=21794e86-fda7-40a6-a5a8-db117c7eeb9d&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1755929
May 20 04:31:43.930938 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a34cf287-3429-4146-bed0-4a9bcb4a140f req-53aa1469-4a1d-43a7-a3d9-afa41ac3d82e service neutron] 10.222.0.82 "GET /v2.0/networks/e31171ff-f097-446e-b691-bef7aad2fb3b?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1708572
May 20 04:31:44.121891 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-f896b035-fe2a-410f-92b4-bec7f224c505 req-e99139db-c5cb-43a1-aa80-ac71d720995d service neutron] 10.222.0.82 "GET /v2.0/networks/21794e86-fda7-40a6-a5a8-db117c7eeb9d?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2277639
May 20 04:31:44.170691 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a34cf287-3429-4146-bed0-4a9bcb4a140f req-b697cd14-702c-4452-8083-c709bb8978a2 service neutron] 10.222.0.82 "GET /v2.0/networks/e31171ff-f097-446e-b691-bef7aad2fb3b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1925180
May 20 04:31:44.265882 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-f896b035-fe2a-410f-92b4-bec7f224c505 req-31a256a6-9688-4067-a9bc-2b2bccc50694 service neutron] 10.222.0.82 "GET /v2.0/networks/21794e86-fda7-40a6-a5a8-db117c7eeb9d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1304083
May 20 04:31:44.506928 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09470625-b2f5-43e2-8231-e60fc2b3b867 req-f291be0c-421f-461d-9484-9fc04f25afa8 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:44.508394 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-09470625-b2f5-43e2-8231-e60fc2b3b867 req-f291be0c-421f-461d-9484-9fc04f25afa8 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 944 time: 0.0884101
May 20 04:31:44.555182 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-09470625-b2f5-43e2-8231-e60fc2b3b867 req-353be1d0-c5c4-45b0-b796-c3f86965dff7 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=35bf24dc-8716-4edf-9f4f-f9d97739d7ef&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0407152
May 20 04:31:44.565966 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0de99675-100f-459f-b832-7c2c6ff8c810 req-6df40a0e-7e3c-4df5-b5b2-beefffea7f8d tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:44.567473 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-0de99675-100f-459f-b832-7c2c6ff8c810 req-6df40a0e-7e3c-4df5-b5b2-beefffea7f8d tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.82 "GET /v2.0/ports?device_id=9e9ac66e-ff2b-4295-8476-471c42fe11a5 HTTP/1.1" status: 200  len: 946 time: 0.0863051
May 20 04:31:44.829381 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [req-0de99675-100f-459f-b832-7c2c6ff8c810 req-9dba5fc7-e8e0-4c5c-a026-2e7b8bc8848e tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Deleting port 836b04fc-7e58-43e4-b4c9-054e40658569 {{(pid=91687) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 04:31:44.829646 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-0de99675-100f-459f-b832-7c2c6ff8c810 req-9dba5fc7-e8e0-4c5c-a026-2e7b8bc8848e tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8782892520551'] for port, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:44.858311 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01c9d7b5-c183-45bc-8b10-029cbb3a1b37 req-2b9a9959-8274-4713-bdc4-1f8e8ad323a8 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:44.859784 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-01c9d7b5-c183-45bc-8b10-029cbb3a1b37 req-2b9a9959-8274-4713-bdc4-1f8e8ad323a8 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.82 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 946 time: 0.1507273
May 20 04:31:44.901451 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92d7ee60-f44d-468f-9574-2bf7465b5a47 req-fcde8f10-2ecf-4194-9c92-33f7babe5122 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:44.903410 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-92d7ee60-f44d-468f-9574-2bf7465b5a47 req-fcde8f10-2ecf-4194-9c92-33f7babe5122 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 946 time: 0.0895283
May 20 04:31:45.004211 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af5f3083-39a9-4439-ae43-1e0ff0e5bd70 req-6a5af1a3-3531-4f0e-89bd-6376ca99b20b tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:45.005700 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-af5f3083-39a9-4439-ae43-1e0ff0e5bd70 req-6a5af1a3-3531-4f0e-89bd-6376ca99b20b tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/ports?device_id=9e9ac66e-ff2b-4295-8476-471c42fe11a5 HTTP/1.1" status: 200  len: 946 time: 0.3435624
May 20 04:31:45.050591 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-92d7ee60-f44d-468f-9574-2bf7465b5a47 req-93ba74f9-133f-45a6-b8fc-145aa594d035 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/security-groups?id=34e473fa-df05-422b-9abc-99aed131bade&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1412511
May 20 04:31:45.221159 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-af5f3083-39a9-4439-ae43-1e0ff0e5bd70 req-fe46d8de-6f43-424c-af92-7f96703298f8 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/security-groups?id=ef28d688-789b-4282-a30c-d7d731615fbf&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1812534
May 20 04:31:45.242008 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [req-0de99675-100f-459f-b832-7c2c6ff8c810 req-9dba5fc7-e8e0-4c5c-a026-2e7b8bc8848e tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] For port 836b04fc-7e58-43e4-b4c9-054e40658569, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=836b04fc-7e58-43e4-b4c9-054e40658569,segment=NetworkSegment(e9f32492-7a41-4dc9-bc94-b8bce4a8e65d),segment_id=e9f32492-7a41-4dc9-bc94-b8bce4a8e65d)] {{(pid=91687) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:31:45.242371 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-0de99675-100f-459f-b832-7c2c6ff8c810 req-9dba5fc7-e8e0-4c5c-a026-2e7b8bc8848e tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1718922'] for port, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:45.415554 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [req-01c9d7b5-c183-45bc-8b10-029cbb3a1b37 req-02629ec5-a470-43bb-9233-79f0d711a4fa tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Deleting port 9c846663-c90b-41d4-a8d1-1086882ba27e {{(pid=91687) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 04:31:45.415862 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-01c9d7b5-c183-45bc-8b10-029cbb3a1b37 req-02629ec5-a470-43bb-9233-79f0d711a4fa tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8782892520551'] for port, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:45.645100 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-0de99675-100f-459f-b832-7c2c6ff8c810 req-9dba5fc7-e8e0-4c5c-a026-2e7b8bc8848e tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks [] for floatingip, precommit_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:45.645460 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-0de99675-100f-459f-b832-7c2c6ff8c810 req-9dba5fc7-e8e0-4c5c-a026-2e7b8bc8848e tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1716406'] for floatingip, after_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:45.645770 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.db.l3_db [req-0de99675-100f-459f-b832-7c2c6ff8c810 req-9dba5fc7-e8e0-4c5c-a026-2e7b8bc8848e tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Floating IP b7dc02ef-f6f6-4ccf-a40c-5f698f78e6e5 disassociated. External IP: 172.27.1.94, port: 836b04fc-7e58-43e4-b4c9-054e40658569.
May 20 04:31:45.646112 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [req-0de99675-100f-459f-b832-7c2c6ff8c810 req-9dba5fc7-e8e0-4c5c-a026-2e7b8bc8848e tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Calling delete_port for 836b04fc-7e58-43e4-b4c9-054e40658569 owned by compute:nova {{(pid=91687) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 04:31:45.654328 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [req-01c9d7b5-c183-45bc-8b10-029cbb3a1b37 req-02629ec5-a470-43bb-9233-79f0d711a4fa tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] For port 9c846663-c90b-41d4-a8d1-1086882ba27e, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=9c846663-c90b-41d4-a8d1-1086882ba27e,segment=NetworkSegment(e5874c72-d111-4955-a5aa-fbad5f078a34),segment_id=e5874c72-d111-4955-a5aa-fbad5f078a34)] {{(pid=91687) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:31:45.654680 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-01c9d7b5-c183-45bc-8b10-029cbb3a1b37 req-02629ec5-a470-43bb-9233-79f0d711a4fa tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1718922'] for port, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:45.747038 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a37ef85d-ff6f-466f-8aa9-5ceb9a661d8a req-f948b689-5504-4697-a30a-8830edb3d38c tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:45.748602 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-a37ef85d-ff6f-466f-8aa9-5ceb9a661d8a req-f948b689-5504-4697-a30a-8830edb3d38c tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 944 time: 0.0797086
May 20 04:31:45.779944 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [req-01c9d7b5-c183-45bc-8b10-029cbb3a1b37 req-02629ec5-a470-43bb-9233-79f0d711a4fa tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Calling delete_port for 9c846663-c90b-41d4-a8d1-1086882ba27e owned by compute:nova {{(pid=91687) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 04:31:45.797567 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-a37ef85d-ff6f-466f-8aa9-5ceb9a661d8a req-562755a4-beab-46a9-8b11-178454711143 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=35bf24dc-8716-4edf-9f4f-f9d97739d7ef&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0430918
May 20 04:31:45.949980 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-0de99675-100f-459f-b832-7c2c6ff8c810 req-9dba5fc7-e8e0-4c5c-a026-2e7b8bc8848e tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8782892522936', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8782892108804', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4162192'] for port, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:45.959278 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-34d40daa-7289-4965-8f90-fdde9b6f3d56 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:31:46.018896 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dba5fc7-e8e0-4c5c-a026-2e7b8bc8848e tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Pushing event deleted for resources: {'Port': ['ID=836b04fc-7e58-43e4-b4c9-054e40658569,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:31:46.025200 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-9dba5fc7-e8e0-4c5c-a026-2e7b8bc8848e tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.066s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:31:46.101311 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 1cc416ab-7f60-449e-8b91-113111ff4aa3 details requested by agent hyperv_hv-cinder-79091 with host hv-cinder-79091 {{(pid=91688) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 20 04:31:46.109171 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-01c9d7b5-c183-45bc-8b10-029cbb3a1b37 req-02629ec5-a470-43bb-9233-79f0d711a4fa tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8782892522936', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8782892108804', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4162192'] for port, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:46.116063 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-1aab6326-7f06-4478-a24a-f3f670e7f8a9 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:31:46.166515 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02629ec5-a470-43bb-9233-79f0d711a4fa tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Pushing event deleted for resources: {'Port': ['ID=9c846663-c90b-41d4-a8d1-1086882ba27e,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:31:46.172164 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-02629ec5-a470-43bb-9233-79f0d711a4fa tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:31:46.244513 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port 1cc416ab-7f60-449e-8b91-113111ff4aa3, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=1cc416ab-7f60-449e-8b91-113111ff4aa3,segment=NetworkSegment(9521f383-6017-4b4d-9f47-cff4ed54cb57),segment_id=9521f383-6017-4b4d-9f47-cff4ed54cb57)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:31:46.259409 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Returning: {'device': '1cc416ab-7f60-449e-8b91-113111ff4aa3', 'network_id': '21794e86-fda7-40a6-a5a8-db117c7eeb9d', 'port_id': '1cc416ab-7f60-449e-8b91-113111ff4aa3', 'mac_address': 'fa:16:3e:76:fe:24', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 864, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '06f38702-3d3c-4e25-8f84-85483d1ddf28', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91688) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 20 04:31:46.318826 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:46.336369 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.notifiers.nova [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 1cc416ab-7f60-449e-8b91-113111ff4aa3 {{(pid=91688) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 04:31:46.357715 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port 1cc416ab-7f60-449e-8b91-113111ff4aa3, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=1cc416ab-7f60-449e-8b91-113111ff4aa3,segment=NetworkSegment(9521f383-6017-4b4d-9f47-cff4ed54cb57),segment_id=9521f383-6017-4b4d-9f47-cff4ed54cb57)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:31:46.365227 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:46.368041 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:31:46.379815 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-86a5b410-e8dc-44cc-935a-2e49e724e137 req-4a97b836-f509-4c68-8d98-9005781864a2 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/ports?device_id=9e9ac66e-ff2b-4295-8476-471c42fe11a5 HTTP/1.1" status: 200  len: 210 time: 0.0497470
May 20 04:31:46.447462 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Pushing event updated for resources: {'Port': ['ID=1cc416ab-7f60-449e-8b91-113111ff4aa3,revision_number=9']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:31:46.453913 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:31:46.485015 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-67cc30bd-0b81-4dc1-b9e4-c49b49c5c78b req-f53fbc4d-80d8-4af7-905f-37566094947f tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "GET /v2.0/ports?device_id=940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18 HTTP/1.1" status: 200  len: 210 time: 0.2314918
May 20 04:31:46.485917 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.l3_dvrscheduler_db [req-01c9d7b5-c183-45bc-8b10-029cbb3a1b37 req-02629ec5-a470-43bb-9233-79f0d711a4fa tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] No DVR routers for this DVR port 9c846663-c90b-41d4-a8d1-1086882ba27e on host hv-cinder-79091 {{(pid=91687) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 04:31:46.490156 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-01c9d7b5-c183-45bc-8b10-029cbb3a1b37 req-02629ec5-a470-43bb-9233-79f0d711a4fa tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for port, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:46.492822 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18', 'name': 'network-vif-deleted', 'tag': '9c846663-c90b-41d4-a8d1-1086882ba27e'}] {{(pid=91687) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:31:46.524173 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.l3_agent_scheduler [req-0de99675-100f-459f-b832-7c2c6ff8c810 req-9dba5fc7-e8e0-4c5c-a026-2e7b8bc8848e tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Router a7f66c4d-6b4f-4053-bd69-e1bea7db4c61 has already been hosted by L3 agent 02733fc0-fc9c-4e29-bc03-c27a792d539d {{(pid=91687) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 04:31:46.525899 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-01c9d7b5-c183-45bc-8b10-029cbb3a1b37 req-02629ec5-a470-43bb-9233-79f0d711a4fa tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.82 "DELETE /v2.0/ports/9c846663-c90b-41d4-a8d1-1086882ba27e HTTP/1.1" status: 204  len: 173 time: 1.5330210
May 20 04:31:46.611552 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '940a5b7a-c9a3-4ee7-bb00-aeb0999a7e18', 'name': 'network-vif-deleted', 'tag': '9c846663-c90b-41d4-a8d1-1086882ba27e', 'status': 'completed', 'code': 200}
May 20 04:31:46.700615 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] get_ports_and_sgs() called for port_ids ['1cc416ab-7f60-449e-8b91-113111ff4aa3'] {{(pid=91688) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 04:31:46.729882 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-0de99675-100f-459f-b832-7c2c6ff8c810 req-9dba5fc7-e8e0-4c5c-a026-2e7b8bc8848e tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify agent at l3_agent.dv-cinder-790910-4-iscsi the message routers_updated {{(pid=91687) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 04:31:46.740216 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-006a3f4a-5847-4fb8-ac69-bc65256ae780 None None] Sync routers for ids ['a7f66c4d-6b4f-4053-bd69-e1bea7db4c61'] in dv-cinder-790910-4-iscsi {{(pid=91688) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 04:31:46.764683 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-006a3f4a-5847-4fb8-ac69-bc65256ae780 None None] Routers {'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91688) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:31:46.765418 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-006a3f4a-5847-4fb8-ac69-bc65256ae780 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced0c202e0>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:31:33Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['a7f66c4d-6b4f-4053-bd69-e1bea7db4c61'], 'active': True} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:31:46.807063 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.l3_dvrscheduler_db [req-0de99675-100f-459f-b832-7c2c6ff8c810 req-9dba5fc7-e8e0-4c5c-a026-2e7b8bc8848e tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] No DVR routers for this DVR port 836b04fc-7e58-43e4-b4c9-054e40658569 on host hv-cinder-79091 {{(pid=91687) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 04:31:46.809656 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-0de99675-100f-459f-b832-7c2c6ff8c810 req-9dba5fc7-e8e0-4c5c-a026-2e7b8bc8848e tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for port, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:46.811673 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-0de99675-100f-459f-b832-7c2c6ff8c810 req-9dba5fc7-e8e0-4c5c-a026-2e7b8bc8848e tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.82 "DELETE /v2.0/ports/836b04fc-7e58-43e4-b4c9-054e40658569 HTTP/1.1" status: 204  len: 173 time: 2.2374496
May 20 04:31:46.999251 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c43b9ef-a6a2-4dd6-a757-597de920b708 req-e16462a0-9836-45f0-bb1b-ce245a0fb931 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:47.007394 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-8c43b9ef-a6a2-4dd6-a757-597de920b708 req-e16462a0-9836-45f0-bb1b-ce245a0fb931 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 945 time: 0.0908928
May 20 04:31:47.029654 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvr_db [None req-006a3f4a-5847-4fb8-ac69-bc65256ae780 None None] Set router a7f66c4d-6b4f-4053-bd69-e1bea7db4c61 gateway port host: dv-cinder-790910-4-iscsi {{(pid=91688) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:31:47.055221 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-8c43b9ef-a6a2-4dd6-a757-597de920b708 req-c8fd23f9-d94a-4c04-aad3-27227ba052c9 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=35bf24dc-8716-4edf-9f4f-f9d97739d7ef&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0469253
May 20 04:31:47.394458 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-006a3f4a-5847-4fb8-ac69-bc65256ae780 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced0c202e0>, [{'id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'name': 'tempest-TestVolumeBootPattern-857163320-router', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.91'}], 'enable_snat': True}, 'gw_port_id': '866cc6c0-5986-4eb4-8827-b255811a13de', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:28:09Z', 'updated_at': '2021-05-20T04:28:12Z', 'revision_number': 4, 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'gw_port': {'id': '866cc6c0-5986-4eb4-8827-b255811a13de', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:f5:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'device_owner': 'network:router_gateway', 'standard_attr_id': 511, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:28:09Z', 'updated_at': '2021-05-20T04:28:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_interfaces': [{'id': '0bcb5c14-319d-4871-bef1-50d60ad3f5b8', 'name': '', 'network_id': '11c994a8-6ede-4290-84f0-71af466860db', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'mac_address': 'fa:16:3e:2c:84:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'device_owner': 'network:router_interface', 'standard_attr_id': 512, 'fixed_ips': [{'subnet_id': '51af45f1-449a-400c-8714-8d713d4a7993', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:28:12Z', 'updated_at': '2021-05-20T04:28:19Z', 'revision_number': 5, 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'subnets': [{'id': '51af45f1-449a-400c-8714-8d713d4a7993', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:31:47.398718 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-006a3f4a-5847-4fb8-ac69-bc65256ae780 None None] Checking router: a7f66c4d-6b4f-4053-bd69-e1bea7db4c61 for host: dv-cinder-790910-4-iscsi {{(pid=91688) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 04:31:47.407908 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-006a3f4a-5847-4fb8-ac69-bc65256ae780 None None] Routers {'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91688) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:31:47.408855 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-006a3f4a-5847-4fb8-ac69-bc65256ae780 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced0c202e0>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:31:33Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['a7f66c4d-6b4f-4053-bd69-e1bea7db4c61'], 'active': True} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:31:47.571053 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-572a8725-a523-4af4-833e-db148a0de94f req-59376cca-ee29-48e0-83d7-efc0bacc0de8 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/ports?device_id=9e9ac66e-ff2b-4295-8476-471c42fe11a5 HTTP/1.1" status: 200  len: 210 time: 0.0554883
May 20 04:31:47.585266 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 45940) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:31:47.640797 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvr_db [None req-006a3f4a-5847-4fb8-ac69-bc65256ae780 None None] Set router a7f66c4d-6b4f-4053-bd69-e1bea7db4c61 gateway port host: dv-cinder-790910-4-iscsi {{(pid=91688) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:31:47.656720 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-6fdaa003-03c3-4274-9e62-d85fc629bc93 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Notify callbacks [] for security_group, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:47.690024 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-6fdaa003-03c3-4274-9e62-d85fc629bc93 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Notify callbacks [] for security_group, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:47.765732 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-6fdaa003-03c3-4274-9e62-d85fc629bc93 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:47.769783 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-8624a336-4855-44d8-af52-5c86c9c835e4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:31:47.785759 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6fdaa003-03c3-4274-9e62-d85fc629bc93 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=34e473fa-df05-422b-9abc-99aed131bade,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:31:47.790349 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-6fdaa003-03c3-4274-9e62-d85fc629bc93 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:31:47.803351 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-6fdaa003-03c3-4274-9e62-d85fc629bc93 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Notify callbacks [] for security_group, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:47.805001 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-6fdaa003-03c3-4274-9e62-d85fc629bc93 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] 10.222.0.71 "DELETE /v2.0/security-groups/34e473fa-df05-422b-9abc-99aed131bade HTTP/1.1" status: 204  len: 168 time: 0.2180979
May 20 04:31:47.857581 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 45946) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:31:47.981078 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-006a3f4a-5847-4fb8-ac69-bc65256ae780 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced0c202e0>, [{'id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'name': 'tempest-TestVolumeBootPattern-857163320-router', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.91'}], 'enable_snat': True}, 'gw_port_id': '866cc6c0-5986-4eb4-8827-b255811a13de', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:28:09Z', 'updated_at': '2021-05-20T04:28:12Z', 'revision_number': 4, 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'gw_port': {'id': '866cc6c0-5986-4eb4-8827-b255811a13de', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:f5:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'device_owner': 'network:router_gateway', 'standard_attr_id': 511, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:28:09Z', 'updated_at': '2021-05-20T04:28:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_interfaces': [{'id': '0bcb5c14-319d-4871-bef1-50d60ad3f5b8', 'name': '', 'network_id': '11c994a8-6ede-4290-84f0-71af466860db', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'mac_address': 'fa:16:3e:2c:84:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'device_owner': 'network:router_interface', 'standard_attr_id': 512, 'fixed_ips': [{'subnet_id': '51af45f1-449a-400c-8714-8d713d4a7993', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:28:12Z', 'updated_at': '2021-05-20T04:28:19Z', 'revision_number': 5, 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'subnets': [{'id': '51af45f1-449a-400c-8714-8d713d4a7993', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:31:47.985111 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-006a3f4a-5847-4fb8-ac69-bc65256ae780 None None] The sync data for ids ['a7f66c4d-6b4f-4053-bd69-e1bea7db4c61'] in dv-cinder-790910-4-iscsi is: [{'id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'name': 'tempest-TestVolumeBootPattern-857163320-router', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.91'}], 'enable_snat': True}, 'gw_port_id': '866cc6c0-5986-4eb4-8827-b255811a13de', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:28:09Z', 'updated_at': '2021-05-20T04:28:12Z', 'revision_number': 4, 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'gw_port': {'id': '866cc6c0-5986-4eb4-8827-b255811a13de', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:f5:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'device_owner': 'network:router_gateway', 'standard_attr_id': 511, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:28:09Z', 'updated_at': '2021-05-20T04:28:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_interfaces': [{'id': '0bcb5c14-319d-4871-bef1-50d60ad3f5b8', 'name': '', 'network_id': '11c994a8-6ede-4290-84f0-71af466860db', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'mac_address': 'fa:16:3e:2c:84:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'device_owner': 'network:router_interface', 'standard_attr_id': 512, 'fixed_ips': [{'subnet_id': '51af45f1-449a-400c-8714-8d713d4a7993', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:28:12Z', 'updated_at': '2021-05-20T04:28:19Z', 'revision_number': 5, 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'subnets': [{'id': '51af45f1-449a-400c-8714-8d713d4a7993', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91688) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 04:31:48.101247 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 1cc416ab-7f60-449e-8b91-113111ff4aa3 up at agent hyperv_hv-cinder-79091 {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:31:48.177336 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Provisioning complete for port 1cc416ab-7f60-449e-8b91-113111ff4aa3 triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:31:48.177865 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:48.229620 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-550177f3-95bc-4e24-b099-38a2c3a1af91 None None] New status for floating IP b7dc02ef-f6f6-4ccf-a40c-5f698f78e6e5: DOWN {{(pid=91689) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 20 04:31:48.303363 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:48.330844 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7925b833-d836-40d7-81b2-48717d6da34b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1cc416ab-7f60-449e-8b91-113111ff4aa3'}] {{(pid=91688) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:31:48.341071 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port 1cc416ab-7f60-449e-8b91-113111ff4aa3, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=1cc416ab-7f60-449e-8b91-113111ff4aa3,segment=NetworkSegment(9521f383-6017-4b4d-9f47-cff4ed54cb57),segment_id=9521f383-6017-4b4d-9f47-cff4ed54cb57)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:31:48.347874 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:48.349497 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 836b04fc-7e58-43e4-b4c9-054e40658569 no longer exists at agent hyperv_hv-cinder-79091 {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 04:31:48.381618 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:31:48.404406 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bb0d60d-5096-47aa-88f9-28c526f03fc5 req-967e69e6-00d4-4d04-82df-7260237fba16 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:48.405951 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-7bb0d60d-5096-47aa-88f9-28c526f03fc5 req-967e69e6-00d4-4d04-82df-7260237fba16 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 945 time: 0.1898704
May 20 04:31:48.434138 dv-cinder-790910-4-iscsi neutron-server[91688]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7925b833-d836-40d7-81b2-48717d6da34b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1cc416ab-7f60-449e-8b91-113111ff4aa3', 'code': 200}
May 20 04:31:48.447142 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] No Port match for: 836b04fc-7e58-43e4-b4c9-054e40658569 {{(pid=91688) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 04:31:48.447503 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 836b04fc-7e58-43e4-b4c9-054e40658569 not bound to the agent host hv-cinder-79091 {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 04:31:48.447998 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 9c846663-c90b-41d4-a8d1-1086882ba27e no longer exists at agent hyperv_hv-cinder-79091 {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 04:31:48.488548 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] No Port match for: 9c846663-c90b-41d4-a8d1-1086882ba27e {{(pid=91688) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 04:31:48.488548 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 9c846663-c90b-41d4-a8d1-1086882ba27e not bound to the agent host hv-cinder-79091 {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 04:31:48.502151 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Pushing event updated for resources: {'Port': ['ID=1cc416ab-7f60-449e-8b91-113111ff4aa3,revision_number=10']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:31:48.505360 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:31:48.541168 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-7bb0d60d-5096-47aa-88f9-28c526f03fc5 req-41ccd748-e64f-4801-8f68-31efb7396963 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=35bf24dc-8716-4edf-9f4f-f9d97739d7ef&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1025455
May 20 04:31:48.629825 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9e9ac66e-ff2b-4295-8476-471c42fe11a5', 'name': 'network-vif-deleted', 'tag': '836b04fc-7e58-43e4-b4c9-054e40658569'}] {{(pid=91687) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:31:48.655112 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-c03d6a14-43d4-4576-834a-3ba191ef8e73 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1716300'] for router_interface, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:48.681546 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f6066ff-ef64-4396-b0ab-b85820b59c5f req-47398c8a-85e0-4e28-ba67-b318f357abc5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:48.683063 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-1f6066ff-ef64-4396-b0ab-b85820b59c5f req-47398c8a-85e0-4e28-ba67-b318f357abc5 service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 1100 time: 0.0953989
May 20 04:31:48.684656 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9e9ac66e-ff2b-4295-8476-471c42fe11a5', 'name': 'network-vif-deleted', 'tag': '836b04fc-7e58-43e4-b4c9-054e40658569', 'status': 'completed', 'code': 200}
May 20 04:31:48.725516 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-1f6066ff-ef64-4396-b0ab-b85820b59c5f req-23a44771-d886-4e2e-8794-cb7509cac023 service neutron] 10.222.0.82 "GET /v2.0/security-groups?id=35bf24dc-8716-4edf-9f4f-f9d97739d7ef&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0359762
May 20 04:31:48.970814 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-83221d64-2209-4c63-ba67-4a3b45a78bba req-32af1a46-87be-487b-81ac-ac6bd09c68a5 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1603607005&fields=id&tenant_id=9b6fb271a7a546a38b0c6df5beaf22fc HTTP/1.1" status: 200  len: 267 time: 0.0581396
May 20 04:31:49.315355 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83221d64-2209-4c63-ba67-4a3b45a78bba req-fbbf1d97-7922-4fd8-a3c0-5a4027e607cc tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:49.316783 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-83221d64-2209-4c63-ba67-4a3b45a78bba req-fbbf1d97-7922-4fd8-a3c0-5a4027e607cc tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/networks?id=11c994a8-6ede-4290-84f0-71af466860db HTTP/1.1" status: 200  len: 811 time: 0.3372278
May 20 04:31:49.336374 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-83221d64-2209-4c63-ba67-4a3b45a78bba req-335b5cbd-cc6e-4943-a73a-cf40f6339dfb tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/quotas/9b6fb271a7a546a38b0c6df5beaf22fc HTTP/1.1" status: 200  len: 375 time: 0.0123646
May 20 04:31:49.397424 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.plugin [None req-c03d6a14-43d4-4576-834a-3ba191ef8e73 admin admin] Deleting port a97d355e-c698-41a6-8ed6-aaec93b83e2a {{(pid=91686) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 04:31:49.397715 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-c03d6a14-43d4-4576-834a-3ba191ef8e73 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8782892520551'] for port, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:49.526742 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-83221d64-2209-4c63-ba67-4a3b45a78bba req-0dcafb65-b4e4-4514-b11d-5f5b363a8ce7 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/ports?tenant_id=9b6fb271a7a546a38b0c6df5beaf22fc&fields=id HTTP/1.1" status: 200  len: 348 time: 0.1844425
May 20 04:31:49.536629 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.db [None req-c03d6a14-43d4-4576-834a-3ba191ef8e73 admin admin] For port a97d355e-c698-41a6-8ed6-aaec93b83e2a, host dv-cinder-790910-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=a97d355e-c698-41a6-8ed6-aaec93b83e2a,segment=NetworkSegment(e5874c72-d111-4955-a5aa-fbad5f078a34),segment_id=e5874c72-d111-4955-a5aa-fbad5f078a34)] {{(pid=91686) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:31:49.536974 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-c03d6a14-43d4-4576-834a-3ba191ef8e73 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1718922'] for port, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:49.551322 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [req-83221d64-2209-4c63-ba67-4a3b45a78bba req-a9c28f4b-c45c-422c-9fde-0965050f5826 service neutron] http://10.222.0.71:9696/v2.0/extensions returned with HTTP 200 {{(pid=91686) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 20 04:31:49.552247 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-83221d64-2209-4c63-ba67-4a3b45a78bba req-a9c28f4b-c45c-422c-9fde-0965050f5826 service neutron] 10.222.0.71 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0080488
May 20 04:31:49.688024 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.plugin [None req-c03d6a14-43d4-4576-834a-3ba191ef8e73 admin admin] Calling delete_port for a97d355e-c698-41a6-8ed6-aaec93b83e2a owned by network:router_interface {{(pid=91686) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 04:31:49.737383 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c6dc5ad-9d77-41b2-9810-ff45653f211a req-b5192546-e6b9-4689-9905-1cf3e7a8951e tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:49.739806 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-5c6dc5ad-9d77-41b2-9810-ff45653f211a req-b5192546-e6b9-4689-9905-1cf3e7a8951e tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 947 time: 0.0853503
May 20 04:31:49.792061 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-5c6dc5ad-9d77-41b2-9810-ff45653f211a req-93279e40-ab08-4b8d-a6d8-64a55dca0250 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=35bf24dc-8716-4edf-9f4f-f9d97739d7ef&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0452740
May 20 04:31:49.816168 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-83221d64-2209-4c63-ba67-4a3b45a78bba req-5df34c92-f5f4-4aa3-90c8-179bb742b18e service neutron] 10.222.0.71 "GET /v2.0/networks/11c994a8-6ede-4290-84f0-71af466860db?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2096686
May 20 04:31:49.982934 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-83221d64-2209-4c63-ba67-4a3b45a78bba req-3d3c1091-b4d3-490c-9020-b340b3893eea service neutron] 10.222.0.71 "GET /v2.0/networks/11c994a8-6ede-4290-84f0-71af466860db?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1527936
May 20 04:31:50.066375 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-c03d6a14-43d4-4576-834a-3ba191ef8e73 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8782892522936', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8782892108804', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2145052'] for port, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:50.070945 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-db3e56b1-3fb2-4c33-911d-32c38ad6aee8 tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:31:50.123375 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c03d6a14-43d4-4576-834a-3ba191ef8e73 admin admin] Pushing event deleted for resources: {'Port': ['ID=a97d355e-c698-41a6-8ed6-aaec93b83e2a,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:31:50.172717 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c03d6a14-43d4-4576-834a-3ba191ef8e73 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:31:50.173137 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c03d6a14-43d4-4576-834a-3ba191ef8e73 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:31:50.173660 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c03d6a14-43d4-4576-834a-3ba191ef8e73 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:31:50.174026 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c03d6a14-43d4-4576-834a-3ba191ef8e73 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:31:50.174386 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c03d6a14-43d4-4576-834a-3ba191ef8e73 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:31:50.174734 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c03d6a14-43d4-4576-834a-3ba191ef8e73 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:31:50.175091 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c03d6a14-43d4-4576-834a-3ba191ef8e73 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:31:50.175441 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c03d6a14-43d4-4576-834a-3ba191ef8e73 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:31:50.175791 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c03d6a14-43d4-4576-834a-3ba191ef8e73 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:31:50.176138 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c03d6a14-43d4-4576-834a-3ba191ef8e73 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:31:50.176479 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c03d6a14-43d4-4576-834a-3ba191ef8e73 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:31:50.176829 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c03d6a14-43d4-4576-834a-3ba191ef8e73 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:31:50.218482 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-c03d6a14-43d4-4576-834a-3ba191ef8e73 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.148s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:31:50.444855 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-c03d6a14-43d4-4576-834a-3ba191ef8e73 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1781439', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1717212'] for router_interface, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:50.451995 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-1e0cc9b2-4538-43f4-92f6-40360df97c3c req-c6687760-f5b9-4df3-8efe-a3db03105117 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Synchronizing usage tracker for tenant:9b6fb271a7a546a38b0c6df5beaf22fc on resource:port {{(pid=91687) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:31:50.473733 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-1e0cc9b2-4538-43f4-92f6-40360df97c3c req-c6687760-f5b9-4df3-8efe-a3db03105117 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Unset dirty status for tenant:9b6fb271a7a546a38b0c6df5beaf22fc on resource:port {{(pid=91687) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:31:50.474894 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-1e0cc9b2-4538-43f4-92f6-40360df97c3c req-c6687760-f5b9-4df3-8efe-a3db03105117 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/ports?device_id=de26e049-9f19-44e7-93d5-64ccd77cb9de HTTP/1.1" status: 200  len: 210 time: 0.0690036
May 20 04:31:51.004441 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c03d6a14-43d4-4576-834a-3ba191ef8e73 admin admin] Router 093b6879-26f9-4912-a2fc-dab73a0df7cb has already been hosted by L3 agent 02733fc0-fc9c-4e29-bc03-c27a792d539d {{(pid=91686) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 04:31:51.110291 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01ddbf5b-5e1b-4a65-82fc-8dbd3450a166 req-eaa8ad4d-a327-41c8-95be-46791462d6e3 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:51.111768 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-01ddbf5b-5e1b-4a65-82fc-8dbd3450a166 req-eaa8ad4d-a327-41c8-95be-46791462d6e3 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 947 time: 0.1932750
May 20 04:31:51.231319 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-01ddbf5b-5e1b-4a65-82fc-8dbd3450a166 req-f2a20a19-ab76-44b6-ad69-a519e5d53cbc tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=35bf24dc-8716-4edf-9f4f-f9d97739d7ef&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1113508
May 20 04:31:51.236496 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c03d6a14-43d4-4576-834a-3ba191ef8e73 admin admin] Notify agent at l3_agent.dv-cinder-790910-4-iscsi the message routers_updated {{(pid=91686) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 04:31:51.245690 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7ae67733-ac7d-4e0c-84d4-58c443e6403e None None] Sync routers for ids ['093b6879-26f9-4912-a2fc-dab73a0df7cb'] in dv-cinder-790910-4-iscsi {{(pid=91688) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 04:31:51.253534 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-c03d6a14-43d4-4576-834a-3ba191ef8e73 admin admin] 10.222.0.71 "PUT /v2.0/routers/093b6879-26f9-4912-a2fc-dab73a0df7cb/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 3.3925898
May 20 04:31:51.253781 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 46020) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:31:51.257551 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7ae67733-ac7d-4e0c-84d4-58c443e6403e None None] Routers {'093b6879-26f9-4912-a2fc-dab73a0df7cb'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91688) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:31:51.258171 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-7ae67733-ac7d-4e0c-84d4-58c443e6403e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced0c1e910>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:31:33Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['093b6879-26f9-4912-a2fc-dab73a0df7cb'], 'active': True} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:31:51.445236 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-8a6eda26-857d-4fc9-bf5f-4166221f4b70 admin admin] Notify callbacks [] for router, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:51.453419 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvr_db [None req-7ae67733-ac7d-4e0c-84d4-58c443e6403e None None] Set router 093b6879-26f9-4912-a2fc-dab73a0df7cb gateway port host: dv-cinder-790910-4-iscsi {{(pid=91688) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:31:51.553390 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83221d64-2209-4c63-ba67-4a3b45a78bba req-fa521a78-bba1-4747-94aa-095d73886715 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:51.555168 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-83221d64-2209-4c63-ba67-4a3b45a78bba req-fa521a78-bba1-4747-94aa-095d73886715 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.82 "GET /v2.0/networks?id=11c994a8-6ede-4290-84f0-71af466860db HTTP/1.1" status: 200  len: 811 time: 0.1740692
May 20 04:31:51.609261 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-83221d64-2209-4c63-ba67-4a3b45a78bba req-641c33b9-3a78-48e5-941c-96a7e6d40dbe tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.82 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=9b6fb271a7a546a38b0c6df5beaf22fc HTTP/1.1" status: 200  len: 380 time: 0.0451925
May 20 04:31:51.652991 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [req-83221d64-2209-4c63-ba67-4a3b45a78bba req-0b8e37e8-97f6-4ced-999a-664f441c2751 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Request body: {'port': {'device_id': 'de26e049-9f19-44e7-93d5-64ccd77cb9de', 'network_id': '11c994a8-6ede-4290-84f0-71af466860db', 'admin_state_up': True, 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'security_groups': ['ef28d688-789b-4282-a30c-d7d731615fbf']}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:31:51.680088 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-8a6eda26-857d-4fc9-bf5f-4166221f4b70 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:51.698848 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-7c742eeb-46e2-451a-bb1f-c89625bab911 req-fab6cdd3-8f5d-427d-827a-22bd7a478084 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/ports?device_id=de26e049-9f19-44e7-93d5-64ccd77cb9de HTTP/1.1" status: 200  len: 210 time: 0.0879507
May 20 04:31:51.785013 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-7ae67733-ac7d-4e0c-84d4-58c443e6403e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced0c1e910>, [{'id': '093b6879-26f9-4912-a2fc-dab73a0df7cb', 'name': 'tempest-TestShelveInstance-1799598596-router', 'tenant_id': 'a1319e4a0fc74f98ba4bb88d8a04086b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.187'}], 'enable_snat': True}, 'gw_port_id': '283f3ebf-83f3-4e30-ae78-4ec7e8841e26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:24:02Z', 'updated_at': '2021-05-20T04:31:49Z', 'revision_number': 5, 'project_id': 'a1319e4a0fc74f98ba4bb88d8a04086b', 'gw_port': {'id': '283f3ebf-83f3-4e30-ae78-4ec7e8841e26', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:d2:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '093b6879-26f9-4912-a2fc-dab73a0df7cb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 395, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.187', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:24:03Z', 'updated_at': '2021-05-20T04:24:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi'}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:31:51.791545 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7ae67733-ac7d-4e0c-84d4-58c443e6403e None None] Checking router: 093b6879-26f9-4912-a2fc-dab73a0df7cb for host: dv-cinder-790910-4-iscsi {{(pid=91688) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 04:31:51.796824 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.plugin [None req-8a6eda26-857d-4fc9-bf5f-4166221f4b70 admin admin] Deleting port 283f3ebf-83f3-4e30-ae78-4ec7e8841e26 {{(pid=91686) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 04:31:51.797219 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-8a6eda26-857d-4fc9-bf5f-4166221f4b70 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8782892520551'] for port, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:51.804332 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7ae67733-ac7d-4e0c-84d4-58c443e6403e None None] Routers {'093b6879-26f9-4912-a2fc-dab73a0df7cb'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91688) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:31:51.804948 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-7ae67733-ac7d-4e0c-84d4-58c443e6403e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced0c1e910>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:31:33Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['093b6879-26f9-4912-a2fc-dab73a0df7cb'], 'active': True} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:31:51.828978 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [req-83221d64-2209-4c63-ba67-4a3b45a78bba req-0b8e37e8-97f6-4ced-999a-664f441c2751 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:31:51.840521 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [req-83221d64-2209-4c63-ba67-4a3b45a78bba req-0b8e37e8-97f6-4ced-999a-664f441c2751 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:31:51.851176 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-83221d64-2209-4c63-ba67-4a3b45a78bba req-0b8e37e8-97f6-4ced-999a-664f441c2751 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Made reservation on behalf of 9b6fb271a7a546a38b0c6df5beaf22fc for: {'port': 1} {{(pid=91687) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 04:31:51.855883 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-83221d64-2209-4c63-ba67-4a3b45a78bba req-0b8e37e8-97f6-4ced-999a-664f441c2751 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:51.932121 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.db [None req-8a6eda26-857d-4fc9-bf5f-4166221f4b70 admin admin] For port 283f3ebf-83f3-4e30-ae78-4ec7e8841e26, host dv-cinder-790910-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=283f3ebf-83f3-4e30-ae78-4ec7e8841e26,segment=NetworkSegment(8df49ec5-3fb9-4715-bc9a-f4019a6b55f9),segment_id=8df49ec5-3fb9-4715-bc9a-f4019a6b55f9)] {{(pid=91686) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:31:51.932477 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-8a6eda26-857d-4fc9-bf5f-4166221f4b70 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1718922'] for port, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:52.012118 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvr_db [None req-7ae67733-ac7d-4e0c-84d4-58c443e6403e None None] Set router 093b6879-26f9-4912-a2fc-dab73a0df7cb gateway port host: None {{(pid=91688) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:31:52.037528 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.db_base_plugin_common [req-83221d64-2209-4c63-ba67-4a3b45a78bba req-0b8e37e8-97f6-4ced-999a-664f441c2751 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Allocated IP 172.20.0.13 (11c994a8-6ede-4290-84f0-71af466860db/51af45f1-449a-400c-8714-8d713d4a7993/b1bae5dc-7bbe-4c23-b60b-26cf817da0ee) {{(pid=91687) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 04:31:52.062955 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.plugin [None req-8a6eda26-857d-4fc9-bf5f-4166221f4b70 admin admin] Calling delete_port for 283f3ebf-83f3-4e30-ae78-4ec7e8841e26 owned by network:router_gateway {{(pid=91686) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 04:31:52.123263 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-7ae67733-ac7d-4e0c-84d4-58c443e6403e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced0c1e910>, [{'id': '093b6879-26f9-4912-a2fc-dab73a0df7cb', 'name': 'tempest-TestShelveInstance-1799598596-router', 'tenant_id': 'a1319e4a0fc74f98ba4bb88d8a04086b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:24:02Z', 'updated_at': '2021-05-20T04:31:51Z', 'revision_number': 6, 'project_id': 'a1319e4a0fc74f98ba4bb88d8a04086b', 'gw_port_host': None}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:31:52.128083 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7ae67733-ac7d-4e0c-84d4-58c443e6403e None None] The sync data for ids ['093b6879-26f9-4912-a2fc-dab73a0df7cb'] in dv-cinder-790910-4-iscsi is: [{'id': '093b6879-26f9-4912-a2fc-dab73a0df7cb', 'name': 'tempest-TestShelveInstance-1799598596-router', 'tenant_id': 'a1319e4a0fc74f98ba4bb88d8a04086b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:24:02Z', 'updated_at': '2021-05-20T04:31:51Z', 'revision_number': 6, 'project_id': 'a1319e4a0fc74f98ba4bb88d8a04086b', 'gw_port_host': None}] {{(pid=91688) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 04:31:52.237755 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-8a6eda26-857d-4fc9-bf5f-4166221f4b70 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8782892522936', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8782892108804', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2145052'] for port, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:52.242423 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-b152f7ce-d3c2-45db-9896-bf7e7a9a2806 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:31:52.280348 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-83221d64-2209-4c63-ba67-4a3b45a78bba req-0b8e37e8-97f6-4ced-999a-664f441c2751 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks [] for port, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:52.291219 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a6eda26-857d-4fc9-bf5f-4166221f4b70 admin admin] Pushing event deleted for resources: {'Port': ['ID=283f3ebf-83f3-4e30-ae78-4ec7e8841e26,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:31:52.294701 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-8a6eda26-857d-4fc9-bf5f-4166221f4b70 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:31:52.301610 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.provisioning_blocks [req-83221d64-2209-4c63-ba67-4a3b45a78bba req-0b8e37e8-97f6-4ced-999a-664f441c2751 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Transition to ACTIVE for port object b1bae5dc-7bbe-4c23-b60b-26cf817da0ee will not be triggered until provisioned by entity DHCP. {{(pid=91687) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:31:52.326663 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-83221d64-2209-4c63-ba67-4a3b45a78bba req-0b8e37e8-97f6-4ced-999a-664f441c2751 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8782892106231', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4162192'] for port, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:52.334233 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-b2684626-bf9a-4931-a4eb-b548dcaeb5d0 tempest-VolumesSnapshotTestJSON-1711994062 tempest-VolumesSnapshotTestJSON-1711994062-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:31:52.386512 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-8a6eda26-857d-4fc9-bf5f-4166221f4b70 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1714023'] for router_gateway, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:52.401578 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-83221d64-2209-4c63-ba67-4a3b45a78bba req-0b8e37e8-97f6-4ced-999a-664f441c2751 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Network 11c994a8-6ede-4290-84f0-71af466860db is already hosted by enough agents. {{(pid=91687) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:31:52.405238 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.base_scheduler [req-83221d64-2209-4c63-ba67-4a3b45a78bba req-0b8e37e8-97f6-4ced-999a-664f441c2751 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Resources bound (agent type, host, resource id):  {{(pid=91687) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:31:52.407926 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.l3_dvrscheduler_db [req-83221d64-2209-4c63-ba67-4a3b45a78bba req-0b8e37e8-97f6-4ced-999a-664f441c2751 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Received port after_create {{(pid=91687) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 04:31:52.451439 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b8e37e8-97f6-4ced-999a-664f441c2751 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Pushing event updated for resources: {'Port': ['ID=b1bae5dc-7bbe-4c23-b60b-26cf817da0ee,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:31:52.454722 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-0b8e37e8-97f6-4ced-999a-664f441c2751 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.121s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:31:52.487232 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83221d64-2209-4c63-ba67-4a3b45a78bba req-0b8e37e8-97f6-4ced-999a-664f441c2751 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:52.488338 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-83221d64-2209-4c63-ba67-4a3b45a78bba req-0b8e37e8-97f6-4ced-999a-664f441c2751 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for port, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:52.528343 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-83221d64-2209-4c63-ba67-4a3b45a78bba req-0b8e37e8-97f6-4ced-999a-664f441c2751 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 0.8847327
May 20 04:31:52.542684 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [req-83221d64-2209-4c63-ba67-4a3b45a78bba req-c98e48a5-10bf-4c18-b4ed-62242a953862 service neutron] Request body: {'port': {'device_id': 'de26e049-9f19-44e7-93d5-64ccd77cb9de', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79091'}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:31:52.628131 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-a4642c89-a60c-4c6b-8974-971f38e32312 None None] Provisioning for port b1bae5dc-7bbe-4c23-b60b-26cf817da0ee completed by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:31:52.634420 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-a4642c89-a60c-4c6b-8974-971f38e32312 None None] Provisioning complete for port b1bae5dc-7bbe-4c23-b60b-26cf817da0ee triggered by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:31:52.634981 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-a4642c89-a60c-4c6b-8974-971f38e32312 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:52.663867 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-83221d64-2209-4c63-ba67-4a3b45a78bba req-c98e48a5-10bf-4c18-b4ed-62242a953862 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:52.698190 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-a4642c89-a60c-4c6b-8974-971f38e32312 None None] Port b1bae5dc-7bbe-4c23-b60b-26cf817da0ee cannot update to ACTIVE because it is not bound. {{(pid=91688) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 20 04:31:52.699721 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-8a6eda26-857d-4fc9-bf5f-4166221f4b70 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1796572', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-6237'] for router, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:52.702037 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-8a6eda26-857d-4fc9-bf5f-4166221f4b70 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:52.727506 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-8a6eda26-857d-4fc9-bf5f-4166221f4b70 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-1712688'] for router, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:52.728158 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8a6eda26-857d-4fc9-bf5f-4166221f4b70 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 093b6879-26f9-4912-a2fc-dab73a0df7cb {{(pid=91686) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 20 04:31:52.745315 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-8a6eda26-857d-4fc9-bf5f-4166221f4b70 admin admin] Notify callbacks [] for router, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:52.748772 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-8a6eda26-857d-4fc9-bf5f-4166221f4b70 admin admin] 10.222.0.71 "DELETE /v2.0/routers/093b6879-26f9-4912-a2fc-dab73a0df7cb HTTP/1.1" status: 204  len: 168 time: 1.4918041
May 20 04:31:52.749041 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 46030) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:31:52.809547 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.db_base_plugin_v2 [None req-1725084c-1864-4869-8aee-94c2ab3b8635 admin admin] Deleting subnet 410f59de-055d-4298-96bf-5d9a7712368d {{(pid=91686) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 20 04:31:52.812554 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-1725084c-1864-4869-8aee-94c2ab3b8635 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:52.914454 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-1725084c-1864-4869-8aee-94c2ab3b8635 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4081462'] for subnet, precommit_delete_associations {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:53.004316 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d358bd9-749e-4f85-82a8-ef9d48e823e5 req-77849d13-f1b5-4120-8888-cb840a49f873 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:53.005848 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-4d358bd9-749e-4f85-82a8-ef9d48e823e5 req-77849d13-f1b5-4120-8888-cb840a49f873 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/ports?device_id=de26e049-9f19-44e7-93d5-64ccd77cb9de HTTP/1.1" status: 200  len: 932 time: 0.1677480
May 20 04:31:53.041463 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-1725084c-1864-4869-8aee-94c2ab3b8635 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1504133'] for subnet, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:53.104816 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-4d358bd9-749e-4f85-82a8-ef9d48e823e5 req-389c811f-06ea-4fb8-8dc8-c6bda6ed9819 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/security-groups?id=ef28d688-789b-4282-a30c-d7d731615fbf&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0926733
May 20 04:31:53.137356 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 283f3ebf-83f3-4e30-ae78-4ec7e8841e26 no longer exists at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 04:31:53.147316 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.notifiers.nova [req-83221d64-2209-4c63-ba67-4a3b45a78bba req-c98e48a5-10bf-4c18-b4ed-62242a953862 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b1bae5dc-7bbe-4c23-b60b-26cf817da0ee {{(pid=91687) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 04:31:53.155806 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-83221d64-2209-4c63-ba67-4a3b45a78bba req-c98e48a5-10bf-4c18-b4ed-62242a953862 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:53.171723 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.provisioning_blocks [req-83221d64-2209-4c63-ba67-4a3b45a78bba req-c98e48a5-10bf-4c18-b4ed-62242a953862 service neutron] Transition to ACTIVE for port object b1bae5dc-7bbe-4c23-b60b-26cf817da0ee will not be triggered until provisioned by entity L2. {{(pid=91687) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:31:53.176465 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] No Port match for: 283f3ebf-83f3-4e30-ae78-4ec7e8841e26 {{(pid=91688) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 04:31:53.176657 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-83221d64-2209-4c63-ba67-4a3b45a78bba req-c98e48a5-10bf-4c18-b4ed-62242a953862 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4162185'] for port, after_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:53.176856 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 283f3ebf-83f3-4e30-ae78-4ec7e8841e26 not bound to the agent host dv-cinder-790910-4-iscsi {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 04:31:53.177504 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device a97d355e-c698-41a6-8ed6-aaec93b83e2a no longer exists at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 04:31:53.181005 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-6131d811-cd30-44c5-9d04-3d1140f0ca21 tempest-AttachVolumeNegativeTest-6194955 tempest-AttachVolumeNegativeTest-6194955-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:31:53.210765 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] No Port match for: a97d355e-c698-41a6-8ed6-aaec93b83e2a {{(pid=91688) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 04:31:53.211146 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device a97d355e-c698-41a6-8ed6-aaec93b83e2a not bound to the agent host dv-cinder-790910-4-iscsi {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 04:31:53.363052 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-1725084c-1864-4869-8aee-94c2ab3b8635 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1504178', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-255887', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2114755', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2442237'] for subnet, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:53.367566 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-09444ff1-f071-45e4-8c60-edb3b6952cbb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:31:53.375433 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c98e48a5-10bf-4c18-b4ed-62242a953862 service neutron] Pushing event updated for resources: {'Port': ['ID=b1bae5dc-7bbe-4c23-b60b-26cf817da0ee,revision_number=2']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:31:53.382009 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-c98e48a5-10bf-4c18-b4ed-62242a953862 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.201s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:31:53.410280 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1725084c-1864-4869-8aee-94c2ab3b8635 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=410f59de-055d-4298-96bf-5d9a7712368d,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:31:53.413466 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-1725084c-1864-4869-8aee-94c2ab3b8635 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:31:53.416662 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-1725084c-1864-4869-8aee-94c2ab3b8635 admin admin] Notify callbacks [] for subnet, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:53.423991 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-abf46c38-061a-4e41-8352-84ce7fc2094b None None] Network e31171ff-f097-446e-b691-bef7aad2fb3b requested from dv-cinder-790910-4-iscsi {{(pid=91688) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 04:31:53.429903 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-1725084c-1864-4869-8aee-94c2ab3b8635 admin admin] 10.222.0.71 "DELETE /v2.0/subnets/410f59de-055d-4298-96bf-5d9a7712368d HTTP/1.1" status: 204  len: 168 time: 0.6794720
May 20 04:31:53.430561 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 46034) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:31:53.435461 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.managers [req-83221d64-2209-4c63-ba67-4a3b45a78bba req-c98e48a5-10bf-4c18-b4ed-62242a953862 service neutron] Attempting to bind port b1bae5dc-7bbe-4c23-b60b-26cf817da0ee on host hv-cinder-79091 for vnic_type normal with profile  {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 04:31:53.435903 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.managers [req-83221d64-2209-4c63-ba67-4a3b45a78bba req-c98e48a5-10bf-4c18-b4ed-62242a953862 service neutron] Attempting to bind port b1bae5dc-7bbe-4c23-b60b-26cf817da0ee by drivers openvswitch,hyperv on host hv-cinder-79091 at level 0 using segments [{'id': 'e9f32492-7a41-4dc9-bc94-b8bce4a8e65d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': '11c994a8-6ede-4290-84f0-71af466860db'}] {{(pid=91687) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 04:31:53.436475 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-83221d64-2209-4c63-ba67-4a3b45a78bba req-c98e48a5-10bf-4c18-b4ed-62242a953862 service neutron] Attempting to bind port b1bae5dc-7bbe-4c23-b60b-26cf817da0ee on network 11c994a8-6ede-4290-84f0-71af466860db {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:31:53.441684 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-83221d64-2209-4c63-ba67-4a3b45a78bba req-c98e48a5-10bf-4c18-b4ed-62242a953862 service neutron] Port b1bae5dc-7bbe-4c23-b60b-26cf817da0ee on network 11c994a8-6ede-4290-84f0-71af466860db not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79091 {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 20 04:31:53.442113 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-83221d64-2209-4c63-ba67-4a3b45a78bba req-c98e48a5-10bf-4c18-b4ed-62242a953862 service neutron] Attempting to bind port b1bae5dc-7bbe-4c23-b60b-26cf817da0ee on network 11c994a8-6ede-4290-84f0-71af466860db {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:31:53.447742 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-83221d64-2209-4c63-ba67-4a3b45a78bba req-c98e48a5-10bf-4c18-b4ed-62242a953862 service neutron] Checking agent: {'id': '7cc947fd-92eb-4d43-ad6b-ea002afff217', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79091', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 4, 19, 34), 'started_at': datetime.datetime(2021, 5, 20, 4, 19, 34), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 4, 31, 37), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 04:31:53.448187 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-83221d64-2209-4c63-ba67-4a3b45a78bba req-c98e48a5-10bf-4c18-b4ed-62242a953862 service neutron] Checking segment: {'id': 'e9f32492-7a41-4dc9-bc94-b8bce4a8e65d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': '11c994a8-6ede-4290-84f0-71af466860db'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91687) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:31:53.448699 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-83221d64-2209-4c63-ba67-4a3b45a78bba req-c98e48a5-10bf-4c18-b4ed-62242a953862 service neutron] Bound using segment: {'id': 'e9f32492-7a41-4dc9-bc94-b8bce4a8e65d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': '11c994a8-6ede-4290-84f0-71af466860db'} {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 04:31:53.449447 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.managers [req-83221d64-2209-4c63-ba67-4a3b45a78bba req-c98e48a5-10bf-4c18-b4ed-62242a953862 service neutron] Bound port: b1bae5dc-7bbe-4c23-b60b-26cf817da0ee, host: hv-cinder-79091, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'e9f32492-7a41-4dc9-bc94-b8bce4a8e65d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': '11c994a8-6ede-4290-84f0-71af466860db'}}] {{(pid=91687) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 04:31:53.449703 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-83221d64-2209-4c63-ba67-4a3b45a78bba req-c98e48a5-10bf-4c18-b4ed-62242a953862 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:53.542812 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [req-83221d64-2209-4c63-ba67-4a3b45a78bba req-c98e48a5-10bf-4c18-b4ed-62242a953862 service neutron] For port b1bae5dc-7bbe-4c23-b60b-26cf817da0ee, host hv-cinder-79091, cleared binding levels {{(pid=91687) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 04:31:53.545283 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-befb7892-ca65-4faf-a074-c726c92170ba admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-593149'] for network, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:53.545902 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [req-83221d64-2209-4c63-ba67-4a3b45a78bba req-c98e48a5-10bf-4c18-b4ed-62242a953862 service neutron] For port b1bae5dc-7bbe-4c23-b60b-26cf817da0ee, host hv-cinder-79091, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=b1bae5dc-7bbe-4c23-b60b-26cf817da0ee,segment=NetworkSegment(e9f32492-7a41-4dc9-bc94-b8bce4a8e65d),segment_id=e9f32492-7a41-4dc9-bc94-b8bce4a8e65d)] {{(pid=91687) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 04:31:53.552174 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-83221d64-2209-4c63-ba67-4a3b45a78bba req-c98e48a5-10bf-4c18-b4ed-62242a953862 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4162185'] for port, after_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:53.557543 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-3c70f0e8-8ed6-4fc4-9746-0153ff435fe4 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:31:53.617188 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83221d64-2209-4c63-ba67-4a3b45a78bba req-c98e48a5-10bf-4c18-b4ed-62242a953862 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:53.617808 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-83221d64-2209-4c63-ba67-4a3b45a78bba req-c98e48a5-10bf-4c18-b4ed-62242a953862 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for port, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:53.622090 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-83221d64-2209-4c63-ba67-4a3b45a78bba req-c98e48a5-10bf-4c18-b4ed-62242a953862 service neutron] 10.222.0.82 "PUT /v2.0/ports/b1bae5dc-7bbe-4c23-b60b-26cf817da0ee HTTP/1.1" status: 200  len: 1094 time: 1.0839813
May 20 04:31:53.622655 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'de26e049-9f19-44e7-93d5-64ccd77cb9de', 'tag': 'b1bae5dc-7bbe-4c23-b60b-26cf817da0ee'}] {{(pid=91687) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:31:53.631646 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.plugin [None req-befb7892-ca65-4faf-a074-c726c92170ba admin admin] Deleting port 2e3c2da6-ee6a-4206-a46f-a624e7511262 {{(pid=91686) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 04:31:53.631995 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-befb7892-ca65-4faf-a074-c726c92170ba admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8782892520551'] for port, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:53.670723 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c98e48a5-10bf-4c18-b4ed-62242a953862 service neutron] Pushing event updated for resources: {'Port': ['ID=b1bae5dc-7bbe-4c23-b60b-26cf817da0ee,revision_number=3']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:31:53.681052 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-c98e48a5-10bf-4c18-b4ed-62242a953862 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:31:53.682745 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'de26e049-9f19-44e7-93d5-64ccd77cb9de', 'tag': 'b1bae5dc-7bbe-4c23-b60b-26cf817da0ee', 'status': 'completed', 'code': 200}
May 20 04:31:53.746014 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-288dd821-fa65-4738-b29d-c7b2d97d372a None None] DHCP port deletion for e31171ff-f097-446e-b691-bef7aad2fb3b request from dv-cinder-790910-4-iscsi {{(pid=91688) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
May 20 04:31:53.752496 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.db [None req-befb7892-ca65-4faf-a074-c726c92170ba admin admin] For port 2e3c2da6-ee6a-4206-a46f-a624e7511262, host dv-cinder-790910-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=2e3c2da6-ee6a-4206-a46f-a624e7511262,segment=NetworkSegment(e5874c72-d111-4955-a5aa-fbad5f078a34),segment_id=e5874c72-d111-4955-a5aa-fbad5f078a34)] {{(pid=91686) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:31:53.752717 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-befb7892-ca65-4faf-a074-c726c92170ba admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1718922'] for port, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:53.781814 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83221d64-2209-4c63-ba67-4a3b45a78bba req-9840fd89-c61d-4309-9236-21849ce2ef65 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:53.783579 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-83221d64-2209-4c63-ba67-4a3b45a78bba req-9840fd89-c61d-4309-9236-21849ce2ef65 service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=9b6fb271a7a546a38b0c6df5beaf22fc&device_id=de26e049-9f19-44e7-93d5-64ccd77cb9de HTTP/1.1" status: 200  len: 1097 time: 0.0921621
May 20 04:31:53.830174 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-288dd821-fa65-4738-b29d-c7b2d97d372a None None] Deleting port 2e3c2da6-ee6a-4206-a46f-a624e7511262 {{(pid=91688) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 04:31:53.830732 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-288dd821-fa65-4738-b29d-c7b2d97d372a None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8782892520551'] for port, before_delete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:53.866880 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-83221d64-2209-4c63-ba67-4a3b45a78bba req-bc6745ff-ba71-4a34-8202-1426afb6cf81 service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=b1bae5dc-7bbe-4c23-b60b-26cf817da0ee HTTP/1.1" status: 200  len: 217 time: 0.0753505
May 20 04:31:53.883608 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.plugin [None req-befb7892-ca65-4faf-a074-c726c92170ba admin admin] Calling delete_port for 2e3c2da6-ee6a-4206-a46f-a624e7511262 owned by network:dhcp {{(pid=91686) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 04:31:53.933807 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-befb7892-ca65-4faf-a074-c726c92170ba admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8782892522936', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8782892108804', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2145052'] for port, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:53.934486 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83221d64-2209-4c63-ba67-4a3b45a78bba req-c59cb0fe-090a-463b-ae0a-80806bcb8852 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:53.936100 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-83221d64-2209-4c63-ba67-4a3b45a78bba req-c59cb0fe-090a-463b-ae0a-80806bcb8852 service neutron] 10.222.0.82 "GET /v2.0/subnets?id=51af45f1-449a-400c-8714-8d713d4a7993 HTTP/1.1" status: 200  len: 850 time: 0.0633919
May 20 04:31:53.939160 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-3649ebb2-347b-4cc6-9a5f-20f5b9d8e810 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:31:53.955647 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-288dd821-fa65-4738-b29d-c7b2d97d372a None None] For port 2e3c2da6-ee6a-4206-a46f-a624e7511262, host dv-cinder-790910-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=2e3c2da6-ee6a-4206-a46f-a624e7511262,segment=NetworkSegment(e5874c72-d111-4955-a5aa-fbad5f078a34),segment_id=e5874c72-d111-4955-a5aa-fbad5f078a34)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:31:53.956047 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-288dd821-fa65-4738-b29d-c7b2d97d372a None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1718922'] for port, precommit_delete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:53.985204 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.l3_dvrscheduler_db [None req-befb7892-ca65-4faf-a074-c726c92170ba admin admin] No DVR routers for this DVR port 2e3c2da6-ee6a-4206-a46f-a624e7511262 on host dv-cinder-790910-4-iscsi {{(pid=91686) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 04:31:54.013663 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83221d64-2209-4c63-ba67-4a3b45a78bba req-4b6cfef6-a94b-4a7e-a0ec-c3dadeb958ce service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:54.015182 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-83221d64-2209-4c63-ba67-4a3b45a78bba req-4b6cfef6-a94b-4a7e-a0ec-c3dadeb958ce service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=11c994a8-6ede-4290-84f0-71af466860db&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0717664
May 20 04:31:54.017006 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-befb7892-ca65-4faf-a074-c726c92170ba admin admin] Pushing event deleted for resources: {'Port': ['ID=2e3c2da6-ee6a-4206-a46f-a624e7511262,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:31:54.019993 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-befb7892-ca65-4faf-a074-c726c92170ba admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:31:54.078515 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-288dd821-fa65-4738-b29d-c7b2d97d372a None None] Calling delete_port for 2e3c2da6-ee6a-4206-a46f-a624e7511262 owned by network:dhcp {{(pid=91688) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 04:31:54.105507 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-befb7892-ca65-4faf-a074-c726c92170ba admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1505550', 'neutron.services.segments.db._delete_segments_for_network-8782892550274'] for network, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:54.119124 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.services.segments.db [None req-befb7892-ca65-4faf-a074-c726c92170ba admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fced10030a0>,) {'filters': {'network_id': ['e31171ff-f097-446e-b691-bef7aad2fb3b']}} {{(pid=91686) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:31:54.124809 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-288dd821-fa65-4738-b29d-c7b2d97d372a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8782892522936', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8782892108804'] for port, after_delete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:54.130777 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:31:54.132680 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.services.segments.db [None req-befb7892-ca65-4faf-a074-c726c92170ba admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fced10030a0>, 'e5874c72-d111-4955-a5aa-fbad5f078a34') {'for_net_delete': True} {{(pid=91686) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:31:54.134491 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.services.segments.db [None req-befb7892-ca65-4faf-a074-c726c92170ba admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fced10030a0>, 'e5874c72-d111-4955-a5aa-fbad5f078a34') {} {{(pid=91686) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:31:54.145371 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-befb7892-ca65-4faf-a074-c726c92170ba admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8782892560523', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4081441'] for segment, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:54.150164 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-83221d64-2209-4c63-ba67-4a3b45a78bba req-90c04323-21d2-4994-aa4c-23bf6c557a1a service neutron] 10.222.0.82 "GET /v2.0/networks/11c994a8-6ede-4290-84f0-71af466860db?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1278121
May 20 04:31:54.166979 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-befb7892-ca65-4faf-a074-c726c92170ba admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1501910'] for segment, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:54.176779 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-befb7892-ca65-4faf-a074-c726c92170ba admin admin] Releasing vlan 880 on physical network physnet1 to pool {{(pid=91686) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 20 04:31:54.177427 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-befb7892-ca65-4faf-a074-c726c92170ba admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1501910', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2145121'] for segment, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:54.179388 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-288dd821-fa65-4738-b29d-c7b2d97d372a None None] Pushing event deleted for resources: {'Port': ['ID=2e3c2da6-ee6a-4206-a46f-a624e7511262,revision_number=None']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:31:54.181398 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-288dd821-fa65-4738-b29d-c7b2d97d372a None None] No DVR routers for this DVR port 2e3c2da6-ee6a-4206-a46f-a624e7511262 on host dv-cinder-790910-4-iscsi {{(pid=91688) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 04:31:54.182621 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-288dd821-fa65-4738-b29d-c7b2d97d372a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:31:54.305464 dv-cinder-790910-4-iscsi neutron-server[91686]: Traceback (most recent call last):
May 20 04:31:54.305464 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 20 04:31:54.305464 dv-cinder-790910-4-iscsi neutron-server[91686]:     timer()
May 20 04:31:54.305464 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 20 04:31:54.305464 dv-cinder-790910-4-iscsi neutron-server[91686]:     cb(*args, **kw)
May 20 04:31:54.305464 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 20 04:31:54.305464 dv-cinder-790910-4-iscsi neutron-server[91686]:     return func(*args, **kwargs)
May 20 04:31:54.305464 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 20 04:31:54.305464 dv-cinder-790910-4-iscsi neutron-server[91686]:     self._notify()
May 20 04:31:54.305464 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 20 04:31:54.305464 dv-cinder-790910-4-iscsi neutron-server[91686]:     self.callback(batched_events)
May 20 04:31:54.305464 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 20 04:31:54.305464 dv-cinder-790910-4-iscsi neutron-server[91686]:     event.method(event)
May 20 04:31:54.305464 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 20 04:31:54.305464 dv-cinder-790910-4-iscsi neutron-server[91686]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 20 04:31:54.305464 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 20 04:31:54.305464 dv-cinder-790910-4-iscsi neutron-server[91686]:     aggregate_uuid = self.p_client.list_aggregates(
May 20 04:31:54.305464 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 20 04:31:54.305464 dv-cinder-790910-4-iscsi neutron-server[91686]:     return f(self, *a, **k)
May 20 04:31:54.305464 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 20 04:31:54.305464 dv-cinder-790910-4-iscsi neutron-server[91686]:     return self._get(url).json()
May 20 04:31:54.305464 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 20 04:31:54.305464 dv-cinder-790910-4-iscsi neutron-server[91686]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 20 04:31:54.305464 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 20 04:31:54.305464 dv-cinder-790910-4-iscsi neutron-server[91686]:     return self.request(url, 'GET', **kwargs)
May 20 04:31:54.305464 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 20 04:31:54.305464 dv-cinder-790910-4-iscsi neutron-server[91686]:     base_url = self.get_endpoint(auth, allow=allow,
May 20 04:31:54.305464 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 20 04:31:54.305464 dv-cinder-790910-4-iscsi neutron-server[91686]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 20 04:31:54.305464 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 20 04:31:54.305464 dv-cinder-790910-4-iscsi neutron-server[91686]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 20 04:31:54.305464 dv-cinder-790910-4-iscsi neutron-server[91686]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 20 04:31:54.312188 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-83221d64-2209-4c63-ba67-4a3b45a78bba req-2cee2d4f-858c-40f8-893b-f3f25499acb0 service neutron] 10.222.0.82 "GET /v2.0/networks/11c994a8-6ede-4290-84f0-71af466860db?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1547608
May 20 04:31:54.439681 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-befb7892-ca65-4faf-a074-c726c92170ba admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1505543', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1590664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1781430', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1713996'] for network, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:54.441435 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c1f30ed-4042-4798-98be-a9182a04949c req-ba38383c-1dae-41e1-8dc7-2beb82f5c672 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:54.442920 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-0c1f30ed-4042-4798-98be-a9182a04949c req-ba38383c-1dae-41e1-8dc7-2beb82f5c672 service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=9b6fb271a7a546a38b0c6df5beaf22fc&device_id=de26e049-9f19-44e7-93d5-64ccd77cb9de HTTP/1.1" status: 200  len: 1097 time: 0.0756531
May 20 04:31:54.447432 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-bd793b1c-3607-477d-9879-4fd0c2b5b734 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:31:54.463801 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-befb7892-ca65-4faf-a074-c726c92170ba admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for network, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:54.471270 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-befb7892-ca65-4faf-a074-c726c92170ba admin admin] Pushing event deleted for resources: {'Network': ['ID=e31171ff-f097-446e-b691-bef7aad2fb3b,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:31:54.476066 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-befb7892-ca65-4faf-a074-c726c92170ba admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:31:54.492676 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6bd4ca9-6d68-4390-848c-6a858a960207 req-75f4e653-eb96-4868-adcf-cc4b809a559d tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:54.494207 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-f6bd4ca9-6d68-4390-848c-6a858a960207 req-75f4e653-eb96-4868-adcf-cc4b809a559d tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/ports?device_id=de26e049-9f19-44e7-93d5-64ccd77cb9de HTTP/1.1" status: 200  len: 944 time: 0.1877973
May 20 04:31:54.505457 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-befb7892-ca65-4faf-a074-c726c92170ba admin admin] 10.222.0.71 "DELETE /v2.0/networks/e31171ff-f097-446e-b691-bef7aad2fb3b HTTP/1.1" status: 204  len: 168 time: 1.0695868
May 20 04:31:54.515090 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 46042) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:31:54.575785 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c1f30ed-4042-4798-98be-a9182a04949c req-3cb2f568-cbcd-49a2-8a68-4e7dbf951ad5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:54.577275 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-0c1f30ed-4042-4798-98be-a9182a04949c req-3cb2f568-cbcd-49a2-8a68-4e7dbf951ad5 service neutron] 10.222.0.82 "GET /v2.0/networks?id=11c994a8-6ede-4290-84f0-71af466860db HTTP/1.1" status: 200  len: 912 time: 0.1282876
May 20 04:31:54.621201 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-f6bd4ca9-6d68-4390-848c-6a858a960207 req-f641cbab-ea87-447a-8e16-021bbb287576 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/security-groups?id=ef28d688-789b-4282-a30c-d7d731615fbf&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1199517
May 20 04:31:54.647727 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-0c1f30ed-4042-4798-98be-a9182a04949c req-e7d0e520-58e3-4aa6-a58c-1ac20b4e2516 service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=b1bae5dc-7bbe-4c23-b60b-26cf817da0ee HTTP/1.1" status: 200  len: 217 time: 0.0628254
May 20 04:31:54.713282 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c1f30ed-4042-4798-98be-a9182a04949c req-e235ed35-f1f3-4440-b890-7f8abbea0749 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:54.714659 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-0c1f30ed-4042-4798-98be-a9182a04949c req-e235ed35-f1f3-4440-b890-7f8abbea0749 service neutron] 10.222.0.82 "GET /v2.0/subnets?id=51af45f1-449a-400c-8714-8d713d4a7993 HTTP/1.1" status: 200  len: 850 time: 0.0603576
May 20 04:31:54.791767 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c1f30ed-4042-4798-98be-a9182a04949c req-2ad622d9-a54e-4c6c-ba43-e31b98929d51 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:54.793285 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-0c1f30ed-4042-4798-98be-a9182a04949c req-2ad622d9-a54e-4c6c-ba43-e31b98929d51 service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=11c994a8-6ede-4290-84f0-71af466860db&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0709548
May 20 04:31:55.029963 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-0c1f30ed-4042-4798-98be-a9182a04949c req-cca5fb0b-faf0-4eea-aeab-4348bb18317d service neutron] 10.222.0.82 "GET /v2.0/networks/11c994a8-6ede-4290-84f0-71af466860db?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2292142
May 20 04:31:55.094554 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-daeb77f8-e2ec-4bd9-a2cc-d83f1ceaf958 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1716300'] for router_interface, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:55.098618 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 2e3c2da6-ee6a-4206-a46f-a624e7511262 no longer exists at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 04:31:55.132615 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] No Port match for: 2e3c2da6-ee6a-4206-a46f-a624e7511262 {{(pid=91688) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 04:31:55.133119 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 2e3c2da6-ee6a-4206-a46f-a624e7511262 not bound to the agent host dv-cinder-790910-4-iscsi {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 04:31:55.168326 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-0c1f30ed-4042-4798-98be-a9182a04949c req-10557068-8778-4c72-8ff1-84d86ee63d55 service neutron] 10.222.0.82 "GET /v2.0/networks/11c994a8-6ede-4290-84f0-71af466860db?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1316204
May 20 04:31:55.505468 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.plugin [None req-daeb77f8-e2ec-4bd9-a2cc-d83f1ceaf958 admin admin] Deleting port f3bb6458-7b30-451b-a7f3-5288f527e9cf {{(pid=91686) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 04:31:55.506096 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-daeb77f8-e2ec-4bd9-a2cc-d83f1ceaf958 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8782892520551'] for port, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:55.625681 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.db [None req-daeb77f8-e2ec-4bd9-a2cc-d83f1ceaf958 admin admin] For port f3bb6458-7b30-451b-a7f3-5288f527e9cf, host dv-cinder-790910-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=f3bb6458-7b30-451b-a7f3-5288f527e9cf,segment=NetworkSegment(7409db9e-5fb3-453d-b7d4-3cbc720cb9d4),segment_id=7409db9e-5fb3-453d-b7d4-3cbc720cb9d4)] {{(pid=91686) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:31:55.625973 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-daeb77f8-e2ec-4bd9-a2cc-d83f1ceaf958 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1718922'] for port, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:55.821682 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ba6f15b-60ce-42d8-991d-8fd29feb27e7 req-4df5d457-dc3d-4182-8e5e-ced5d09aaed8 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:55.822305 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-0ba6f15b-60ce-42d8-991d-8fd29feb27e7 req-4df5d457-dc3d-4182-8e5e-ced5d09aaed8 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Synchronizing usage tracker for tenant:9b6fb271a7a546a38b0c6df5beaf22fc on resource:port {{(pid=91687) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:31:55.838797 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-0ba6f15b-60ce-42d8-991d-8fd29feb27e7 req-4df5d457-dc3d-4182-8e5e-ced5d09aaed8 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Unset dirty status for tenant:9b6fb271a7a546a38b0c6df5beaf22fc on resource:port {{(pid=91687) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:31:55.839937 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-0ba6f15b-60ce-42d8-991d-8fd29feb27e7 req-4df5d457-dc3d-4182-8e5e-ced5d09aaed8 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/ports?device_id=de26e049-9f19-44e7-93d5-64ccd77cb9de HTTP/1.1" status: 200  len: 944 time: 0.1078246
May 20 04:31:55.866901 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.plugin [None req-daeb77f8-e2ec-4bd9-a2cc-d83f1ceaf958 admin admin] Calling delete_port for f3bb6458-7b30-451b-a7f3-5288f527e9cf owned by network:router_interface {{(pid=91686) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 04:31:55.888525 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-0ba6f15b-60ce-42d8-991d-8fd29feb27e7 req-3497e303-a0fb-438b-b4a0-25ea6e011a72 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/security-groups?id=ef28d688-789b-4282-a30c-d7d731615fbf&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0419190
May 20 04:31:56.033161 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-daeb77f8-e2ec-4bd9-a2cc-d83f1ceaf958 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8782892522936', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8782892108804', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2145052'] for port, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:56.040734 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-44b3366a-cabd-41a6-95ca-a39afcf09098 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:31:56.083446 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-daeb77f8-e2ec-4bd9-a2cc-d83f1ceaf958 admin admin] Pushing event deleted for resources: {'Port': ['ID=f3bb6458-7b30-451b-a7f3-5288f527e9cf,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:31:56.111844 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-daeb77f8-e2ec-4bd9-a2cc-d83f1ceaf958 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:31:56.347441 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-daeb77f8-e2ec-4bd9-a2cc-d83f1ceaf958 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1781439', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1717212'] for router_interface, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:56.714303 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-daeb77f8-e2ec-4bd9-a2cc-d83f1ceaf958 admin admin] Router 5de71c93-6369-4531-861a-910439b7d267 has already been hosted by L3 agent 02733fc0-fc9c-4e29-bc03-c27a792d539d {{(pid=91686) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 04:31:56.894473 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-daeb77f8-e2ec-4bd9-a2cc-d83f1ceaf958 admin admin] Notify agent at l3_agent.dv-cinder-790910-4-iscsi the message routers_updated {{(pid=91686) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 04:31:56.903701 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-29909853-5bd4-4758-a70d-a9103c49de7a None None] Sync routers for ids ['5de71c93-6369-4531-861a-910439b7d267'] in dv-cinder-790910-4-iscsi {{(pid=91689) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 04:31:56.914318 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-29909853-5bd4-4758-a70d-a9103c49de7a None None] Routers {'5de71c93-6369-4531-861a-910439b7d267'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91689) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:31:56.915104 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-daeb77f8-e2ec-4bd9-a2cc-d83f1ceaf958 admin admin] 10.222.0.71 "PUT /v2.0/routers/5de71c93-6369-4531-861a-910439b7d267/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.3990130
May 20 04:31:56.915807 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-29909853-5bd4-4758-a70d-a9103c49de7a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced15bcee0>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:31:33Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['5de71c93-6369-4531-861a-910439b7d267'], 'active': True} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:31:56.917733 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 46050) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:31:57.088727 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c2d9541-1ba0-4861-8aa7-fe5017a50ccb req-fdaea6e1-cba0-4fe6-9856-2b02e308705d tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:57.090471 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-2c2d9541-1ba0-4861-8aa7-fe5017a50ccb req-fdaea6e1-cba0-4fe6-9856-2b02e308705d tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/ports?device_id=de26e049-9f19-44e7-93d5-64ccd77cb9de HTTP/1.1" status: 200  len: 944 time: 0.0924091
May 20 04:31:57.109415 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-4daf2dd0-4335-420a-a06c-b92d1b30d319 admin admin] Notify callbacks [] for router, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:57.120343 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvr_db [None req-29909853-5bd4-4758-a70d-a9103c49de7a None None] Set router 5de71c93-6369-4531-861a-910439b7d267 gateway port host: dv-cinder-790910-4-iscsi {{(pid=91689) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:31:57.143270 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-2c2d9541-1ba0-4861-8aa7-fe5017a50ccb req-b3f34cf9-47a4-442c-b6e5-56832614eed5 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/security-groups?id=ef28d688-789b-4282-a30c-d7d731615fbf&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0461836
May 20 04:31:57.284717 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-4daf2dd0-4335-420a-a06c-b92d1b30d319 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:57.356149 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [None req-4daf2dd0-4335-420a-a06c-b92d1b30d319 admin admin] Deleting port 18fb2347-22cb-4478-9bc6-8008249183c5 {{(pid=91687) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 04:31:57.356389 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-4daf2dd0-4335-420a-a06c-b92d1b30d319 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8782892520551'] for port, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:57.398837 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-29909853-5bd4-4758-a70d-a9103c49de7a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced15bcee0>, [{'id': '5de71c93-6369-4531-861a-910439b7d267', 'name': 'tempest-TestShelveInstance-292307318-router', 'tenant_id': '4bcdcc410bb7407eb15e956f1cf3816f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.238'}], 'enable_snat': True}, 'gw_port_id': '18fb2347-22cb-4478-9bc6-8008249183c5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:24:16Z', 'updated_at': '2021-05-20T04:31:55Z', 'revision_number': 5, 'project_id': '4bcdcc410bb7407eb15e956f1cf3816f', 'gw_port': {'id': '18fb2347-22cb-4478-9bc6-8008249183c5', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:fb:ff:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5de71c93-6369-4531-861a-910439b7d267', 'device_owner': 'network:router_gateway', 'standard_attr_id': 413, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.238', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:24:17Z', 'updated_at': '2021-05-20T04:24:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi'}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:31:57.403135 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-29909853-5bd4-4758-a70d-a9103c49de7a None None] Checking router: 5de71c93-6369-4531-861a-910439b7d267 for host: dv-cinder-790910-4-iscsi {{(pid=91689) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 04:31:57.411510 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-29909853-5bd4-4758-a70d-a9103c49de7a None None] Routers {'5de71c93-6369-4531-861a-910439b7d267'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91689) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:31:57.412100 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-29909853-5bd4-4758-a70d-a9103c49de7a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced15bcee0>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:31:33Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['5de71c93-6369-4531-861a-910439b7d267'], 'active': True} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:31:57.475813 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [None req-4daf2dd0-4335-420a-a06c-b92d1b30d319 admin admin] For port 18fb2347-22cb-4478-9bc6-8008249183c5, host dv-cinder-790910-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=18fb2347-22cb-4478-9bc6-8008249183c5,segment=NetworkSegment(8df49ec5-3fb9-4715-bc9a-f4019a6b55f9),segment_id=8df49ec5-3fb9-4715-bc9a-f4019a6b55f9)] {{(pid=91687) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:31:57.476137 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-4daf2dd0-4335-420a-a06c-b92d1b30d319 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1718922'] for port, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:57.559359 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvr_db [None req-29909853-5bd4-4758-a70d-a9103c49de7a None None] Set router 5de71c93-6369-4531-861a-910439b7d267 gateway port host: None {{(pid=91689) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:31:57.598023 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [None req-4daf2dd0-4335-420a-a06c-b92d1b30d319 admin admin] Calling delete_port for 18fb2347-22cb-4478-9bc6-8008249183c5 owned by network:router_gateway {{(pid=91687) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 04:31:57.660181 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-29909853-5bd4-4758-a70d-a9103c49de7a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced15bcee0>, [{'id': '5de71c93-6369-4531-861a-910439b7d267', 'name': 'tempest-TestShelveInstance-292307318-router', 'tenant_id': '4bcdcc410bb7407eb15e956f1cf3816f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:24:16Z', 'updated_at': '2021-05-20T04:31:57Z', 'revision_number': 6, 'project_id': '4bcdcc410bb7407eb15e956f1cf3816f', 'gw_port_host': None}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:31:57.663915 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-29909853-5bd4-4758-a70d-a9103c49de7a None None] The sync data for ids ['5de71c93-6369-4531-861a-910439b7d267'] in dv-cinder-790910-4-iscsi is: [{'id': '5de71c93-6369-4531-861a-910439b7d267', 'name': 'tempest-TestShelveInstance-292307318-router', 'tenant_id': '4bcdcc410bb7407eb15e956f1cf3816f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:24:16Z', 'updated_at': '2021-05-20T04:31:57Z', 'revision_number': 6, 'project_id': '4bcdcc410bb7407eb15e956f1cf3816f', 'gw_port_host': None}] {{(pid=91689) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 04:31:57.739056 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-4daf2dd0-4335-420a-a06c-b92d1b30d319 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8782892522936', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8782892108804', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4162192'] for port, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:57.742795 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-0b8e37e8-97f6-4ced-999a-664f441c2751 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:31:57.785343 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4daf2dd0-4335-420a-a06c-b92d1b30d319 admin admin] Pushing event deleted for resources: {'Port': ['ID=18fb2347-22cb-4478-9bc6-8008249183c5,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:31:57.788431 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-4daf2dd0-4335-420a-a06c-b92d1b30d319 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:31:57.882521 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-4daf2dd0-4335-420a-a06c-b92d1b30d319 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1714023'] for router_gateway, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:57.956339 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.agents_db [None req-92d61f12-17bc-4bf9-9eab-8a69b8c6da2f None None] Agent healthcheck: found 6 active agents {{(pid=91689) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 04:31:58.165448 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-4daf2dd0-4335-420a-a06c-b92d1b30d319 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1796572', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-6237'] for router, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:58.167716 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-4daf2dd0-4335-420a-a06c-b92d1b30d319 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:58.196265 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-4daf2dd0-4335-420a-a06c-b92d1b30d319 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-1712688'] for router, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:58.196772 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4daf2dd0-4335-420a-a06c-b92d1b30d319 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 5de71c93-6369-4531-861a-910439b7d267 {{(pid=91687) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 20 04:31:58.209297 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-4daf2dd0-4335-420a-a06c-b92d1b30d319 admin admin] Notify callbacks [] for router, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:58.212748 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-4daf2dd0-4335-420a-a06c-b92d1b30d319 admin admin] 10.222.0.71 "DELETE /v2.0/routers/5de71c93-6369-4531-861a-910439b7d267 HTTP/1.1" status: 204  len: 168 time: 1.2916019
May 20 04:31:58.213080 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 46056) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:31:58.313485 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.db_base_plugin_v2 [None req-9a29bbf4-6c99-4a89-bb52-1b9f7c8efbd7 admin admin] Deleting subnet 7ed199e2-8424-415a-b375-501cfccc5d60 {{(pid=91687) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 20 04:31:58.323452 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-9a29bbf4-6c99-4a89-bb52-1b9f7c8efbd7 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:58.379123 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-9a29bbf4-6c99-4a89-bb52-1b9f7c8efbd7 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-936634'] for subnet, precommit_delete_associations {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:58.434669 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58ba3c82-95bf-4c1f-a253-15b602040544 req-1344f899-059f-442d-a821-4e1b5a0cb813 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:58.436142 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-58ba3c82-95bf-4c1f-a253-15b602040544 req-1344f899-059f-442d-a821-4e1b5a0cb813 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/ports?device_id=de26e049-9f19-44e7-93d5-64ccd77cb9de HTTP/1.1" status: 200  len: 944 time: 0.1767819
May 20 04:31:58.500745 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-58ba3c82-95bf-4c1f-a253-15b602040544 req-3dcf6547-d6d0-42c4-bb4e-b11917f74d11 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/security-groups?id=ef28d688-789b-4282-a30c-d7d731615fbf&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0577450
May 20 04:31:58.510588 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-9a29bbf4-6c99-4a89-bb52-1b9f7c8efbd7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1504133'] for subnet, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:58.776879 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-9a29bbf4-6c99-4a89-bb52-1b9f7c8efbd7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1504178', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-255887', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-4160847', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-692244'] for subnet, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:58.784140 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-e06623cb-0e10-4d48-8bae-e5b3415f28e6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:31:58.819814 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a29bbf4-6c99-4a89-bb52-1b9f7c8efbd7 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=7ed199e2-8424-415a-b375-501cfccc5d60,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:31:58.822807 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-9a29bbf4-6c99-4a89-bb52-1b9f7c8efbd7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:31:58.823725 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-9a29bbf4-6c99-4a89-bb52-1b9f7c8efbd7 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for subnet, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:58.829688 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1c2654cd-c1c0-4eb9-99d6-6eb2fa4b0308 None None] Network 4bb43617-e5b5-4e08-aa62-fcff79192e08 requested from dv-cinder-790910-4-iscsi {{(pid=91688) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 04:31:58.830192 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-9a29bbf4-6c99-4a89-bb52-1b9f7c8efbd7 admin admin] 10.222.0.71 "DELETE /v2.0/subnets/7ed199e2-8424-415a-b375-501cfccc5d60 HTTP/1.1" status: 204  len: 168 time: 0.6158633
May 20 04:31:58.832710 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 46060) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:31:58.939616 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-37fb79a0-c2be-4ce0-b4c9-12d4a9c755ec admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-593149'] for network, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:59.013840 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.plugin [None req-37fb79a0-c2be-4ce0-b4c9-12d4a9c755ec admin admin] Deleting port 65fa81fb-51bd-4b50-b2a8-68d472455252 {{(pid=91686) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 04:31:59.014166 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-37fb79a0-c2be-4ce0-b4c9-12d4a9c755ec admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8782892520551'] for port, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:59.078475 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-65794c0e-7ad1-47f5-98b6-5287a957af80 None None] DHCP port deletion for 4bb43617-e5b5-4e08-aa62-fcff79192e08 request from dv-cinder-790910-4-iscsi {{(pid=91688) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
May 20 04:31:59.132904 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 18fb2347-22cb-4478-9bc6-8008249183c5 no longer exists at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 04:31:59.170065 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] No Port match for: 18fb2347-22cb-4478-9bc6-8008249183c5 {{(pid=91688) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 04:31:59.170420 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 18fb2347-22cb-4478-9bc6-8008249183c5 not bound to the agent host dv-cinder-790910-4-iscsi {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 04:31:59.170849 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device f3bb6458-7b30-451b-a7f3-5288f527e9cf no longer exists at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 04:31:59.235219 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.db [None req-37fb79a0-c2be-4ce0-b4c9-12d4a9c755ec admin admin] For port 65fa81fb-51bd-4b50-b2a8-68d472455252, host dv-cinder-790910-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=65fa81fb-51bd-4b50-b2a8-68d472455252,segment=NetworkSegment(7409db9e-5fb3-453d-b7d4-3cbc720cb9d4),segment_id=7409db9e-5fb3-453d-b7d4-3cbc720cb9d4)] {{(pid=91686) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:31:59.235533 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-37fb79a0-c2be-4ce0-b4c9-12d4a9c755ec admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1718922'] for port, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:59.246246 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] No Port match for: f3bb6458-7b30-451b-a7f3-5288f527e9cf {{(pid=91688) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 04:31:59.246602 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device f3bb6458-7b30-451b-a7f3-5288f527e9cf not bound to the agent host dv-cinder-790910-4-iscsi {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 04:31:59.256379 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-65794c0e-7ad1-47f5-98b6-5287a957af80 None None] Deleting port 65fa81fb-51bd-4b50-b2a8-68d472455252 {{(pid=91688) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 04:31:59.256760 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-65794c0e-7ad1-47f5-98b6-5287a957af80 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8782892520551'] for port, before_delete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:59.352012 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-65794c0e-7ad1-47f5-98b6-5287a957af80 None None] For port 65fa81fb-51bd-4b50-b2a8-68d472455252, host dv-cinder-790910-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=65fa81fb-51bd-4b50-b2a8-68d472455252,segment=NetworkSegment(7409db9e-5fb3-453d-b7d4-3cbc720cb9d4),segment_id=7409db9e-5fb3-453d-b7d4-3cbc720cb9d4)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:31:59.352280 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-65794c0e-7ad1-47f5-98b6-5287a957af80 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1718922'] for port, precommit_delete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:59.359787 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.plugin [None req-37fb79a0-c2be-4ce0-b4c9-12d4a9c755ec admin admin] Calling delete_port for 65fa81fb-51bd-4b50-b2a8-68d472455252 owned by network:dhcp {{(pid=91686) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 04:31:59.413926 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-37fb79a0-c2be-4ce0-b4c9-12d4a9c755ec admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8782892522936', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8782892108804', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2145052'] for port, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:59.418789 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-4cb15e24-a9a3-4fe7-98cf-6a9376806fd2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:31:59.462054 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37fb79a0-c2be-4ce0-b4c9-12d4a9c755ec admin admin] Pushing event deleted for resources: {'Port': ['ID=65fa81fb-51bd-4b50-b2a8-68d472455252,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:31:59.463808 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.l3_dvrscheduler_db [None req-37fb79a0-c2be-4ce0-b4c9-12d4a9c755ec admin admin] No DVR routers for this DVR port 65fa81fb-51bd-4b50-b2a8-68d472455252 on host dv-cinder-790910-4-iscsi {{(pid=91686) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 04:31:59.465304 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-37fb79a0-c2be-4ce0-b4c9-12d4a9c755ec admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:31:59.475833 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-65794c0e-7ad1-47f5-98b6-5287a957af80 None None] Calling delete_port for 65fa81fb-51bd-4b50-b2a8-68d472455252 owned by network:dhcp {{(pid=91688) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 04:31:59.519475 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-65794c0e-7ad1-47f5-98b6-5287a957af80 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8782892522936', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8782892108804'] for port, after_delete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:59.523148 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:31:59.567639 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65794c0e-7ad1-47f5-98b6-5287a957af80 None None] Pushing event deleted for resources: {'Port': ['ID=65fa81fb-51bd-4b50-b2a8-68d472455252,revision_number=None']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:31:59.569485 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-65794c0e-7ad1-47f5-98b6-5287a957af80 None None] No DVR routers for this DVR port 65fa81fb-51bd-4b50-b2a8-68d472455252 on host dv-cinder-790910-4-iscsi {{(pid=91688) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 04:31:59.570843 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-65794c0e-7ad1-47f5-98b6-5287a957af80 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:31:59.579914 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-37fb79a0-c2be-4ce0-b4c9-12d4a9c755ec admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1505550', 'neutron.services.segments.db._delete_segments_for_network-8782892550274'] for network, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:59.593883 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.services.segments.db [None req-37fb79a0-c2be-4ce0-b4c9-12d4a9c755ec admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fced0782190>,) {'filters': {'network_id': ['4bb43617-e5b5-4e08-aa62-fcff79192e08']}} {{(pid=91686) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:31:59.606263 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.services.segments.db [None req-37fb79a0-c2be-4ce0-b4c9-12d4a9c755ec admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fced0782190>, '7409db9e-5fb3-453d-b7d4-3cbc720cb9d4') {'for_net_delete': True} {{(pid=91686) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:31:59.606472 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.services.segments.db [None req-37fb79a0-c2be-4ce0-b4c9-12d4a9c755ec admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fced0782190>, '7409db9e-5fb3-453d-b7d4-3cbc720cb9d4') {} {{(pid=91686) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:31:59.656088 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-37fb79a0-c2be-4ce0-b4c9-12d4a9c755ec admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8782892560523', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4081441'] for segment, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:59.680722 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-37fb79a0-c2be-4ce0-b4c9-12d4a9c755ec admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1501910'] for segment, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:59.690342 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-37fb79a0-c2be-4ce0-b4c9-12d4a9c755ec admin admin] Releasing vlan 863 on physical network physnet1 to pool {{(pid=91686) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 20 04:31:59.690627 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-37fb79a0-c2be-4ce0-b4c9-12d4a9c755ec admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1501910', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2145121'] for segment, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:59.703545 dv-cinder-790910-4-iscsi neutron-server[91686]: Traceback (most recent call last):
May 20 04:31:59.703545 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 20 04:31:59.703545 dv-cinder-790910-4-iscsi neutron-server[91686]:     timer()
May 20 04:31:59.703545 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 20 04:31:59.703545 dv-cinder-790910-4-iscsi neutron-server[91686]:     cb(*args, **kw)
May 20 04:31:59.703545 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 20 04:31:59.703545 dv-cinder-790910-4-iscsi neutron-server[91686]:     return func(*args, **kwargs)
May 20 04:31:59.703545 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 20 04:31:59.703545 dv-cinder-790910-4-iscsi neutron-server[91686]:     self._notify()
May 20 04:31:59.703545 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 20 04:31:59.703545 dv-cinder-790910-4-iscsi neutron-server[91686]:     self.callback(batched_events)
May 20 04:31:59.703545 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 20 04:31:59.703545 dv-cinder-790910-4-iscsi neutron-server[91686]:     event.method(event)
May 20 04:31:59.703545 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 20 04:31:59.703545 dv-cinder-790910-4-iscsi neutron-server[91686]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 20 04:31:59.703545 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 20 04:31:59.703545 dv-cinder-790910-4-iscsi neutron-server[91686]:     aggregate_uuid = self.p_client.list_aggregates(
May 20 04:31:59.703545 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 20 04:31:59.703545 dv-cinder-790910-4-iscsi neutron-server[91686]:     return f(self, *a, **k)
May 20 04:31:59.703545 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 20 04:31:59.703545 dv-cinder-790910-4-iscsi neutron-server[91686]:     return self._get(url).json()
May 20 04:31:59.703545 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 20 04:31:59.703545 dv-cinder-790910-4-iscsi neutron-server[91686]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 20 04:31:59.703545 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 20 04:31:59.703545 dv-cinder-790910-4-iscsi neutron-server[91686]:     return self.request(url, 'GET', **kwargs)
May 20 04:31:59.703545 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 20 04:31:59.703545 dv-cinder-790910-4-iscsi neutron-server[91686]:     base_url = self.get_endpoint(auth, allow=allow,
May 20 04:31:59.703545 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 20 04:31:59.703545 dv-cinder-790910-4-iscsi neutron-server[91686]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 20 04:31:59.703545 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 20 04:31:59.703545 dv-cinder-790910-4-iscsi neutron-server[91686]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 20 04:31:59.703545 dv-cinder-790910-4-iscsi neutron-server[91686]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 20 04:31:59.792694 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c869f42-0641-483e-8cb5-95676ac50bec req-6b3112db-84ca-496b-a824-f87b71027871 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:31:59.794194 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-9c869f42-0641-483e-8cb5-95676ac50bec req-6b3112db-84ca-496b-a824-f87b71027871 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/ports?device_id=de26e049-9f19-44e7-93d5-64ccd77cb9de HTTP/1.1" status: 200  len: 944 time: 0.1806498
May 20 04:31:59.794875 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-37fb79a0-c2be-4ce0-b4c9-12d4a9c755ec admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1505543', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1590664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1781430', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1713996'] for network, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:59.798552 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:31:59.811840 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-37fb79a0-c2be-4ce0-b4c9-12d4a9c755ec admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for network, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:59.837051 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37fb79a0-c2be-4ce0-b4c9-12d4a9c755ec admin admin] Pushing event deleted for resources: {'Network': ['ID=4bb43617-e5b5-4e08-aa62-fcff79192e08,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:31:59.842307 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-37fb79a0-c2be-4ce0-b4c9-12d4a9c755ec admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:31:59.848065 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-37fb79a0-c2be-4ce0-b4c9-12d4a9c755ec admin admin] 10.222.0.71 "DELETE /v2.0/networks/4bb43617-e5b5-4e08-aa62-fcff79192e08 HTTP/1.1" status: 204  len: 168 time: 1.0142269
May 20 04:31:59.868423 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-b23acff6-3c1f-47ec-94f7-ff368204f26d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:31:59.874367 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-9c869f42-0641-483e-8cb5-95676ac50bec req-d6a707c7-c7e0-460d-841d-e3051ab2525f tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/security-groups?id=ef28d688-789b-4282-a30c-d7d731615fbf&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0599508
May 20 04:31:59.972852 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 46068) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:32:00.020223 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-dafe0e48-c676-42f0-9170-bc9033b93d5c admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=a1319e4a0fc74f98ba4bb88d8a04086b&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0460055
May 20 04:32:00.022665 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 46072) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:32:00.083133 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-cef8cdfc-af96-47c8-9138-435d0a73b14e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:00.110777 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-cef8cdfc-af96-47c8-9138-435d0a73b14e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:00.170426 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-cef8cdfc-af96-47c8-9138-435d0a73b14e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:00.179413 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-8b76a888-93bc-4be0-ad6c-57f016c31113 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:32:00.193160 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cef8cdfc-af96-47c8-9138-435d0a73b14e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5caf5bf6-4479-4098-bb89-e9d1c971ca8a,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:32:00.195752 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-cef8cdfc-af96-47c8-9138-435d0a73b14e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:32:00.202605 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-cef8cdfc-af96-47c8-9138-435d0a73b14e admin admin] Notify callbacks [] for security_group, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:00.206133 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-cef8cdfc-af96-47c8-9138-435d0a73b14e admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/5caf5bf6-4479-4098-bb89-e9d1c971ca8a HTTP/1.1" status: 204  len: 168 time: 0.1801968
May 20 04:32:00.585129 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 46080) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:32:00.637623 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-485910e7-1bbb-427c-be1f-17d6a944ff7a admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=4bcdcc410bb7407eb15e956f1cf3816f&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0511808
May 20 04:32:00.641716 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 46084) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:32:00.707097 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-bab68ab2-3c6e-449e-a701-e599b80371ac admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:00.734311 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-bab68ab2-3c6e-449e-a701-e599b80371ac admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:00.804260 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-bab68ab2-3c6e-449e-a701-e599b80371ac admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:00.809296 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-d38ce2fb-0bb8-4b86-a292-df13d86b16cc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:32:00.821173 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bab68ab2-3c6e-449e-a701-e599b80371ac admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8be8071a-a46b-40d0-a979-8a6411da4342,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:32:00.824597 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-bab68ab2-3c6e-449e-a701-e599b80371ac admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:32:00.827858 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-bab68ab2-3c6e-449e-a701-e599b80371ac admin admin] Notify callbacks [] for security_group, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:00.829000 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-bab68ab2-3c6e-449e-a701-e599b80371ac admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/8be8071a-a46b-40d0-a979-8a6411da4342 HTTP/1.1" status: 204  len: 168 time: 0.1859357
May 20 04:32:01.072250 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44474100-181f-4b08-95aa-953981e2678f req-9ecb0656-f6da-44a6-a00a-cc8cdf7c1ac5 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:32:01.076991 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-44474100-181f-4b08-95aa-953981e2678f req-9ecb0656-f6da-44a6-a00a-cc8cdf7c1ac5 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/ports?device_id=de26e049-9f19-44e7-93d5-64ccd77cb9de HTTP/1.1" status: 200  len: 944 time: 0.0937092
May 20 04:32:01.105109 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 65fa81fb-51bd-4b50-b2a8-68d472455252 no longer exists at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 04:32:01.128591 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-44474100-181f-4b08-95aa-953981e2678f req-f6b80759-d758-443b-b869-0a401a21be4f tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/security-groups?id=ef28d688-789b-4282-a30c-d7d731615fbf&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0479109
May 20 04:32:01.145727 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] No Port match for: 65fa81fb-51bd-4b50-b2a8-68d472455252 {{(pid=91688) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 04:32:01.146077 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 65fa81fb-51bd-4b50-b2a8-68d472455252 not bound to the agent host dv-cinder-790910-4-iscsi {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 04:32:02.179271 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device b1bae5dc-7bbe-4c23-b60b-26cf817da0ee details requested by agent hyperv_hv-cinder-79091 with host hv-cinder-79091 {{(pid=91688) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 20 04:32:02.315264 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port b1bae5dc-7bbe-4c23-b60b-26cf817da0ee, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=b1bae5dc-7bbe-4c23-b60b-26cf817da0ee,segment=NetworkSegment(e9f32492-7a41-4dc9-bc94-b8bce4a8e65d),segment_id=e9f32492-7a41-4dc9-bc94-b8bce4a8e65d)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:32:02.321135 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-491444ed-be36-47ce-a086-d6f64fbdfb20 req-390c4772-a575-4dd4-a3ae-70613048e070 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:32:02.322616 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-491444ed-be36-47ce-a086-d6f64fbdfb20 req-390c4772-a575-4dd4-a3ae-70613048e070 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/ports?device_id=de26e049-9f19-44e7-93d5-64ccd77cb9de HTTP/1.1" status: 200  len: 944 time: 0.0821168
May 20 04:32:02.328879 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Returning: {'device': 'b1bae5dc-7bbe-4c23-b60b-26cf817da0ee', 'network_id': '11c994a8-6ede-4290-84f0-71af466860db', 'port_id': 'b1bae5dc-7bbe-4c23-b60b-26cf817da0ee', 'mac_address': 'fa:16:3e:43:d1:db', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 874, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '51af45f1-449a-400c-8714-8d713d4a7993', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91688) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 20 04:32:02.372288 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-491444ed-be36-47ce-a086-d6f64fbdfb20 req-befaf175-fc28-4825-96f8-5a3793a868eb tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/security-groups?id=ef28d688-789b-4282-a30c-d7d731615fbf&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0436532
May 20 04:32:02.383501 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:02.401313 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.notifiers.nova [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b1bae5dc-7bbe-4c23-b60b-26cf817da0ee {{(pid=91688) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 04:32:02.418155 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port b1bae5dc-7bbe-4c23-b60b-26cf817da0ee, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=b1bae5dc-7bbe-4c23-b60b-26cf817da0ee,segment=NetworkSegment(e9f32492-7a41-4dc9-bc94-b8bce4a8e65d),segment_id=e9f32492-7a41-4dc9-bc94-b8bce4a8e65d)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:32:02.422650 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:02.424380 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:32:02.493340 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Pushing event updated for resources: {'Port': ['ID=b1bae5dc-7bbe-4c23-b60b-26cf817da0ee,revision_number=4']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:32:02.496544 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:32:02.566638 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:02.705071 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-bc907ff0-dc79-4957-911c-d51225b7ed70 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:02.743771 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] get_ports_and_sgs() called for port_ids ['b1bae5dc-7bbe-4c23-b60b-26cf817da0ee'] {{(pid=91688) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 04:32:03.365666 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ea4803bd-878f-47d5-9084-1ec41953c9db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:03.566041 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3edbba9b-3cf7-48d5-b703-d47e4a336d7a req-f7c0dfe7-93db-4ae0-8097-0b9e88ade0ea tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:32:03.567498 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-3edbba9b-3cf7-48d5-b703-d47e4a336d7a req-f7c0dfe7-93db-4ae0-8097-0b9e88ade0ea tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/ports?device_id=de26e049-9f19-44e7-93d5-64ccd77cb9de HTTP/1.1" status: 200  len: 945 time: 0.0882330
May 20 04:32:03.620851 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-3edbba9b-3cf7-48d5-b703-d47e4a336d7a req-4548b946-e2f1-4773-9da4-4f6fd9505946 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/security-groups?id=ef28d688-789b-4282-a30c-d7d731615fbf&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0470874
May 20 04:32:04.189315 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device b1bae5dc-7bbe-4c23-b60b-26cf817da0ee up at agent hyperv_hv-cinder-79091 {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:32:04.269125 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Provisioning for port b1bae5dc-7bbe-4c23-b60b-26cf817da0ee completed by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:32:04.275956 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Provisioning complete for port b1bae5dc-7bbe-4c23-b60b-26cf817da0ee triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:32:04.276476 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:04.398549 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:04.427516 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'de26e049-9f19-44e7-93d5-64ccd77cb9de', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b1bae5dc-7bbe-4c23-b60b-26cf817da0ee'}] {{(pid=91688) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:32:04.437815 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port b1bae5dc-7bbe-4c23-b60b-26cf817da0ee, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=b1bae5dc-7bbe-4c23-b60b-26cf817da0ee,segment=NetworkSegment(e9f32492-7a41-4dc9-bc94-b8bce4a8e65d),segment_id=e9f32492-7a41-4dc9-bc94-b8bce4a8e65d)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:32:04.442550 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:04.444391 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:32:04.476626 dv-cinder-790910-4-iscsi neutron-server[91688]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'de26e049-9f19-44e7-93d5-64ccd77cb9de', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b1bae5dc-7bbe-4c23-b60b-26cf817da0ee', 'code': 200}
May 20 04:32:04.515163 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Pushing event updated for resources: {'Port': ['ID=b1bae5dc-7bbe-4c23-b60b-26cf817da0ee,revision_number=5']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:32:04.518290 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:32:04.803479 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16628ac7-75b3-45d0-bf45-36e3953132ce req-f0d3bb24-8ad6-4c83-898e-ff9431c1a23f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:32:04.804943 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-16628ac7-75b3-45d0-bf45-36e3953132ce req-f0d3bb24-8ad6-4c83-898e-ff9431c1a23f service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=de26e049-9f19-44e7-93d5-64ccd77cb9de HTTP/1.1" status: 200  len: 1099 time: 0.1209257
May 20 04:32:04.855192 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-16628ac7-75b3-45d0-bf45-36e3953132ce req-d5951e3f-7847-4772-afcd-5812f9dd7852 service neutron] 10.222.0.82 "GET /v2.0/security-groups?id=ef28d688-789b-4282-a30c-d7d731615fbf&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0424802
May 20 04:32:04.863665 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d8778bc-3abd-45ac-97b3-13fd6eb70bf3 req-a397a520-97c5-4123-8d38-520799bc1891 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:32:04.865178 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9d8778bc-3abd-45ac-97b3-13fd6eb70bf3 req-a397a520-97c5-4123-8d38-520799bc1891 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/ports?device_id=de26e049-9f19-44e7-93d5-64ccd77cb9de HTTP/1.1" status: 200  len: 946 time: 0.1248393
May 20 04:32:04.914023 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9d8778bc-3abd-45ac-97b3-13fd6eb70bf3 req-826ba282-3435-4a98-ab68-aae5836af2a6 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/security-groups?id=ef28d688-789b-4282-a30c-d7d731615fbf&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0392356
May 20 04:32:05.215786 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f21320cc-6a25-4ec1-8a32-8b119b35fd55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:06.115695 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5a2761f-3159-46e8-b1cd-ef367aab38f6 req-d9f25127-a2b1-4aa5-bef2-e811a165e2cb tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:32:06.117339 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-b5a2761f-3159-46e8-b1cd-ef367aab38f6 req-d9f25127-a2b1-4aa5-bef2-e811a165e2cb tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/ports?device_id=de26e049-9f19-44e7-93d5-64ccd77cb9de HTTP/1.1" status: 200  len: 946 time: 0.0941298
May 20 04:32:06.164698 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-b5a2761f-3159-46e8-b1cd-ef367aab38f6 req-8f1083e0-094e-43fa-abe3-474e06edaa9e tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/security-groups?id=ef28d688-789b-4282-a30c-d7d731615fbf&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0412593
May 20 04:32:06.359791 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9269446b-9bb5-4f78-b386-29329f7a4f07 req-f3118364-18e2-41bf-87f3-e63ce83f5474 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:32:06.361283 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9269446b-9bb5-4f78-b386-29329f7a4f07 req-f3118364-18e2-41bf-87f3-e63ce83f5474 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/ports?device_id=de26e049-9f19-44e7-93d5-64ccd77cb9de HTTP/1.1" status: 200  len: 946 time: 0.0871882
May 20 04:32:06.409339 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9269446b-9bb5-4f78-b386-29329f7a4f07 req-6dae801f-9825-43a3-9dfe-1dbe21ce1b9d tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/security-groups?id=ef28d688-789b-4282-a30c-d7d731615fbf&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0404553
May 20 04:32:06.436399 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 46104) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:32:06.516457 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-60bc5d40-f75b-4815-9767-39d67771cd43 tempest-TestVolumeBootPattern-89884506 tempest-TestVolumeBootPattern-89884506-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:32:06.517999 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-60bc5d40-f75b-4815-9767-39d67771cd43 tempest-TestVolumeBootPattern-89884506 tempest-TestVolumeBootPattern-89884506-project-admin] 10.222.0.71 "GET /v2.0/ports?device_id=de26e049-9f19-44e7-93d5-64ccd77cb9de HTTP/1.1" status: 200  len: 1094 time: 0.0805695
May 20 04:32:06.520786 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 46108) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:32:06.525853 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [None req-1fce11c4-da30-4257-ade2-1f7dbc52deaf tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Request body: {'floatingip': {'floating_network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'port_id': 'b1bae5dc-7bbe-4c23-b60b-26cf817da0ee', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'fixed_ip_address': '172.20.0.13'}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:32:06.532644 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-1fce11c4-da30-4257-ade2-1f7dbc52deaf tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:32:06.537206 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-1fce11c4-da30-4257-ade2-1f7dbc52deaf tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Usage tracker for resource:floatingip and tenant:9b6fb271a7a546a38b0c6df5beaf22fc is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:32:06.540224 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-1fce11c4-da30-4257-ade2-1f7dbc52deaf tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Quota usage for floatingip was recalculated. Used quota:1. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:32:06.546062 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-1fce11c4-da30-4257-ade2-1f7dbc52deaf tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attempting to reserve 1 items for resource floatingip. Total usage: 1; quota limit: 50; headroom:49 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:32:06.557877 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-1fce11c4-da30-4257-ade2-1f7dbc52deaf tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks [] for floatingip, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:06.585473 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:06.696549 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-1fce11c4-da30-4257-ade2-1f7dbc52deaf tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:06.926547 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.db_base_plugin_common [None req-1fce11c4-da30-4257-ade2-1f7dbc52deaf tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Allocated IP 172.27.1.86 (aec557db-0c02-4008-8c9f-2efcd7462f90/217f4b55-4415-4d57-8b43-2ff4c8ac8e81/ca121a9d-b4a4-4641-9c83-971ee0156e48) {{(pid=91687) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 04:32:07.085095 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-1fce11c4-da30-4257-ade2-1f7dbc52deaf tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks [] for port, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:07.120876 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-1fce11c4-da30-4257-ade2-1f7dbc52deaf tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8782892106231', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4162192'] for port, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:07.124575 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-2016da6e-91f2-4a78-b1e7-2ec273ca939f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:32:07.186687 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1fce11c4-da30-4257-ade2-1f7dbc52deaf tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Network aec557db-0c02-4008-8c9f-2efcd7462f90 is already hosted by enough agents. {{(pid=91687) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:32:07.189404 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.base_scheduler [None req-1fce11c4-da30-4257-ade2-1f7dbc52deaf tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Resources bound (agent type, host, resource id):  {{(pid=91687) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:32:07.192877 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1fce11c4-da30-4257-ade2-1f7dbc52deaf tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Received port after_create {{(pid=91687) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 04:32:07.221230 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fce11c4-da30-4257-ade2-1f7dbc52deaf tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Pushing event updated for resources: {'Port': ['ID=ca121a9d-b4a4-4641-9c83-971ee0156e48,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:32:07.228605 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-1fce11c4-da30-4257-ade2-1f7dbc52deaf tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:32:07.614579 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-1fce11c4-da30-4257-ade2-1f7dbc52deaf tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks [] for floatingip, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:07.698243 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-1fce11c4-da30-4257-ade2-1f7dbc52deaf tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:07.925963 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-1fce11c4-da30-4257-ade2-1f7dbc52deaf tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks [] for port, precommit_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:07.931474 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-1fce11c4-da30-4257-ade2-1f7dbc52deaf tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4162185'] for port, after_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:07.935108 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-80144644-4f54-4e2b-993b-0f3628c73fa4 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:32:08.037875 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fce11c4-da30-4257-ade2-1f7dbc52deaf tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Pushing event updated for resources: {'Port': ['ID=ca121a9d-b4a4-4641-9c83-971ee0156e48,revision_number=2']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:32:08.041959 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-1fce11c4-da30-4257-ade2-1f7dbc52deaf tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:32:08.050495 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-1fce11c4-da30-4257-ade2-1f7dbc52deaf tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1716406'] for floatingip, after_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:08.220517 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.db.l3_db [None req-1fce11c4-da30-4257-ade2-1f7dbc52deaf tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Floating IP 3e823655-ee96-49c4-9d83-df544348d4cf associated. External IP: 172.27.1.86, port: b1bae5dc-7bbe-4c23-b60b-26cf817da0ee.
May 20 04:32:08.693720 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1fce11c4-da30-4257-ade2-1f7dbc52deaf tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Router a7f66c4d-6b4f-4053-bd69-e1bea7db4c61 has already been hosted by L3 agent 02733fc0-fc9c-4e29-bc03-c27a792d539d {{(pid=91687) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 04:32:08.877591 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1fce11c4-da30-4257-ade2-1f7dbc52deaf tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify agent at l3_agent.dv-cinder-790910-4-iscsi the message routers_updated {{(pid=91687) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 04:32:08.888881 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f91859d0-a69b-44a9-b880-9f1b93233854 None None] Sync routers for ids ['a7f66c4d-6b4f-4053-bd69-e1bea7db4c61'] in dv-cinder-790910-4-iscsi {{(pid=91688) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 04:32:08.898497 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f91859d0-a69b-44a9-b880-9f1b93233854 None None] Routers {'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91688) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:32:08.899085 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-f91859d0-a69b-44a9-b880-9f1b93233854 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced0a7faf0>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:32:03Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['a7f66c4d-6b4f-4053-bd69-e1bea7db4c61'], 'active': True} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:32:08.907314 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-1fce11c4-da30-4257-ade2-1f7dbc52deaf tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for floatingip, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:08.968466 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-1fce11c4-da30-4257-ade2-1f7dbc52deaf tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 996 time: 2.4463904
May 20 04:32:08.969102 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'de26e049-9f19-44e7-93d5-64ccd77cb9de', 'tag': 'b1bae5dc-7bbe-4c23-b60b-26cf817da0ee'}] {{(pid=91687) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:32:09.078431 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvr_db [None req-f91859d0-a69b-44a9-b880-9f1b93233854 None None] Set router a7f66c4d-6b4f-4053-bd69-e1bea7db4c61 gateway port host: dv-cinder-790910-4-iscsi {{(pid=91688) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:32:09.209627 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'de26e049-9f19-44e7-93d5-64ccd77cb9de', 'tag': 'b1bae5dc-7bbe-4c23-b60b-26cf817da0ee', 'status': 'completed', 'code': 200}
May 20 04:32:09.306490 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42925a64-a165-4bc3-a581-ebcc3dfef152 req-3c94c4a8-a146-4c0a-a2ac-2b5a07c147d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:32:09.307995 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-42925a64-a165-4bc3-a581-ebcc3dfef152 req-3c94c4a8-a146-4c0a-a2ac-2b5a07c147d3 service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=9b6fb271a7a546a38b0c6df5beaf22fc&device_id=de26e049-9f19-44e7-93d5-64ccd77cb9de HTTP/1.1" status: 200  len: 1099 time: 0.0755639
May 20 04:32:09.441282 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42925a64-a165-4bc3-a581-ebcc3dfef152 req-b231f7e8-05bc-4d82-bba9-28dc6377058d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:32:09.442723 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-42925a64-a165-4bc3-a581-ebcc3dfef152 req-b231f7e8-05bc-4d82-bba9-28dc6377058d service neutron] 10.222.0.82 "GET /v2.0/networks?id=11c994a8-6ede-4290-84f0-71af466860db HTTP/1.1" status: 200  len: 912 time: 0.1265359
May 20 04:32:09.461832 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-f91859d0-a69b-44a9-b880-9f1b93233854 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced0a7faf0>, [{'id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'name': 'tempest-TestVolumeBootPattern-857163320-router', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.91'}], 'enable_snat': True}, 'gw_port_id': '866cc6c0-5986-4eb4-8827-b255811a13de', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:28:09Z', 'updated_at': '2021-05-20T04:28:12Z', 'revision_number': 4, 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'gw_port': {'id': '866cc6c0-5986-4eb4-8827-b255811a13de', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:f5:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'device_owner': 'network:router_gateway', 'standard_attr_id': 511, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:28:09Z', 'updated_at': '2021-05-20T04:28:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_floatingips': [{'id': '3e823655-ee96-49c4-9d83-df544348d4cf', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'floating_ip_address': '172.27.1.86', 'floating_network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'router_id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'port_id': 'b1bae5dc-7bbe-4c23-b60b-26cf817da0ee', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 597, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '11c994a8-6ede-4290-84f0-71af466860db', 'mac_address': 'fa:16:3e:43:d1:db', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'de26e049-9f19-44e7-93d5-64ccd77cb9de', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T04:32:07Z', 'updated_at': '2021-05-20T04:32:07Z', 'revision_number': 0, 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0bcb5c14-319d-4871-bef1-50d60ad3f5b8', 'name': '', 'network_id': '11c994a8-6ede-4290-84f0-71af466860db', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'mac_address': 'fa:16:3e:2c:84:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'device_owner': 'network:router_interface', 'standard_attr_id': 512, 'fixed_ips': [{'subnet_id': '51af45f1-449a-400c-8714-8d713d4a7993', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:28:12Z', 'updated_at': '2021-05-20T04:28:19Z', 'revision_number': 5, 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'subnets': [{'id': '51af45f1-449a-400c-8714-8d713d4a7993', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:32:09.465958 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f91859d0-a69b-44a9-b880-9f1b93233854 None None] Checking router: a7f66c4d-6b4f-4053-bd69-e1bea7db4c61 for host: dv-cinder-790910-4-iscsi {{(pid=91688) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 04:32:09.474949 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f91859d0-a69b-44a9-b880-9f1b93233854 None None] Routers {'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91688) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:32:09.475552 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-f91859d0-a69b-44a9-b880-9f1b93233854 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced0a7faf0>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:32:03Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['a7f66c4d-6b4f-4053-bd69-e1bea7db4c61'], 'active': True} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:32:09.545210 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-42925a64-a165-4bc3-a581-ebcc3dfef152 req-c20867b0-e779-427b-b295-3d2bcf041787 service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=b1bae5dc-7bbe-4c23-b60b-26cf817da0ee HTTP/1.1" status: 200  len: 999 time: 0.0960331
May 20 04:32:09.608835 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42925a64-a165-4bc3-a581-ebcc3dfef152 req-d6dbce5a-0047-4986-883a-0bc3952bfc27 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:32:09.610207 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-42925a64-a165-4bc3-a581-ebcc3dfef152 req-d6dbce5a-0047-4986-883a-0bc3952bfc27 service neutron] 10.222.0.82 "GET /v2.0/subnets?id=51af45f1-449a-400c-8714-8d713d4a7993 HTTP/1.1" status: 200  len: 850 time: 0.0581532
May 20 04:32:09.653124 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvr_db [None req-f91859d0-a69b-44a9-b880-9f1b93233854 None None] Set router a7f66c4d-6b4f-4053-bd69-e1bea7db4c61 gateway port host: dv-cinder-790910-4-iscsi {{(pid=91688) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:32:09.689196 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42925a64-a165-4bc3-a581-ebcc3dfef152 req-81bd5fcc-4994-4e5a-88eb-3de86696f9d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:32:09.690679 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-42925a64-a165-4bc3-a581-ebcc3dfef152 req-81bd5fcc-4994-4e5a-88eb-3de86696f9d4 service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=11c994a8-6ede-4290-84f0-71af466860db&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0732481
May 20 04:32:09.823204 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-42925a64-a165-4bc3-a581-ebcc3dfef152 req-a944c1f7-dd96-40a2-bd51-a1e011432291 service neutron] 10.222.0.82 "GET /v2.0/networks/11c994a8-6ede-4290-84f0-71af466860db?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1259165
May 20 04:32:09.959911 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-42925a64-a165-4bc3-a581-ebcc3dfef152 req-555ef3f5-23f8-4af9-a4c9-97dabb41b7a9 service neutron] 10.222.0.82 "GET /v2.0/networks/11c994a8-6ede-4290-84f0-71af466860db?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1278684
May 20 04:32:09.999471 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-f91859d0-a69b-44a9-b880-9f1b93233854 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced0a7faf0>, [{'id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'name': 'tempest-TestVolumeBootPattern-857163320-router', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.91'}], 'enable_snat': True}, 'gw_port_id': '866cc6c0-5986-4eb4-8827-b255811a13de', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:28:09Z', 'updated_at': '2021-05-20T04:28:12Z', 'revision_number': 4, 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'gw_port': {'id': '866cc6c0-5986-4eb4-8827-b255811a13de', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:f5:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'device_owner': 'network:router_gateway', 'standard_attr_id': 511, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:28:09Z', 'updated_at': '2021-05-20T04:28:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_floatingips': [{'id': '3e823655-ee96-49c4-9d83-df544348d4cf', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'floating_ip_address': '172.27.1.86', 'floating_network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'router_id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'port_id': 'b1bae5dc-7bbe-4c23-b60b-26cf817da0ee', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 597, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '11c994a8-6ede-4290-84f0-71af466860db', 'mac_address': 'fa:16:3e:43:d1:db', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'de26e049-9f19-44e7-93d5-64ccd77cb9de', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T04:32:07Z', 'updated_at': '2021-05-20T04:32:07Z', 'revision_number': 0, 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0bcb5c14-319d-4871-bef1-50d60ad3f5b8', 'name': '', 'network_id': '11c994a8-6ede-4290-84f0-71af466860db', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'mac_address': 'fa:16:3e:2c:84:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'device_owner': 'network:router_interface', 'standard_attr_id': 512, 'fixed_ips': [{'subnet_id': '51af45f1-449a-400c-8714-8d713d4a7993', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:28:12Z', 'updated_at': '2021-05-20T04:28:19Z', 'revision_number': 5, 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'subnets': [{'id': '51af45f1-449a-400c-8714-8d713d4a7993', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:32:10.003605 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f91859d0-a69b-44a9-b880-9f1b93233854 None None] The sync data for ids ['a7f66c4d-6b4f-4053-bd69-e1bea7db4c61'] in dv-cinder-790910-4-iscsi is: [{'id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'name': 'tempest-TestVolumeBootPattern-857163320-router', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.91'}], 'enable_snat': True}, 'gw_port_id': '866cc6c0-5986-4eb4-8827-b255811a13de', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:28:09Z', 'updated_at': '2021-05-20T04:28:12Z', 'revision_number': 4, 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'gw_port': {'id': '866cc6c0-5986-4eb4-8827-b255811a13de', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:f5:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'device_owner': 'network:router_gateway', 'standard_attr_id': 511, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:28:09Z', 'updated_at': '2021-05-20T04:28:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_floatingips': [{'id': '3e823655-ee96-49c4-9d83-df544348d4cf', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'floating_ip_address': '172.27.1.86', 'floating_network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'router_id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'port_id': 'b1bae5dc-7bbe-4c23-b60b-26cf817da0ee', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 597, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '11c994a8-6ede-4290-84f0-71af466860db', 'mac_address': 'fa:16:3e:43:d1:db', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'de26e049-9f19-44e7-93d5-64ccd77cb9de', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T04:32:07Z', 'updated_at': '2021-05-20T04:32:07Z', 'revision_number': 0, 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0bcb5c14-319d-4871-bef1-50d60ad3f5b8', 'name': '', 'network_id': '11c994a8-6ede-4290-84f0-71af466860db', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'mac_address': 'fa:16:3e:2c:84:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'device_owner': 'network:router_interface', 'standard_attr_id': 512, 'fixed_ips': [{'subnet_id': '51af45f1-449a-400c-8714-8d713d4a7993', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:28:12Z', 'updated_at': '2021-05-20T04:28:19Z', 'revision_number': 5, 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'subnets': [{'id': '51af45f1-449a-400c-8714-8d713d4a7993', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91688) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 04:32:10.178550 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4bcf7553-b25d-4296-8133-a7af02b589dc None None] New status for floating IP 3e823655-ee96-49c4-9d83-df544348d4cf: ACTIVE {{(pid=91689) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 20 04:32:29.870587 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f0438efd-c187-4e3f-8585-135e1f80befd None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:32.575988 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:32.709371 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-176e17bd-2476-4a6d-a182-b5f6a0c18e71 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:33.370117 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ea4803bd-878f-47d5-9084-1ec41953c9db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:34.957214 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.agents_db [None req-92d61f12-17bc-4bf9-9eab-8a69b8c6da2f None None] Agent healthcheck: found 6 active agents {{(pid=91689) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 04:32:35.221081 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f21320cc-6a25-4ec1-8a32-8b119b35fd55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:36.595221 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:37.546246 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-51dfb3ae-5e31-4278-9562-eda066404415 req-6c9b55d5-c48d-4449-bfd5-2312f52e4454 service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=7925b833-d836-40d7-81b2-48717d6da34b&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0766962
May 20 04:32:37.699791 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51dfb3ae-5e31-4278-9562-eda066404415 req-d527c79b-aeb2-46eb-8b76-c3abf92a0cd6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:32:37.701262 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-51dfb3ae-5e31-4278-9562-eda066404415 req-d527c79b-aeb2-46eb-8b76-c3abf92a0cd6 service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=ef3bec4745b14484ac8e21cd16cbd11d&device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 1100 time: 0.0770109
May 20 04:32:37.980861 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51dfb3ae-5e31-4278-9562-eda066404415 req-04b3803d-41a3-450f-9079-4023239ee070 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:32:37.982339 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-51dfb3ae-5e31-4278-9562-eda066404415 req-04b3803d-41a3-450f-9079-4023239ee070 service neutron] 10.222.0.82 "GET /v2.0/networks?id=21794e86-fda7-40a6-a5a8-db117c7eeb9d HTTP/1.1" status: 200  len: 918 time: 0.2532799
May 20 04:32:38.084224 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-51dfb3ae-5e31-4278-9562-eda066404415 req-8ddd2f5b-5ac3-4d69-837c-982f6a49db54 service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=1cc416ab-7f60-449e-8b91-113111ff4aa3 HTTP/1.1" status: 200  len: 1001 time: 0.0946836
May 20 04:32:38.146216 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51dfb3ae-5e31-4278-9562-eda066404415 req-d6491bcd-5b00-410d-aab3-41203c0f2691 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:32:38.147516 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-51dfb3ae-5e31-4278-9562-eda066404415 req-d6491bcd-5b00-410d-aab3-41203c0f2691 service neutron] 10.222.0.82 "GET /v2.0/subnets?id=06f38702-3d3c-4e25-8f84-85483d1ddf28 HTTP/1.1" status: 200  len: 856 time: 0.0560436
May 20 04:32:38.226136 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51dfb3ae-5e31-4278-9562-eda066404415 req-b74a17ef-ca1b-42d3-94a0-0dfc97b0be61 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:32:38.227595 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-51dfb3ae-5e31-4278-9562-eda066404415 req-b74a17ef-ca1b-42d3-94a0-0dfc97b0be61 service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=21794e86-fda7-40a6-a5a8-db117c7eeb9d&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0725508
May 20 04:32:38.360824 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-51dfb3ae-5e31-4278-9562-eda066404415 req-0f5ec3ce-c714-4ecc-9f4f-7a3f681c31e2 service neutron] 10.222.0.82 "GET /v2.0/networks/21794e86-fda7-40a6-a5a8-db117c7eeb9d?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1252334
May 20 04:32:38.498196 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-51dfb3ae-5e31-4278-9562-eda066404415 req-2f390c19-3869-4d95-86ad-c051d5dc1d21 service neutron] 10.222.0.82 "GET /v2.0/networks/21794e86-fda7-40a6-a5a8-db117c7eeb9d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1302569
May 20 04:32:47.335867 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4660c97e-6a83-407d-8772-6c7e44450e17 req-a133a636-4099-4dda-8188-53985cfc1b6a tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:32:47.337225 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-4660c97e-6a83-407d-8772-6c7e44450e17 req-a133a636-4099-4dda-8188-53985cfc1b6a tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 947 time: 0.1031246
May 20 04:32:47.381835 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-4660c97e-6a83-407d-8772-6c7e44450e17 req-184bff76-287a-4f95-8b98-0e699c031d48 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=35bf24dc-8716-4edf-9f4f-f9d97739d7ef&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0383503
May 20 04:32:48.589167 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8554e310-21ad-431e-b71b-cfcdd18f07ae req-00b374fc-7564-4797-beb6-d0818654ec29 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:32:48.590555 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-8554e310-21ad-431e-b71b-cfcdd18f07ae req-00b374fc-7564-4797-beb6-d0818654ec29 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 947 time: 0.0864737
May 20 04:32:48.637983 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-8554e310-21ad-431e-b71b-cfcdd18f07ae req-cb4fa54a-247f-4d00-af66-f1dc749fdd50 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups?id=35bf24dc-8716-4edf-9f4f-f9d97739d7ef&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0390682
May 20 04:32:48.889542 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4700435-580e-4732-9bee-cba5db2fd273 req-f098de82-d939-43d6-b486-8175e829ac08 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:32:48.891072 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-b4700435-580e-4732-9bee-cba5db2fd273 req-f098de82-d939-43d6-b486-8175e829ac08 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.82 "GET /v2.0/ports?device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 947 time: 0.0928364
May 20 04:32:49.039186 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [req-b4700435-580e-4732-9bee-cba5db2fd273 req-fb63cdb0-ec06-4fd9-a9a0-eba94daa4568 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Deleting port 1cc416ab-7f60-449e-8b91-113111ff4aa3 {{(pid=91687) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 04:32:49.039550 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-b4700435-580e-4732-9bee-cba5db2fd273 req-fb63cdb0-ec06-4fd9-a9a0-eba94daa4568 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8782892520551'] for port, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:49.177375 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [req-b4700435-580e-4732-9bee-cba5db2fd273 req-fb63cdb0-ec06-4fd9-a9a0-eba94daa4568 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] For port 1cc416ab-7f60-449e-8b91-113111ff4aa3, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=1cc416ab-7f60-449e-8b91-113111ff4aa3,segment=NetworkSegment(9521f383-6017-4b4d-9f47-cff4ed54cb57),segment_id=9521f383-6017-4b4d-9f47-cff4ed54cb57)] {{(pid=91687) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:32:49.177652 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-b4700435-580e-4732-9bee-cba5db2fd273 req-fb63cdb0-ec06-4fd9-a9a0-eba94daa4568 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1718922'] for port, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:49.469090 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-b4700435-580e-4732-9bee-cba5db2fd273 req-fb63cdb0-ec06-4fd9-a9a0-eba94daa4568 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks [] for floatingip, precommit_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:49.469415 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-b4700435-580e-4732-9bee-cba5db2fd273 req-fb63cdb0-ec06-4fd9-a9a0-eba94daa4568 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1716406'] for floatingip, after_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:49.469716 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.db.l3_db [req-b4700435-580e-4732-9bee-cba5db2fd273 req-fb63cdb0-ec06-4fd9-a9a0-eba94daa4568 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Floating IP a73fb90d-bf4b-41bd-a01a-5fdf0d810c60 disassociated. External IP: 172.27.1.20, port: 1cc416ab-7f60-449e-8b91-113111ff4aa3.
May 20 04:32:49.470086 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [req-b4700435-580e-4732-9bee-cba5db2fd273 req-fb63cdb0-ec06-4fd9-a9a0-eba94daa4568 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Calling delete_port for 1cc416ab-7f60-449e-8b91-113111ff4aa3 owned by compute:nova {{(pid=91687) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 04:32:49.595937 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-b4700435-580e-4732-9bee-cba5db2fd273 req-fb63cdb0-ec06-4fd9-a9a0-eba94daa4568 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8782892522936', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8782892108804', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4162192'] for port, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:49.602221 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-4daf2dd0-4335-420a-a06c-b92d1b30d319 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:32:49.648452 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb63cdb0-ec06-4fd9-a9a0-eba94daa4568 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Pushing event deleted for resources: {'Port': ['ID=1cc416ab-7f60-449e-8b91-113111ff4aa3,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:32:49.659581 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb63cdb0-ec06-4fd9-a9a0-eba94daa4568 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:32:49.659947 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb63cdb0-ec06-4fd9-a9a0-eba94daa4568 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:32:49.660376 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb63cdb0-ec06-4fd9-a9a0-eba94daa4568 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:32:49.660777 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb63cdb0-ec06-4fd9-a9a0-eba94daa4568 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:32:49.661338 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb63cdb0-ec06-4fd9-a9a0-eba94daa4568 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:32:49.661705 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb63cdb0-ec06-4fd9-a9a0-eba94daa4568 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:32:49.662057 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb63cdb0-ec06-4fd9-a9a0-eba94daa4568 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:32:49.662500 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb63cdb0-ec06-4fd9-a9a0-eba94daa4568 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:32:49.662863 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb63cdb0-ec06-4fd9-a9a0-eba94daa4568 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:32:49.663223 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb63cdb0-ec06-4fd9-a9a0-eba94daa4568 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:32:49.663579 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb63cdb0-ec06-4fd9-a9a0-eba94daa4568 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:32:49.663928 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb63cdb0-ec06-4fd9-a9a0-eba94daa4568 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:32:49.667749 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-fb63cdb0-ec06-4fd9-a9a0-eba94daa4568 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.066s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:32:49.798850 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-d5050fe7-4e10-4825-96b9-f5634f3b7aa1 req-f3662b89-1762-46f6-b4e2-5be865386715 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/ports?device_id=7925b833-d836-40d7-81b2-48717d6da34b HTTP/1.1" status: 200  len: 210 time: 0.0446825
May 20 04:32:49.953370 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.l3_agent_scheduler [req-b4700435-580e-4732-9bee-cba5db2fd273 req-fb63cdb0-ec06-4fd9-a9a0-eba94daa4568 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Router 34eeb764-2607-4d9f-96c4-89598b702500 has already been hosted by L3 agent 02733fc0-fc9c-4e29-bc03-c27a792d539d {{(pid=91687) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 04:32:50.137544 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-b4700435-580e-4732-9bee-cba5db2fd273 req-fb63cdb0-ec06-4fd9-a9a0-eba94daa4568 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify agent at l3_agent.dv-cinder-790910-4-iscsi the message routers_updated {{(pid=91687) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 04:32:50.147577 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1eeb1938-aba7-44e9-8b20-326bb2e32619 None None] Sync routers for ids ['34eeb764-2607-4d9f-96c4-89598b702500'] in dv-cinder-790910-4-iscsi {{(pid=91688) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 04:32:50.158030 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1eeb1938-aba7-44e9-8b20-326bb2e32619 None None] Routers {'34eeb764-2607-4d9f-96c4-89598b702500'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91688) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:32:50.158634 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-1eeb1938-aba7-44e9-8b20-326bb2e32619 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced1bb4700>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:32:33Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['34eeb764-2607-4d9f-96c4-89598b702500'], 'active': True} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:32:50.215259 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.l3_dvrscheduler_db [req-b4700435-580e-4732-9bee-cba5db2fd273 req-fb63cdb0-ec06-4fd9-a9a0-eba94daa4568 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] No DVR routers for this DVR port 1cc416ab-7f60-449e-8b91-113111ff4aa3 on host hv-cinder-79091 {{(pid=91687) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 04:32:50.218075 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-b4700435-580e-4732-9bee-cba5db2fd273 req-fb63cdb0-ec06-4fd9-a9a0-eba94daa4568 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for port, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:50.220795 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7925b833-d836-40d7-81b2-48717d6da34b', 'name': 'network-vif-deleted', 'tag': '1cc416ab-7f60-449e-8b91-113111ff4aa3'}] {{(pid=91687) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:32:50.238833 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-b4700435-580e-4732-9bee-cba5db2fd273 req-fb63cdb0-ec06-4fd9-a9a0-eba94daa4568 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.82 "DELETE /v2.0/ports/1cc416ab-7f60-449e-8b91-113111ff4aa3 HTTP/1.1" status: 204  len: 173 time: 1.3419473
May 20 04:32:50.272097 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7925b833-d836-40d7-81b2-48717d6da34b', 'name': 'network-vif-deleted', 'tag': '1cc416ab-7f60-449e-8b91-113111ff4aa3', 'status': 'completed', 'code': 200}
May 20 04:32:50.340146 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvr_db [None req-1eeb1938-aba7-44e9-8b20-326bb2e32619 None None] Set router 34eeb764-2607-4d9f-96c4-89598b702500 gateway port host: dv-cinder-790910-4-iscsi {{(pid=91688) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:32:50.652870 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-1eeb1938-aba7-44e9-8b20-326bb2e32619 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced1bb4700>, [{'id': '34eeb764-2607-4d9f-96c4-89598b702500', 'name': 'tempest-AttachVolumeShelveTestJSON-1895235554-router', 'tenant_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.72'}], 'enable_snat': True}, 'gw_port_id': '16508f6e-35a3-4301-9018-78e099969b00', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:21:10Z', 'updated_at': '2021-05-20T04:21:20Z', 'revision_number': 4, 'project_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'gw_port': {'id': '16508f6e-35a3-4301-9018-78e099969b00', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:e3:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '34eeb764-2607-4d9f-96c4-89598b702500', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:21:12Z', 'updated_at': '2021-05-20T04:21:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_interfaces': [{'id': 'aad390e4-f9e2-4bbe-9e64-7b390cc7f3b3', 'name': '', 'network_id': '21794e86-fda7-40a6-a5a8-db117c7eeb9d', 'tenant_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'mac_address': 'fa:16:3e:b2:b9:f0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '34eeb764-2607-4d9f-96c4-89598b702500', 'device_owner': 'network:router_interface', 'standard_attr_id': 88, 'fixed_ips': [{'subnet_id': '06f38702-3d3c-4e25-8f84-85483d1ddf28', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:21:18Z', 'updated_at': '2021-05-20T04:21:40Z', 'revision_number': 5, 'project_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'subnets': [{'id': '06f38702-3d3c-4e25-8f84-85483d1ddf28', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:32:50.657505 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1eeb1938-aba7-44e9-8b20-326bb2e32619 None None] Checking router: 34eeb764-2607-4d9f-96c4-89598b702500 for host: dv-cinder-790910-4-iscsi {{(pid=91688) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 04:32:50.666825 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1eeb1938-aba7-44e9-8b20-326bb2e32619 None None] Routers {'34eeb764-2607-4d9f-96c4-89598b702500'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91688) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:32:50.667438 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-1eeb1938-aba7-44e9-8b20-326bb2e32619 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced1bb4700>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:32:33Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['34eeb764-2607-4d9f-96c4-89598b702500'], 'active': True} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:32:50.896911 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvr_db [None req-1eeb1938-aba7-44e9-8b20-326bb2e32619 None None] Set router 34eeb764-2607-4d9f-96c4-89598b702500 gateway port host: dv-cinder-790910-4-iscsi {{(pid=91688) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:32:50.928334 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 46158) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:32:50.994565 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-2d1d72e1-5cca-4124-9b55-dbb2848b3414 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks [] for security_group, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:51.022115 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-2d1d72e1-5cca-4124-9b55-dbb2848b3414 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks [] for security_group, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:51.077716 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-2d1d72e1-5cca-4124-9b55-dbb2848b3414 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:51.083175 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-f234eda3-0961-42ce-b0b8-6c12928f107e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:32:51.098385 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d1d72e1-5cca-4124-9b55-dbb2848b3414 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=35bf24dc-8716-4edf-9f4f-f9d97739d7ef,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:32:51.101106 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-2d1d72e1-5cca-4124-9b55-dbb2848b3414 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:32:51.107904 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-2d1d72e1-5cca-4124-9b55-dbb2848b3414 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks [] for security_group, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:51.109269 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-2d1d72e1-5cca-4124-9b55-dbb2848b3414 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "DELETE /v2.0/security-groups/35bf24dc-8716-4edf-9f4f-f9d97739d7ef HTTP/1.1" status: 204  len: 168 time: 0.1796622
May 20 04:32:51.111862 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 46162) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:32:51.128208 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.api.v2.resource [None req-3b6528aa-414a-4e7e-b2db-4204b54f93f3 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] show failed (client error): The resource could not be found.
May 20 04:32:51.129217 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-3b6528aa-414a-4e7e-b2db-4204b54f93f3 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "GET /v2.0/security-groups/35bf24dc-8716-4edf-9f4f-f9d97739d7ef HTTP/1.1" status: 404  len: 347 time: 0.0164180
May 20 04:32:51.132547 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 46166) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:32:51.221287 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-1eeb1938-aba7-44e9-8b20-326bb2e32619 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced1bb4700>, [{'id': '34eeb764-2607-4d9f-96c4-89598b702500', 'name': 'tempest-AttachVolumeShelveTestJSON-1895235554-router', 'tenant_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.72'}], 'enable_snat': True}, 'gw_port_id': '16508f6e-35a3-4301-9018-78e099969b00', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:21:10Z', 'updated_at': '2021-05-20T04:21:20Z', 'revision_number': 4, 'project_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'gw_port': {'id': '16508f6e-35a3-4301-9018-78e099969b00', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:e3:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '34eeb764-2607-4d9f-96c4-89598b702500', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:21:12Z', 'updated_at': '2021-05-20T04:21:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_interfaces': [{'id': 'aad390e4-f9e2-4bbe-9e64-7b390cc7f3b3', 'name': '', 'network_id': '21794e86-fda7-40a6-a5a8-db117c7eeb9d', 'tenant_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'mac_address': 'fa:16:3e:b2:b9:f0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '34eeb764-2607-4d9f-96c4-89598b702500', 'device_owner': 'network:router_interface', 'standard_attr_id': 88, 'fixed_ips': [{'subnet_id': '06f38702-3d3c-4e25-8f84-85483d1ddf28', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:21:18Z', 'updated_at': '2021-05-20T04:21:40Z', 'revision_number': 5, 'project_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'subnets': [{'id': '06f38702-3d3c-4e25-8f84-85483d1ddf28', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:32:51.225411 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1eeb1938-aba7-44e9-8b20-326bb2e32619 None None] The sync data for ids ['34eeb764-2607-4d9f-96c4-89598b702500'] in dv-cinder-790910-4-iscsi is: [{'id': '34eeb764-2607-4d9f-96c4-89598b702500', 'name': 'tempest-AttachVolumeShelveTestJSON-1895235554-router', 'tenant_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.72'}], 'enable_snat': True}, 'gw_port_id': '16508f6e-35a3-4301-9018-78e099969b00', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:21:10Z', 'updated_at': '2021-05-20T04:21:20Z', 'revision_number': 4, 'project_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'gw_port': {'id': '16508f6e-35a3-4301-9018-78e099969b00', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:e3:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '34eeb764-2607-4d9f-96c4-89598b702500', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:21:12Z', 'updated_at': '2021-05-20T04:21:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_interfaces': [{'id': 'aad390e4-f9e2-4bbe-9e64-7b390cc7f3b3', 'name': '', 'network_id': '21794e86-fda7-40a6-a5a8-db117c7eeb9d', 'tenant_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'mac_address': 'fa:16:3e:b2:b9:f0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '34eeb764-2607-4d9f-96c4-89598b702500', 'device_owner': 'network:router_interface', 'standard_attr_id': 88, 'fixed_ips': [{'subnet_id': '06f38702-3d3c-4e25-8f84-85483d1ddf28', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:21:18Z', 'updated_at': '2021-05-20T04:21:40Z', 'revision_number': 5, 'project_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'subnets': [{'id': '06f38702-3d3c-4e25-8f84-85483d1ddf28', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91688) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 04:32:51.360377 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [None req-329e70a1-ad79-4874-94a9-86476739067e tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Deleting port d2673de2-37f6-4de1-beee-81535239ad2a {{(pid=91687) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 04:32:51.360785 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-329e70a1-ad79-4874-94a9-86476739067e tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8782892520551'] for port, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:51.432800 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-04c79138-8944-4e13-bdc9-7547ffe2a185 None None] New status for floating IP a73fb90d-bf4b-41bd-a01a-5fdf0d810c60: DOWN {{(pid=91689) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 20 04:32:51.478552 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-329e70a1-ad79-4874-94a9-86476739067e tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1718922'] for port, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:51.478826 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-329e70a1-ad79-4874-94a9-86476739067e tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:51.598494 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [None req-329e70a1-ad79-4874-94a9-86476739067e tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Calling delete_port for d2673de2-37f6-4de1-beee-81535239ad2a owned by network:floatingip {{(pid=91687) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 04:32:51.727907 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-329e70a1-ad79-4874-94a9-86476739067e tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8782892522936', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8782892108804', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4162192'] for port, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:51.731834 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-f86d71df-99fb-4a16-904e-60c0046a6848 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:32:51.774072 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-329e70a1-ad79-4874-94a9-86476739067e tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Pushing event deleted for resources: {'Port': ['ID=d2673de2-37f6-4de1-beee-81535239ad2a,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:32:51.777470 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-329e70a1-ad79-4874-94a9-86476739067e tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:32:51.870220 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-329e70a1-ad79-4874-94a9-86476739067e tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks [] for floatingip, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:51.884534 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-329e70a1-ad79-4874-94a9-86476739067e tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for floatingip, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:51.885683 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-329e70a1-ad79-4874-94a9-86476739067e tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] 10.222.0.71 "DELETE /v2.0/floatingips/a73fb90d-bf4b-41bd-a01a-5fdf0d810c60 HTTP/1.1" status: 204  len: 168 time: 0.7478037
May 20 04:32:52.382774 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 1cc416ab-7f60-449e-8b91-113111ff4aa3 no longer exists at agent hyperv_hv-cinder-79091 {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 04:32:52.425864 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] No Port match for: 1cc416ab-7f60-449e-8b91-113111ff4aa3 {{(pid=91688) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 04:32:52.426391 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 1cc416ab-7f60-449e-8b91-113111ff4aa3 not bound to the agent host hv-cinder-79091 {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 04:32:54.850484 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 46190) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:32:55.671174 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-d7951ee4-82af-4f84-bffc-a49032236fb9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1716300'] for router_interface, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:56.101886 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [None req-d7951ee4-82af-4f84-bffc-a49032236fb9 admin admin] Deleting port aad390e4-f9e2-4bbe-9e64-7b390cc7f3b3 {{(pid=91687) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 04:32:56.102645 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-d7951ee4-82af-4f84-bffc-a49032236fb9 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8782892520551'] for port, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:56.224376 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [None req-d7951ee4-82af-4f84-bffc-a49032236fb9 admin admin] For port aad390e4-f9e2-4bbe-9e64-7b390cc7f3b3, host dv-cinder-790910-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=aad390e4-f9e2-4bbe-9e64-7b390cc7f3b3,segment=NetworkSegment(9521f383-6017-4b4d-9f47-cff4ed54cb57),segment_id=9521f383-6017-4b4d-9f47-cff4ed54cb57)] {{(pid=91687) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:32:56.224709 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-d7951ee4-82af-4f84-bffc-a49032236fb9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1718922'] for port, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:56.356862 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [None req-d7951ee4-82af-4f84-bffc-a49032236fb9 admin admin] Calling delete_port for aad390e4-f9e2-4bbe-9e64-7b390cc7f3b3 owned by network:router_interface {{(pid=91687) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 04:32:56.523257 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-d7951ee4-82af-4f84-bffc-a49032236fb9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8782892522936', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8782892108804', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4162192'] for port, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:56.527455 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-cc1c2c2f-505a-46d5-be79-e4ba34ae4dcb tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:32:56.573637 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7951ee4-82af-4f84-bffc-a49032236fb9 admin admin] Pushing event deleted for resources: {'Port': ['ID=aad390e4-f9e2-4bbe-9e64-7b390cc7f3b3,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:32:56.576807 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-d7951ee4-82af-4f84-bffc-a49032236fb9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:32:56.939594 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-d7951ee4-82af-4f84-bffc-a49032236fb9 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1781439', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1717212'] for router_interface, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:57.317583 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d7951ee4-82af-4f84-bffc-a49032236fb9 admin admin] Router 34eeb764-2607-4d9f-96c4-89598b702500 has already been hosted by L3 agent 02733fc0-fc9c-4e29-bc03-c27a792d539d {{(pid=91687) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 04:32:57.497907 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d7951ee4-82af-4f84-bffc-a49032236fb9 admin admin] Notify agent at l3_agent.dv-cinder-790910-4-iscsi the message routers_updated {{(pid=91687) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 04:32:57.506583 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fdc114c8-1885-4871-bf8d-be9756f54aad None None] Sync routers for ids ['34eeb764-2607-4d9f-96c4-89598b702500'] in dv-cinder-790910-4-iscsi {{(pid=91688) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 04:32:57.511216 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-d7951ee4-82af-4f84-bffc-a49032236fb9 admin admin] 10.222.0.71 "PUT /v2.0/routers/34eeb764-2607-4d9f-96c4-89598b702500/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.6594379
May 20 04:32:57.513635 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 46196) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:32:57.523424 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fdc114c8-1885-4871-bf8d-be9756f54aad None None] Routers {'34eeb764-2607-4d9f-96c4-89598b702500'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91688) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:32:57.524031 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-fdc114c8-1885-4871-bf8d-be9756f54aad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced18a4a60>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:32:33Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['34eeb764-2607-4d9f-96c4-89598b702500'], 'active': True} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:32:57.684185 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-f29a8234-cedd-4b10-8dc8-16111b616d5d admin admin] Notify callbacks [] for router, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:57.695867 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvr_db [None req-fdc114c8-1885-4871-bf8d-be9756f54aad None None] Set router 34eeb764-2607-4d9f-96c4-89598b702500 gateway port host: dv-cinder-790910-4-iscsi {{(pid=91688) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:32:57.854392 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-f29a8234-cedd-4b10-8dc8-16111b616d5d admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:57.927849 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [None req-f29a8234-cedd-4b10-8dc8-16111b616d5d admin admin] Deleting port 16508f6e-35a3-4301-9018-78e099969b00 {{(pid=91687) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 04:32:57.928224 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-f29a8234-cedd-4b10-8dc8-16111b616d5d admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8782892520551'] for port, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:57.973396 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-fdc114c8-1885-4871-bf8d-be9756f54aad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced18a4a60>, [{'id': '34eeb764-2607-4d9f-96c4-89598b702500', 'name': 'tempest-AttachVolumeShelveTestJSON-1895235554-router', 'tenant_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.72'}], 'enable_snat': True}, 'gw_port_id': '16508f6e-35a3-4301-9018-78e099969b00', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:21:10Z', 'updated_at': '2021-05-20T04:32:56Z', 'revision_number': 5, 'project_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'gw_port': {'id': '16508f6e-35a3-4301-9018-78e099969b00', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:e3:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '34eeb764-2607-4d9f-96c4-89598b702500', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:21:12Z', 'updated_at': '2021-05-20T04:21:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi'}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:32:57.977243 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fdc114c8-1885-4871-bf8d-be9756f54aad None None] Checking router: 34eeb764-2607-4d9f-96c4-89598b702500 for host: dv-cinder-790910-4-iscsi {{(pid=91688) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 04:32:57.985695 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fdc114c8-1885-4871-bf8d-be9756f54aad None None] Routers {'34eeb764-2607-4d9f-96c4-89598b702500'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91688) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:32:57.986283 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-fdc114c8-1885-4871-bf8d-be9756f54aad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced18a4a60>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:32:33Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['34eeb764-2607-4d9f-96c4-89598b702500'], 'active': True} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:32:58.051631 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [None req-f29a8234-cedd-4b10-8dc8-16111b616d5d admin admin] For port 16508f6e-35a3-4301-9018-78e099969b00, host dv-cinder-790910-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=16508f6e-35a3-4301-9018-78e099969b00,segment=NetworkSegment(8df49ec5-3fb9-4715-bc9a-f4019a6b55f9),segment_id=8df49ec5-3fb9-4715-bc9a-f4019a6b55f9)] {{(pid=91687) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:32:58.051946 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-f29a8234-cedd-4b10-8dc8-16111b616d5d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1718922'] for port, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:58.183237 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvr_db [None req-fdc114c8-1885-4871-bf8d-be9756f54aad None None] Set router 34eeb764-2607-4d9f-96c4-89598b702500 gateway port host: None {{(pid=91688) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:32:58.286549 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [None req-f29a8234-cedd-4b10-8dc8-16111b616d5d admin admin] Calling delete_port for 16508f6e-35a3-4301-9018-78e099969b00 owned by network:router_gateway {{(pid=91687) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 04:32:58.289336 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-fdc114c8-1885-4871-bf8d-be9756f54aad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced18a4a60>, [{'id': '34eeb764-2607-4d9f-96c4-89598b702500', 'name': 'tempest-AttachVolumeShelveTestJSON-1895235554-router', 'tenant_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:21:10Z', 'updated_at': '2021-05-20T04:32:57Z', 'revision_number': 6, 'project_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'gw_port_host': None}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:32:58.293375 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fdc114c8-1885-4871-bf8d-be9756f54aad None None] The sync data for ids ['34eeb764-2607-4d9f-96c4-89598b702500'] in dv-cinder-790910-4-iscsi is: [{'id': '34eeb764-2607-4d9f-96c4-89598b702500', 'name': 'tempest-AttachVolumeShelveTestJSON-1895235554-router', 'tenant_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:21:10Z', 'updated_at': '2021-05-20T04:32:57Z', 'revision_number': 6, 'project_id': 'ef3bec4745b14484ac8e21cd16cbd11d', 'gw_port_host': None}] {{(pid=91688) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 04:32:58.439468 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-f29a8234-cedd-4b10-8dc8-16111b616d5d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8782892522936', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8782892108804', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4162192'] for port, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:58.443020 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-dfe6a5e0-49de-4181-a0a4-7051dafa56dd service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:32:58.489466 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f29a8234-cedd-4b10-8dc8-16111b616d5d admin admin] Pushing event deleted for resources: {'Port': ['ID=16508f6e-35a3-4301-9018-78e099969b00,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:32:58.492669 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-f29a8234-cedd-4b10-8dc8-16111b616d5d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:32:58.582396 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-f29a8234-cedd-4b10-8dc8-16111b616d5d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1714023'] for router_gateway, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:58.755987 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-f29a8234-cedd-4b10-8dc8-16111b616d5d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1796572', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-6237'] for router, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:58.758335 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-f29a8234-cedd-4b10-8dc8-16111b616d5d admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:58.792914 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-f29a8234-cedd-4b10-8dc8-16111b616d5d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-1712688'] for router, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:58.793698 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f29a8234-cedd-4b10-8dc8-16111b616d5d admin admin] Fanout notify agent at l3_agent the message router_deleted on router 34eeb764-2607-4d9f-96c4-89598b702500 {{(pid=91687) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 20 04:32:58.809276 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-f29a8234-cedd-4b10-8dc8-16111b616d5d admin admin] Notify callbacks [] for router, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:58.810419 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-f29a8234-cedd-4b10-8dc8-16111b616d5d admin admin] 10.222.0.71 "DELETE /v2.0/routers/34eeb764-2607-4d9f-96c4-89598b702500 HTTP/1.1" status: 204  len: 168 time: 1.2959127
May 20 04:32:58.814044 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 46202) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:32:58.874372 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.db_base_plugin_v2 [None req-0f1e4455-645b-42c2-afc3-e024ac3c96a7 admin admin] Deleting subnet 06f38702-3d3c-4e25-8f84-85483d1ddf28 {{(pid=91687) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 20 04:32:58.877399 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-0f1e4455-645b-42c2-afc3-e024ac3c96a7 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:58.931928 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-0f1e4455-645b-42c2-afc3-e024ac3c96a7 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-936634'] for subnet, precommit_delete_associations {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:59.013667 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-0f1e4455-645b-42c2-afc3-e024ac3c96a7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1504133'] for subnet, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:59.141993 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 16508f6e-35a3-4301-9018-78e099969b00 no longer exists at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 04:32:59.177289 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] No Port match for: 16508f6e-35a3-4301-9018-78e099969b00 {{(pid=91688) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 04:32:59.177956 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 16508f6e-35a3-4301-9018-78e099969b00 not bound to the agent host dv-cinder-790910-4-iscsi {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 04:32:59.178635 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device aad390e4-f9e2-4bbe-9e64-7b390cc7f3b3 no longer exists at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 04:32:59.216445 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] No Port match for: aad390e4-f9e2-4bbe-9e64-7b390cc7f3b3 {{(pid=91688) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 04:32:59.216870 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device aad390e4-f9e2-4bbe-9e64-7b390cc7f3b3 not bound to the agent host dv-cinder-790910-4-iscsi {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 04:32:59.265621 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-0f1e4455-645b-42c2-afc3-e024ac3c96a7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1504178', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-255887', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-4160847', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-692244'] for subnet, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:59.270723 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:32:59.310850 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f1e4455-645b-42c2-afc3-e024ac3c96a7 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=06f38702-3d3c-4e25-8f84-85483d1ddf28,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:32:59.312765 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-0f1e4455-645b-42c2-afc3-e024ac3c96a7 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for subnet, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:59.315280 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-0f1e4455-645b-42c2-afc3-e024ac3c96a7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:32:59.317644 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9bef3ecd-5d5b-4058-bf33-bc37084fc3e7 None None] Network 21794e86-fda7-40a6-a5a8-db117c7eeb9d requested from dv-cinder-790910-4-iscsi {{(pid=91688) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 04:32:59.319610 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-0f1e4455-645b-42c2-afc3-e024ac3c96a7 admin admin] 10.222.0.71 "DELETE /v2.0/subnets/06f38702-3d3c-4e25-8f84-85483d1ddf28 HTTP/1.1" status: 204  len: 168 time: 0.5045409
May 20 04:32:59.322230 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 46206) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:32:59.437496 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-715bd72c-17ef-47f0-8718-fa2039087606 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-593149'] for network, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:59.508566 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [None req-715bd72c-17ef-47f0-8718-fa2039087606 admin admin] Deleting port 37c13c83-3c6b-4c47-8428-d4af18562753 {{(pid=91687) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 04:32:59.509163 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-715bd72c-17ef-47f0-8718-fa2039087606 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8782892520551'] for port, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:59.566126 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aab6e702-59a8-4a15-a61c-e47cf96127f8 None None] DHCP port deletion for 21794e86-fda7-40a6-a5a8-db117c7eeb9d request from dv-cinder-790910-4-iscsi {{(pid=91688) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
May 20 04:32:59.609878 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [None req-715bd72c-17ef-47f0-8718-fa2039087606 admin admin] For port 37c13c83-3c6b-4c47-8428-d4af18562753, host dv-cinder-790910-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=37c13c83-3c6b-4c47-8428-d4af18562753,segment=NetworkSegment(9521f383-6017-4b4d-9f47-cff4ed54cb57),segment_id=9521f383-6017-4b4d-9f47-cff4ed54cb57)] {{(pid=91687) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:32:59.610416 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-715bd72c-17ef-47f0-8718-fa2039087606 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1718922'] for port, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:59.633650 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-aab6e702-59a8-4a15-a61c-e47cf96127f8 None None] Deleting port 37c13c83-3c6b-4c47-8428-d4af18562753 {{(pid=91688) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 04:32:59.634033 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-aab6e702-59a8-4a15-a61c-e47cf96127f8 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8782892520551'] for port, before_delete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:59.729026 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-aab6e702-59a8-4a15-a61c-e47cf96127f8 None None] For port 37c13c83-3c6b-4c47-8428-d4af18562753, host dv-cinder-790910-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=37c13c83-3c6b-4c47-8428-d4af18562753,segment=NetworkSegment(9521f383-6017-4b4d-9f47-cff4ed54cb57),segment_id=9521f383-6017-4b4d-9f47-cff4ed54cb57)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:32:59.729302 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-aab6e702-59a8-4a15-a61c-e47cf96127f8 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1718922'] for port, precommit_delete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:59.730670 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [None req-715bd72c-17ef-47f0-8718-fa2039087606 admin admin] Calling delete_port for 37c13c83-3c6b-4c47-8428-d4af18562753 owned by network:dhcp {{(pid=91687) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 04:32:59.777895 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-715bd72c-17ef-47f0-8718-fa2039087606 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8782892522936', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8782892108804', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4162192'] for port, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:59.782640 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-67c18f03-7e64-4ce5-a09f-77aa4c01ab46 tempest-VolumesNegativeTest-245197447 tempest-VolumesNegativeTest-245197447-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:32:59.857544 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-aab6e702-59a8-4a15-a61c-e47cf96127f8 None None] Calling delete_port for 37c13c83-3c6b-4c47-8428-d4af18562753 owned by network:dhcp {{(pid=91688) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 04:32:59.877634 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-95e0d6db-23da-4f70-900f-f473668ff7ec None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:59.915610 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-aab6e702-59a8-4a15-a61c-e47cf96127f8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8782892522936', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8782892108804'] for port, after_delete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:32:59.919448 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-5d1fad46-8d7f-4005-9e5c-f7fa607c792a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:32:59.925744 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-715bd72c-17ef-47f0-8718-fa2039087606 admin admin] Pushing event deleted for resources: {'Port': ['ID=37c13c83-3c6b-4c47-8428-d4af18562753,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:32:59.927541 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.l3_dvrscheduler_db [None req-715bd72c-17ef-47f0-8718-fa2039087606 admin admin] No DVR routers for this DVR port 37c13c83-3c6b-4c47-8428-d4af18562753 on host dv-cinder-790910-4-iscsi {{(pid=91687) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 04:32:59.929123 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-715bd72c-17ef-47f0-8718-fa2039087606 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.146s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:32:59.961137 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aab6e702-59a8-4a15-a61c-e47cf96127f8 None None] Pushing event deleted for resources: {'Port': ['ID=37c13c83-3c6b-4c47-8428-d4af18562753,revision_number=None']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:32:59.967191 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aab6e702-59a8-4a15-a61c-e47cf96127f8 None None] No DVR routers for this DVR port 37c13c83-3c6b-4c47-8428-d4af18562753 on host dv-cinder-790910-4-iscsi {{(pid=91688) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 04:32:59.972069 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aab6e702-59a8-4a15-a61c-e47cf96127f8 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:32:59.972440 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aab6e702-59a8-4a15-a61c-e47cf96127f8 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:32:59.972773 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aab6e702-59a8-4a15-a61c-e47cf96127f8 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:32:59.973133 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aab6e702-59a8-4a15-a61c-e47cf96127f8 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:32:59.973458 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aab6e702-59a8-4a15-a61c-e47cf96127f8 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:32:59.973783 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aab6e702-59a8-4a15-a61c-e47cf96127f8 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:32:59.974087 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aab6e702-59a8-4a15-a61c-e47cf96127f8 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:32:59.974410 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aab6e702-59a8-4a15-a61c-e47cf96127f8 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:32:59.974724 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aab6e702-59a8-4a15-a61c-e47cf96127f8 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:32:59.975028 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aab6e702-59a8-4a15-a61c-e47cf96127f8 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:32:59.975344 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aab6e702-59a8-4a15-a61c-e47cf96127f8 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:32:59.976142 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aab6e702-59a8-4a15-a61c-e47cf96127f8 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:32:59.979853 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-aab6e702-59a8-4a15-a61c-e47cf96127f8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:33:00.042951 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-715bd72c-17ef-47f0-8718-fa2039087606 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1505550', 'neutron.services.segments.db._delete_segments_for_network-8782892550274'] for network, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:00.055959 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.services.segments.db [None req-715bd72c-17ef-47f0-8718-fa2039087606 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fced164e0a0>,) {'filters': {'network_id': ['21794e86-fda7-40a6-a5a8-db117c7eeb9d']}} {{(pid=91687) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:33:00.068462 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.services.segments.db [None req-715bd72c-17ef-47f0-8718-fa2039087606 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fced164e0a0>, '9521f383-6017-4b4d-9f47-cff4ed54cb57') {'for_net_delete': True} {{(pid=91687) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:33:00.068758 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.services.segments.db [None req-715bd72c-17ef-47f0-8718-fa2039087606 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fced164e0a0>, '9521f383-6017-4b4d-9f47-cff4ed54cb57') {} {{(pid=91687) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:33:00.080101 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-715bd72c-17ef-47f0-8718-fa2039087606 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8782892560523', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-936621'] for segment, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:00.095869 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-715bd72c-17ef-47f0-8718-fa2039087606 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1501910'] for segment, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:00.102142 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-715bd72c-17ef-47f0-8718-fa2039087606 admin admin] Releasing vlan 864 on physical network physnet1 to pool {{(pid=91687) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 20 04:33:00.102518 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-715bd72c-17ef-47f0-8718-fa2039087606 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1501910', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-4162285'] for segment, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:00.115257 dv-cinder-790910-4-iscsi neutron-server[91687]: Traceback (most recent call last):
May 20 04:33:00.115257 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 20 04:33:00.115257 dv-cinder-790910-4-iscsi neutron-server[91687]:     timer()
May 20 04:33:00.115257 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 20 04:33:00.115257 dv-cinder-790910-4-iscsi neutron-server[91687]:     cb(*args, **kw)
May 20 04:33:00.115257 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 20 04:33:00.115257 dv-cinder-790910-4-iscsi neutron-server[91687]:     return func(*args, **kwargs)
May 20 04:33:00.115257 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 20 04:33:00.115257 dv-cinder-790910-4-iscsi neutron-server[91687]:     self._notify()
May 20 04:33:00.115257 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 20 04:33:00.115257 dv-cinder-790910-4-iscsi neutron-server[91687]:     self.callback(batched_events)
May 20 04:33:00.115257 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 20 04:33:00.115257 dv-cinder-790910-4-iscsi neutron-server[91687]:     event.method(event)
May 20 04:33:00.115257 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 20 04:33:00.115257 dv-cinder-790910-4-iscsi neutron-server[91687]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 20 04:33:00.115257 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 20 04:33:00.115257 dv-cinder-790910-4-iscsi neutron-server[91687]:     aggregate_uuid = self.p_client.list_aggregates(
May 20 04:33:00.115257 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 20 04:33:00.115257 dv-cinder-790910-4-iscsi neutron-server[91687]:     return f(self, *a, **k)
May 20 04:33:00.115257 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 20 04:33:00.115257 dv-cinder-790910-4-iscsi neutron-server[91687]:     return self._get(url).json()
May 20 04:33:00.115257 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 20 04:33:00.115257 dv-cinder-790910-4-iscsi neutron-server[91687]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 20 04:33:00.115257 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 20 04:33:00.115257 dv-cinder-790910-4-iscsi neutron-server[91687]:     return self.request(url, 'GET', **kwargs)
May 20 04:33:00.115257 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 20 04:33:00.115257 dv-cinder-790910-4-iscsi neutron-server[91687]:     base_url = self.get_endpoint(auth, allow=allow,
May 20 04:33:00.115257 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 20 04:33:00.115257 dv-cinder-790910-4-iscsi neutron-server[91687]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 20 04:33:00.115257 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 20 04:33:00.115257 dv-cinder-790910-4-iscsi neutron-server[91687]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 20 04:33:00.115257 dv-cinder-790910-4-iscsi neutron-server[91687]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 20 04:33:00.196928 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-715bd72c-17ef-47f0-8718-fa2039087606 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1505543', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1590664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1781430', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1713996'] for network, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:00.200637 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-59487d47-2e70-405a-a7ac-5cb753cf58c0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:33:00.213573 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-715bd72c-17ef-47f0-8718-fa2039087606 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for network, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:00.223815 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-715bd72c-17ef-47f0-8718-fa2039087606 admin admin] Pushing event deleted for resources: {'Network': ['ID=21794e86-fda7-40a6-a5a8-db117c7eeb9d,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:33:00.226999 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-715bd72c-17ef-47f0-8718-fa2039087606 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:33:00.239367 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-715bd72c-17ef-47f0-8718-fa2039087606 admin admin] 10.222.0.71 "DELETE /v2.0/networks/21794e86-fda7-40a6-a5a8-db117c7eeb9d HTTP/1.1" status: 204  len: 168 time: 0.9162228
May 20 04:33:00.363543 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 46212) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:33:00.415548 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-62abaecd-cc8d-44eb-9149-9dda78dac3d8 admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=ef3bec4745b14484ac8e21cd16cbd11d&name=default HTTP/1.1" status: 200  len: 2975 time: 0.0504732
May 20 04:33:00.418205 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 46216) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:33:00.478099 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-163f6ee6-c4e7-4141-b31a-9c48fa4a5182 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:00.505114 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-163f6ee6-c4e7-4141-b31a-9c48fa4a5182 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:00.563098 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-163f6ee6-c4e7-4141-b31a-9c48fa4a5182 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:00.568074 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-8e411f1f-6d21-4191-b98f-035f54eb780e tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:33:00.586936 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-163f6ee6-c4e7-4141-b31a-9c48fa4a5182 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3964c773-44b6-48ed-a264-0a09ce1eab7e,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:33:00.590887 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-163f6ee6-c4e7-4141-b31a-9c48fa4a5182 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:33:00.593647 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-163f6ee6-c4e7-4141-b31a-9c48fa4a5182 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:00.594827 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-163f6ee6-c4e7-4141-b31a-9c48fa4a5182 admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/3964c773-44b6-48ed-a264-0a09ce1eab7e HTTP/1.1" status: 204  len: 168 time: 0.1757455
May 20 04:33:01.141303 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 37c13c83-3c6b-4c47-8428-d4af18562753 no longer exists at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 04:33:01.181163 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] No Port match for: 37c13c83-3c6b-4c47-8428-d4af18562753 {{(pid=91688) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 04:33:01.181524 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 37c13c83-3c6b-4c47-8428-d4af18562753 not bound to the agent host dv-cinder-790910-4-iscsi {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 04:33:01.383249 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 46240) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:33:01.492046 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.v2.base [None req-a846cc65-8062-4569-817c-45ea968db02b admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeTestJSON-1012860640-network', 'tenant_id': '2035da004a584b4ea1f637e593596cd7'}} {{(pid=91686) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:33:01.496933 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-a846cc65-8062-4569-817c-45ea968db02b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:33:01.500992 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-a846cc65-8062-4569-817c-45ea968db02b admin admin] Usage tracker for resource:network and tenant:2035da004a584b4ea1f637e593596cd7 is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:33:01.504292 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-a846cc65-8062-4569-817c-45ea968db02b admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:33:01.511266 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-a846cc65-8062-4569-817c-45ea968db02b admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:33:01.521724 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a846cc65-8062-4569-817c-45ea968db02b admin admin] Made reservation on behalf of 2035da004a584b4ea1f637e593596cd7 for: {'network': 1} {{(pid=91686) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 04:33:01.524434 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-a846cc65-8062-4569-817c-45ea968db02b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-578118'] for network, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:01.537159 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-a846cc65-8062-4569-817c-45ea968db02b admin admin] Notify callbacks [] for security_group, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:01.552136 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-a846cc65-8062-4569-817c-45ea968db02b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:33:01.556164 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-a846cc65-8062-4569-817c-45ea968db02b admin admin] Usage tracker for resource:security_group_rule and tenant:2035da004a584b4ea1f637e593596cd7 is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:33:01.559199 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-a846cc65-8062-4569-817c-45ea968db02b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:33:01.565110 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-a846cc65-8062-4569-817c-45ea968db02b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:33:01.654385 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-a846cc65-8062-4569-817c-45ea968db02b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:01.659766 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-a846cc65-8062-4569-817c-45ea968db02b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:01.663066 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-5260e29b-4e55-446d-ae40-b76f04444937 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:33:01.695486 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a846cc65-8062-4569-817c-45ea968db02b admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 871}  {{(pid=91686) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 20 04:33:01.703962 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a846cc65-8062-4569-817c-45ea968db02b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8f7712f6-fe75-4f69-80ea-9d9af82cf1a5,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:33:01.713970 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a846cc65-8062-4569-817c-45ea968db02b admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:33:01.714372 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a846cc65-8062-4569-817c-45ea968db02b admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:33:01.714762 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a846cc65-8062-4569-817c-45ea968db02b admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:33:01.715118 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a846cc65-8062-4569-817c-45ea968db02b admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:33:01.715477 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a846cc65-8062-4569-817c-45ea968db02b admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:33:01.715856 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a846cc65-8062-4569-817c-45ea968db02b admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:33:01.716189 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a846cc65-8062-4569-817c-45ea968db02b admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:33:01.716544 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a846cc65-8062-4569-817c-45ea968db02b admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:33:01.716904 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a846cc65-8062-4569-817c-45ea968db02b admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:33:01.717282 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a846cc65-8062-4569-817c-45ea968db02b admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:33:01.717634 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a846cc65-8062-4569-817c-45ea968db02b admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:33:01.718022 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a846cc65-8062-4569-817c-45ea968db02b admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:33:01.722082 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-a846cc65-8062-4569-817c-45ea968db02b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:33:01.723405 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-a846cc65-8062-4569-817c-45ea968db02b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1501910'] for segment, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:01.723751 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.db.segments_db [None req-a846cc65-8062-4569-817c-45ea968db02b admin admin] Added segment 12af0450-da1a-4552-85ca-9149ff5b7f01 of type vlan for network 4c58b50e-1091-40dd-b4fa-ff2da87b1475
May 20 04:33:01.753121 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-a846cc65-8062-4569-817c-45ea968db02b admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8782892092784'] for network, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:01.788599 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-a846cc65-8062-4569-817c-45ea968db02b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1590664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1781430'] for network, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:01.790034 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a846cc65-8062-4569-817c-45ea968db02b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:33:01.790843 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-a846cc65-8062-4569-817c-45ea968db02b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for network, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:01.794158 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:33:01.896729 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-a846cc65-8062-4569-817c-45ea968db02b admin admin] 10.222.0.71 "POST /v2.0/networks HTTP/1.1" status: 201  len: 884 time: 0.5121827
May 20 04:33:01.897485 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a846cc65-8062-4569-817c-45ea968db02b admin admin] Pushing event updated for resources: {'Network': ['ID=4c58b50e-1091-40dd-b4fa-ff2da87b1475,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:33:01.899689 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 46246) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:33:01.903079 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-a846cc65-8062-4569-817c-45ea968db02b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:33:01.906615 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.v2.base [None req-ea0b8d87-849c-47a9-bed7-a1349c764652 admin admin] Request body: {'subnet': {'network_id': '4c58b50e-1091-40dd-b4fa-ff2da87b1475', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeTestJSON-1012860640-subnet', 'tenant_id': '2035da004a584b4ea1f637e593596cd7', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=91686) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:33:01.909010 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Network 4c58b50e-1091-40dd-b4fa-ff2da87b1475 details requested by agent ovs-agent-dv-cinder-790910-4-iscsi with host dv-cinder-790910-4-iscsi {{(pid=91688) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 20 04:33:01.911858 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-ea0b8d87-849c-47a9-bed7-a1349c764652 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:33:01.916216 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-ea0b8d87-849c-47a9-bed7-a1349c764652 admin admin] Usage tracker for resource:subnet and tenant:2035da004a584b4ea1f637e593596cd7 is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:33:01.919286 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-ea0b8d87-849c-47a9-bed7-a1349c764652 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:33:01.925208 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-ea0b8d87-849c-47a9-bed7-a1349c764652 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:33:01.937527 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ea0b8d87-849c-47a9-bed7-a1349c764652 admin admin] Made reservation on behalf of 2035da004a584b4ea1f637e593596cd7 for: {'subnet': 1} {{(pid=91686) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 04:33:01.939888 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-ea0b8d87-849c-47a9-bed7-a1349c764652 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-2442182'] for subnet, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:02.437549 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-ea0b8d87-849c-47a9-bed7-a1349c764652 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-255887', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2114700', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-2442228'] for subnet, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:02.441290 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-9be9b252-4968-4c1c-9254-0e7f5f5a0dba admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:33:02.511034 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea0b8d87-849c-47a9-bed7-a1349c764652 admin admin] Pushing event updated for resources: {'Subnet': ['ID=24a65302-95b2-4d66-9d40-a9959babbe40,revision_number=0']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:33:02.514854 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-ea0b8d87-849c-47a9-bed7-a1349c764652 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:33:02.521940 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ea0b8d87-849c-47a9-bed7-a1349c764652 admin admin] Checking segment: {'id': '12af0450-da1a-4552-85ca-9149ff5b7f01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 871, 'network_id': '4c58b50e-1091-40dd-b4fa-ff2da87b1475'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91686) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:33:02.522274 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ea0b8d87-849c-47a9-bed7-a1349c764652 admin admin] Network hostable DHCP agents. Network: 4c58b50e-1091-40dd-b4fa-ff2da87b1475, hostable agents: ['36d27813-c368-4fd7-ae26-0f662e0a96fd'], hosted agents: [] {{(pid=91686) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 20 04:33:02.542906 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ea0b8d87-849c-47a9-bed7-a1349c764652 admin admin] Network 4c58b50e-1091-40dd-b4fa-ff2da87b1475 is scheduled to be hosted by DHCP agent 36d27813-c368-4fd7-ae26-0f662e0a96fd with binding_index 1 {{(pid=91686) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 20 04:33:02.557166 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.base_scheduler [None req-ea0b8d87-849c-47a9-bed7-a1349c764652 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-790910-4-iscsi, 4c58b50e-1091-40dd-b4fa-ff2da87b1475) {{(pid=91686) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:33:02.565891 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ea0b8d87-849c-47a9-bed7-a1349c764652 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:33:02.567006 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-ea0b8d87-849c-47a9-bed7-a1349c764652 admin admin] Notify callbacks [] for subnet, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:02.570678 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bd42abcf-3faa-4176-8a7c-4cff448cee7d None None] Network 4c58b50e-1091-40dd-b4fa-ff2da87b1475 requested from dv-cinder-790910-4-iscsi {{(pid=91688) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 04:33:02.589501 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-ea0b8d87-849c-47a9-bed7-a1349c764652 admin admin] 10.222.0.71 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 847 time: 0.6884692
May 20 04:33:02.589951 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:02.592261 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 46250) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:33:02.597783 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [None req-4c5769b0-9f98-4a84-8344-951b55f2edaa admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeTestJSON-1012860640-router', 'tenant_id': '2035da004a584b4ea1f637e593596cd7', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90'}}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:33:02.603855 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-4c5769b0-9f98-4a84-8344-951b55f2edaa admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:33:02.608132 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-4c5769b0-9f98-4a84-8344-951b55f2edaa admin admin] Usage tracker for resource:router and tenant:2035da004a584b4ea1f637e593596cd7 is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:33:02.611199 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-4c5769b0-9f98-4a84-8344-951b55f2edaa admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:33:02.617198 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-4c5769b0-9f98-4a84-8344-951b55f2edaa admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:33:02.629965 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-4c5769b0-9f98-4a84-8344-951b55f2edaa admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1796465', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-6255'] for router, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:02.631585 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-4c5769b0-9f98-4a84-8344-951b55f2edaa admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1713009', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1713968', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1590966', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-6244'] for router, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:02.647019 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-4c5769b0-9f98-4a84-8344-951b55f2edaa admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:02.761538 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-4e8f7e61-e0e6-442f-97af-15d0d47ac052 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:02.814224 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-46ba1de9-de0c-472d-bb51-bd40ff197921 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpfbdc8e9b-5136-5478-8aa8-b0b6b9be0f90-4c58b50e-1091-40dd-b4fa-ff2da87b1475', 'network_id': '4c58b50e-1091-40dd-b4fa-ff2da87b1475', 'tenant_id': '2035da004a584b4ea1f637e593596cd7', 'fixed_ips': [{'subnet_id': '24a65302-95b2-4d66-9d40-a9959babbe40'}]}} from dv-cinder-790910-4-iscsi. {{(pid=91688) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 20 04:33:02.815260 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-46ba1de9-de0c-472d-bb51-bd40ff197921 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_create {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:02.921064 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-4c5769b0-9f98-4a84-8344-951b55f2edaa admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1713977', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1796355', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-6218'] for router, precommit_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:03.015116 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.db_base_plugin_common [None req-46ba1de9-de0c-472d-bb51-bd40ff197921 None None] Allocated IP 172.20.0.2 (4c58b50e-1091-40dd-b4fa-ff2da87b1475/24a65302-95b2-4d66-9d40-a9959babbe40/afceb3be-dac0-4a64-8295-7d082bff4ea3) {{(pid=91688) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 04:33:03.219445 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-46ba1de9-de0c-472d-bb51-bd40ff197921 None None] Notify callbacks [] for port, precommit_create {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:03.230129 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-4c5769b0-9f98-4a84-8344-951b55f2edaa admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:03.230415 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-46ba1de9-de0c-472d-bb51-bd40ff197921 None None] Transition to ACTIVE for port object afceb3be-dac0-4a64-8295-7d082bff4ea3 will not be triggered until provisioned by entity L2. {{(pid=91688) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:33:03.248408 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-46ba1de9-de0c-472d-bb51-bd40ff197921 None None] Transition to ACTIVE for port object afceb3be-dac0-4a64-8295-7d082bff4ea3 will not be triggered until provisioned by entity DHCP. {{(pid=91688) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:33:03.254574 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-46ba1de9-de0c-472d-bb51-bd40ff197921 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8782892106231'] for port, after_create {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:03.259157 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:33:03.262965 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-4c5769b0-9f98-4a84-8344-951b55f2edaa admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:03.320910 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-46ba1de9-de0c-472d-bb51-bd40ff197921 None None] Network 4c58b50e-1091-40dd-b4fa-ff2da87b1475 is already hosted by enough agents. {{(pid=91688) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:33:03.323701 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.scheduler.base_scheduler [None req-46ba1de9-de0c-472d-bb51-bd40ff197921 None None] Resources bound (agent type, host, resource id):  {{(pid=91688) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:33:03.327367 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-46ba1de9-de0c-472d-bb51-bd40ff197921 None None] Received port after_create {{(pid=91688) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 04:33:03.336221 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46ba1de9-de0c-472d-bb51-bd40ff197921 None None] Pushing event updated for resources: {'Port': ['ID=afceb3be-dac0-4a64-8295-7d082bff4ea3,revision_number=1']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:33:03.362866 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-46ba1de9-de0c-472d-bb51-bd40ff197921 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:33:03.398881 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.db_base_plugin_common [None req-4c5769b0-9f98-4a84-8344-951b55f2edaa admin admin] Allocated IP 172.27.1.206 (aec557db-0c02-4008-8c9f-2efcd7462f90/217f4b55-4415-4d57-8b43-2ff4c8ac8e81/4e511e4a-69db-4a8c-b460-faca77e2e63e) {{(pid=91687) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 04:33:03.419678 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ea4803bd-878f-47d5-9084-1ec41953c9db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:03.435175 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.managers [None req-46ba1de9-de0c-472d-bb51-bd40ff197921 None None] Attempting to bind port afceb3be-dac0-4a64-8295-7d082bff4ea3 on host dv-cinder-790910-4-iscsi for vnic_type normal with profile  {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 04:33:03.435545 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.managers [None req-46ba1de9-de0c-472d-bb51-bd40ff197921 None None] Attempting to bind port afceb3be-dac0-4a64-8295-7d082bff4ea3 by drivers openvswitch,hyperv on host dv-cinder-790910-4-iscsi at level 0 using segments [{'id': '12af0450-da1a-4552-85ca-9149ff5b7f01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 871, 'network_id': '4c58b50e-1091-40dd-b4fa-ff2da87b1475'}] {{(pid=91688) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 04:33:03.435913 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-46ba1de9-de0c-472d-bb51-bd40ff197921 None None] Attempting to bind port afceb3be-dac0-4a64-8295-7d082bff4ea3 on network 4c58b50e-1091-40dd-b4fa-ff2da87b1475 {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:33:03.441357 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-46ba1de9-de0c-472d-bb51-bd40ff197921 None None] Checking agent: {'id': '333121d4-1023-4a33-a54c-f4dd052e1612', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-790910-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 4, 13, 33), 'started_at': datetime.datetime(2021, 5, 20, 4, 14, 3), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 4, 33, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-790910-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 04:33:03.441729 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-46ba1de9-de0c-472d-bb51-bd40ff197921 None None] Checking segment: {'id': '12af0450-da1a-4552-85ca-9149ff5b7f01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 871, 'network_id': '4c58b50e-1091-40dd-b4fa-ff2da87b1475'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91688) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:33:03.442140 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-46ba1de9-de0c-472d-bb51-bd40ff197921 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:03.442534 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-46ba1de9-de0c-472d-bb51-bd40ff197921 None None] Bound using segment: {'id': '12af0450-da1a-4552-85ca-9149ff5b7f01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 871, 'network_id': '4c58b50e-1091-40dd-b4fa-ff2da87b1475'} {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 04:33:03.443002 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.managers [None req-46ba1de9-de0c-472d-bb51-bd40ff197921 None None] Bound port: afceb3be-dac0-4a64-8295-7d082bff4ea3, host: dv-cinder-790910-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '12af0450-da1a-4552-85ca-9149ff5b7f01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 871, 'network_id': '4c58b50e-1091-40dd-b4fa-ff2da87b1475'}}] {{(pid=91688) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 04:33:03.443378 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-46ba1de9-de0c-472d-bb51-bd40ff197921 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:03.532207 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-46ba1de9-de0c-472d-bb51-bd40ff197921 None None] For port afceb3be-dac0-4a64-8295-7d082bff4ea3, host dv-cinder-790910-4-iscsi, cleared binding levels {{(pid=91688) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 04:33:03.535464 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-46ba1de9-de0c-472d-bb51-bd40ff197921 None None] For port afceb3be-dac0-4a64-8295-7d082bff4ea3, host dv-cinder-790910-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=afceb3be-dac0-4a64-8295-7d082bff4ea3,segment=NetworkSegment(12af0450-da1a-4552-85ca-9149ff5b7f01),segment_id=12af0450-da1a-4552-85ca-9149ff5b7f01)] {{(pid=91688) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 04:33:03.539729 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-46ba1de9-de0c-472d-bb51-bd40ff197921 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:03.544464 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:33:03.549428 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-4c5769b0-9f98-4a84-8344-951b55f2edaa admin admin] Notify callbacks [] for port, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:03.579146 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-4c5769b0-9f98-4a84-8344-951b55f2edaa admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8782892106231', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4162192'] for port, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:03.583652 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-c98e48a5-10bf-4c18-b4ed-62242a953862 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:33:03.637474 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46ba1de9-de0c-472d-bb51-bd40ff197921 None None] Pushing event updated for resources: {'Port': ['ID=afceb3be-dac0-4a64-8295-7d082bff4ea3,revision_number=2']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:33:03.642840 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-46ba1de9-de0c-472d-bb51-bd40ff197921 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:33:03.754526 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4c5769b0-9f98-4a84-8344-951b55f2edaa admin admin] Network aec557db-0c02-4008-8c9f-2efcd7462f90 is already hosted by enough agents. {{(pid=91687) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:33:03.757666 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.base_scheduler [None req-4c5769b0-9f98-4a84-8344-951b55f2edaa admin admin] Resources bound (agent type, host, resource id):  {{(pid=91687) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:33:03.761432 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4c5769b0-9f98-4a84-8344-951b55f2edaa admin admin] Received port after_create {{(pid=91687) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 04:33:03.796598 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c5769b0-9f98-4a84-8344-951b55f2edaa admin admin] Pushing event updated for resources: {'Port': ['ID=4e511e4a-69db-4a8c-b460-faca77e2e63e,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:33:03.809118 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-4c5769b0-9f98-4a84-8344-951b55f2edaa admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.224s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:33:04.203927 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-4c5769b0-9f98-4a84-8344-951b55f2edaa admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:04.502874 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e09e4bca-5966-4826-981c-d36cddf1c3e4 None None] Network 4c58b50e-1091-40dd-b4fa-ff2da87b1475 requested from dv-cinder-790910-4-iscsi {{(pid=91688) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 04:33:04.552303 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-4c5769b0-9f98-4a84-8344-951b55f2edaa admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1796474', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1714058'] for router, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:04.612293 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-48533bc5-b944-41dd-b5d3-96510820e6ef None None] Provisioning for port afceb3be-dac0-4a64-8295-7d082bff4ea3 completed by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:33:04.762949 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4c5769b0-9f98-4a84-8344-951b55f2edaa admin admin] Router d4b509ec-ef18-4627-a6cf-1d7baff4e160 is scheduled to L3 agent 02733fc0-fc9c-4e29-bc03-c27a792d539d with binding_index 1 {{(pid=91687) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 20 04:33:04.941065 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4c5769b0-9f98-4a84-8344-951b55f2edaa admin admin] Notify agent at l3_agent.dv-cinder-790910-4-iscsi the message routers_updated {{(pid=91687) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 04:33:04.949772 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d379eaae-bfd6-47a5-8076-690a94fdc68b None None] Sync routers for ids ['d4b509ec-ef18-4627-a6cf-1d7baff4e160'] in dv-cinder-790910-4-iscsi {{(pid=91689) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 04:33:04.960354 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d379eaae-bfd6-47a5-8076-690a94fdc68b None None] Routers {'d4b509ec-ef18-4627-a6cf-1d7baff4e160'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91689) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:33:04.960919 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-d379eaae-bfd6-47a5-8076-690a94fdc68b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced17e6cd0>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:33:03Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['d4b509ec-ef18-4627-a6cf-1d7baff4e160'], 'active': True} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:33:04.969996 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-4c5769b0-9f98-4a84-8344-951b55f2edaa admin admin] Notify callbacks [] for router, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:04.971336 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-4c5769b0-9f98-4a84-8344-951b55f2edaa admin admin] 10.222.0.71 "POST /v2.0/routers HTTP/1.1" status: 201  len: 923 time: 2.3777902
May 20 04:33:04.974115 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 46254) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:33:05.139291 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvr_db [None req-d379eaae-bfd6-47a5-8076-690a94fdc68b None None] Set router d4b509ec-ef18-4627-a6cf-1d7baff4e160 gateway port host: dv-cinder-790910-4-iscsi {{(pid=91689) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:33:05.180662 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device afceb3be-dac0-4a64-8295-7d082bff4ea3 up at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:33:05.244322 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f21320cc-6a25-4ec1-8a32-8b119b35fd55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:05.266280 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning for port afceb3be-dac0-4a64-8295-7d082bff4ea3 completed by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:33:05.272531 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning complete for port afceb3be-dac0-4a64-8295-7d082bff4ea3 triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:33:05.273078 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:05.395495 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:05.427420 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-d379eaae-bfd6-47a5-8076-690a94fdc68b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced17e6cd0>, [{'id': 'd4b509ec-ef18-4627-a6cf-1d7baff4e160', 'name': 'tempest-AttachVolumeTestJSON-1012860640-router', 'tenant_id': '2035da004a584b4ea1f637e593596cd7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.206'}], 'enable_snat': True}, 'gw_port_id': '4e511e4a-69db-4a8c-b460-faca77e2e63e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:33:02Z', 'updated_at': '2021-05-20T04:33:04Z', 'revision_number': 3, 'project_id': '2035da004a584b4ea1f637e593596cd7', 'gw_port': {'id': '4e511e4a-69db-4a8c-b460-faca77e2e63e', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:59:ad', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd4b509ec-ef18-4627-a6cf-1d7baff4e160', 'device_owner': 'network:router_gateway', 'standard_attr_id': 608, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.206', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:33:03Z', 'updated_at': '2021-05-20T04:33:03Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi'}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:33:05.431642 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] For port afceb3be-dac0-4a64-8295-7d082bff4ea3, host dv-cinder-790910-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=afceb3be-dac0-4a64-8295-7d082bff4ea3,segment=NetworkSegment(12af0450-da1a-4552-85ca-9149ff5b7f01),segment_id=12af0450-da1a-4552-85ca-9149ff5b7f01)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:33:05.432136 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d379eaae-bfd6-47a5-8076-690a94fdc68b None None] Checking router: d4b509ec-ef18-4627-a6cf-1d7baff4e160 for host: dv-cinder-790910-4-iscsi {{(pid=91689) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 04:33:05.432642 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d379eaae-bfd6-47a5-8076-690a94fdc68b None None] Updating router d4b509ec-ef18-4627-a6cf-1d7baff4e160 port 4e511e4a-69db-4a8c-b460-faca77e2e63e binding host dv-cinder-790910-4-iscsi {{(pid=91689) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 20 04:33:05.438630 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:05.441074 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:33:05.488992 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron_lib.callbacks.manager [None req-d379eaae-bfd6-47a5-8076-690a94fdc68b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:05.512261 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Pushing event updated for resources: {'Port': ['ID=afceb3be-dac0-4a64-8295-7d082bff4ea3,revision_number=3']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:33:05.521514 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:33:05.797800 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-e885970a-bd07-490e-acbf-45a3a8301eed admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:05.836796 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron_lib.callbacks.manager [None req-d379eaae-bfd6-47a5-8076-690a94fdc68b None None] Notify callbacks [] for port, precommit_update {{(pid=91689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:05.849195 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.provisioning_blocks [None req-d379eaae-bfd6-47a5-8076-690a94fdc68b None None] Transition to ACTIVE for port object 4e511e4a-69db-4a8c-b460-faca77e2e63e will not be triggered until provisioned by entity L2. {{(pid=91689) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:33:05.855848 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron_lib.callbacks.manager [None req-d379eaae-bfd6-47a5-8076-690a94fdc68b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:05.860562 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG oslo_concurrency.lockutils [None req-2c2f4c9a-1e0f-43e2-9984-19c1b954e4d1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:33:05.939041 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.managers [None req-d379eaae-bfd6-47a5-8076-690a94fdc68b None None] Attempting to bind port 4e511e4a-69db-4a8c-b460-faca77e2e63e on host dv-cinder-790910-4-iscsi for vnic_type normal with profile  {{(pid=91689) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 04:33:05.939384 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.managers [None req-d379eaae-bfd6-47a5-8076-690a94fdc68b None None] Attempting to bind port 4e511e4a-69db-4a8c-b460-faca77e2e63e by drivers openvswitch,hyperv on host dv-cinder-790910-4-iscsi at level 0 using segments [{'id': '8df49ec5-3fb9-4715-bc9a-f4019a6b55f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90'}] {{(pid=91689) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 04:33:05.939750 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d379eaae-bfd6-47a5-8076-690a94fdc68b None None] Attempting to bind port 4e511e4a-69db-4a8c-b460-faca77e2e63e on network aec557db-0c02-4008-8c9f-2efcd7462f90 {{(pid=91689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:33:05.941813 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9818ec8c-1f74-47f6-b3e8-1b472546ef1b None None] Pushing event updated for resources: {'Port': ['ID=4e511e4a-69db-4a8c-b460-faca77e2e63e,revision_number=2']} {{(pid=91689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:33:05.954791 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9818ec8c-1f74-47f6-b3e8-1b472546ef1b None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:33:05.955480 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9818ec8c-1f74-47f6-b3e8-1b472546ef1b None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:33:05.955480 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9818ec8c-1f74-47f6-b3e8-1b472546ef1b None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:33:05.955788 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9818ec8c-1f74-47f6-b3e8-1b472546ef1b None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:33:05.956098 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9818ec8c-1f74-47f6-b3e8-1b472546ef1b None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:33:05.956417 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9818ec8c-1f74-47f6-b3e8-1b472546ef1b None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:33:05.956733 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9818ec8c-1f74-47f6-b3e8-1b472546ef1b None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:33:05.957067 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9818ec8c-1f74-47f6-b3e8-1b472546ef1b None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:33:05.957403 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9818ec8c-1f74-47f6-b3e8-1b472546ef1b None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:33:05.957718 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9818ec8c-1f74-47f6-b3e8-1b472546ef1b None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:33:05.958021 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9818ec8c-1f74-47f6-b3e8-1b472546ef1b None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:33:05.958353 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9818ec8c-1f74-47f6-b3e8-1b472546ef1b None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:33:05.961640 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d379eaae-bfd6-47a5-8076-690a94fdc68b None None] Checking agent: {'id': '333121d4-1023-4a33-a54c-f4dd052e1612', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-790910-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 4, 13, 33), 'started_at': datetime.datetime(2021, 5, 20, 4, 14, 3), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 4, 33, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-790910-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 04:33:05.966489 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d379eaae-bfd6-47a5-8076-690a94fdc68b None None] Checking segment: {'id': '8df49ec5-3fb9-4715-bc9a-f4019a6b55f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91689) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:33:05.966489 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron_lib.callbacks.manager [None req-d379eaae-bfd6-47a5-8076-690a94fdc68b None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:05.966489 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d379eaae-bfd6-47a5-8076-690a94fdc68b None None] Bound using segment: {'id': '8df49ec5-3fb9-4715-bc9a-f4019a6b55f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90'} {{(pid=91689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 04:33:05.966489 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.managers [None req-d379eaae-bfd6-47a5-8076-690a94fdc68b None None] Bound port: 4e511e4a-69db-4a8c-b460-faca77e2e63e, host: dv-cinder-790910-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8df49ec5-3fb9-4715-bc9a-f4019a6b55f9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90'}}] {{(pid=91689) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 04:33:05.966489 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron_lib.callbacks.manager [None req-d379eaae-bfd6-47a5-8076-690a94fdc68b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:05.992610 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG oslo_concurrency.lockutils [None req-9818ec8c-1f74-47f6-b3e8-1b472546ef1b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.132s {{(pid=91689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:33:06.010795 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.db_base_plugin_common [None req-e885970a-bd07-490e-acbf-45a3a8301eed admin admin] Allocated IP 172.20.0.1 (4c58b50e-1091-40dd-b4fa-ff2da87b1475/24a65302-95b2-4d66-9d40-a9959babbe40/6bbd99c0-ca71-4a0a-8b11-1bb2be75a9c9) {{(pid=91687) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 04:33:06.037900 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.db [None req-d379eaae-bfd6-47a5-8076-690a94fdc68b None None] For port 4e511e4a-69db-4a8c-b460-faca77e2e63e, host dv-cinder-790910-4-iscsi, cleared binding levels {{(pid=91689) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 04:33:06.041083 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.plugins.ml2.db [None req-d379eaae-bfd6-47a5-8076-690a94fdc68b None None] For port 4e511e4a-69db-4a8c-b460-faca77e2e63e, host dv-cinder-790910-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=4e511e4a-69db-4a8c-b460-faca77e2e63e,segment=NetworkSegment(8df49ec5-3fb9-4715-bc9a-f4019a6b55f9),segment_id=8df49ec5-3fb9-4715-bc9a-f4019a6b55f9)] {{(pid=91689) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 04:33:06.047910 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron_lib.callbacks.manager [None req-d379eaae-bfd6-47a5-8076-690a94fdc68b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:06.051743 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:33:06.124210 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d379eaae-bfd6-47a5-8076-690a94fdc68b None None] Routers {'d4b509ec-ef18-4627-a6cf-1d7baff4e160'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91689) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:33:06.124818 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-d379eaae-bfd6-47a5-8076-690a94fdc68b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced17e6cd0>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:33:03Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['d4b509ec-ef18-4627-a6cf-1d7baff4e160'], 'active': True} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:33:06.164213 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-e885970a-bd07-490e-acbf-45a3a8301eed admin admin] Notify callbacks [] for port, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:06.179587 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.provisioning_blocks [None req-e885970a-bd07-490e-acbf-45a3a8301eed admin admin] Transition to ACTIVE for port object 6bbd99c0-ca71-4a0a-8b11-1bb2be75a9c9 will not be triggered until provisioned by entity DHCP. {{(pid=91687) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:33:06.186814 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9818ec8c-1f74-47f6-b3e8-1b472546ef1b None None] Pushing event updated for resources: {'Port': ['ID=4e511e4a-69db-4a8c-b460-faca77e2e63e,revision_number=3']} {{(pid=91689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:33:06.197466 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG oslo_concurrency.lockutils [None req-9818ec8c-1f74-47f6-b3e8-1b472546ef1b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.146s {{(pid=91689) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:33:06.208871 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-e885970a-bd07-490e-acbf-45a3a8301eed admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8782892106231', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4162192'] for port, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:06.213620 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-cc1c2c2f-505a-46d5-be79-e4ba34ae4dcb tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:33:06.276474 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e885970a-bd07-490e-acbf-45a3a8301eed admin admin] Network 4c58b50e-1091-40dd-b4fa-ff2da87b1475 is already hosted by enough agents. {{(pid=91687) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:33:06.279431 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.base_scheduler [None req-e885970a-bd07-490e-acbf-45a3a8301eed admin admin] Resources bound (agent type, host, resource id):  {{(pid=91687) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:33:06.283087 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e885970a-bd07-490e-acbf-45a3a8301eed admin admin] Received port after_create {{(pid=91687) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 04:33:06.303997 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvr_db [None req-d379eaae-bfd6-47a5-8076-690a94fdc68b None None] Set router d4b509ec-ef18-4627-a6cf-1d7baff4e160 gateway port host: dv-cinder-790910-4-iscsi {{(pid=91689) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:33:06.322421 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e885970a-bd07-490e-acbf-45a3a8301eed admin admin] Pushing event updated for resources: {'Port': ['ID=6bbd99c0-ca71-4a0a-8b11-1bb2be75a9c9,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:33:06.326109 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-e885970a-bd07-490e-acbf-45a3a8301eed admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:33:06.349987 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-e885970a-bd07-490e-acbf-45a3a8301eed admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1716281'] for router_interface, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:06.492607 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-9d5e0c21-5f76-4227-aa47-7ce3f951e198 None None] Provisioning for port 6bbd99c0-ca71-4a0a-8b11-1bb2be75a9c9 completed by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:33:06.499224 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-9d5e0c21-5f76-4227-aa47-7ce3f951e198 None None] Provisioning complete for port 6bbd99c0-ca71-4a0a-8b11-1bb2be75a9c9 triggered by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:33:06.499735 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-9d5e0c21-5f76-4227-aa47-7ce3f951e198 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:06.562644 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-9d5e0c21-5f76-4227-aa47-7ce3f951e198 None None] Port 6bbd99c0-ca71-4a0a-8b11-1bb2be75a9c9 cannot update to ACTIVE because it is not bound. {{(pid=91688) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 20 04:33:06.589667 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:06.609980 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-d379eaae-bfd6-47a5-8076-690a94fdc68b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced17e6cd0>, [{'id': 'd4b509ec-ef18-4627-a6cf-1d7baff4e160', 'name': 'tempest-AttachVolumeTestJSON-1012860640-router', 'tenant_id': '2035da004a584b4ea1f637e593596cd7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.206'}], 'enable_snat': True}, 'gw_port_id': '4e511e4a-69db-4a8c-b460-faca77e2e63e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:33:02Z', 'updated_at': '2021-05-20T04:33:04Z', 'revision_number': 3, 'project_id': '2035da004a584b4ea1f637e593596cd7', 'gw_port': {'id': '4e511e4a-69db-4a8c-b460-faca77e2e63e', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:59:ad', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd4b509ec-ef18-4627-a6cf-1d7baff4e160', 'device_owner': 'network:router_gateway', 'standard_attr_id': 608, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.206', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:33:03Z', 'updated_at': '2021-05-20T04:33:06Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi'}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:33:06.613995 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d379eaae-bfd6-47a5-8076-690a94fdc68b None None] The sync data for ids ['d4b509ec-ef18-4627-a6cf-1d7baff4e160'] in dv-cinder-790910-4-iscsi is: [{'id': 'd4b509ec-ef18-4627-a6cf-1d7baff4e160', 'name': 'tempest-AttachVolumeTestJSON-1012860640-router', 'tenant_id': '2035da004a584b4ea1f637e593596cd7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.206'}], 'enable_snat': True}, 'gw_port_id': '4e511e4a-69db-4a8c-b460-faca77e2e63e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:33:02Z', 'updated_at': '2021-05-20T04:33:04Z', 'revision_number': 3, 'project_id': '2035da004a584b4ea1f637e593596cd7', 'gw_port': {'id': '4e511e4a-69db-4a8c-b460-faca77e2e63e', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:59:ad', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd4b509ec-ef18-4627-a6cf-1d7baff4e160', 'device_owner': 'network:router_gateway', 'standard_attr_id': 608, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.206', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:33:03Z', 'updated_at': '2021-05-20T04:33:06Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi'}] {{(pid=91689) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 04:33:06.619943 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-e885970a-bd07-490e-acbf-45a3a8301eed admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:06.982195 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-e885970a-bd07-490e-acbf-45a3a8301eed admin admin] Notify callbacks [] for port, precommit_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:06.986971 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-e885970a-bd07-490e-acbf-45a3a8301eed admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4162185'] for port, after_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:07.012316 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-329e70a1-ad79-4874-94a9-86476739067e tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:33:07.098192 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e885970a-bd07-490e-acbf-45a3a8301eed admin admin] Pushing event updated for resources: {'Port': ['ID=6bbd99c0-ca71-4a0a-8b11-1bb2be75a9c9,revision_number=2']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:33:07.100861 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-e885970a-bd07-490e-acbf-45a3a8301eed admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1781412', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1716318'] for router_interface, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:07.104796 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-e885970a-bd07-490e-acbf-45a3a8301eed admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:33:07.230645 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 4e511e4a-69db-4a8c-b460-faca77e2e63e up at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:33:07.262994 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e885970a-bd07-490e-acbf-45a3a8301eed admin admin] Network 4c58b50e-1091-40dd-b4fa-ff2da87b1475 is already hosted by enough agents. {{(pid=91687) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:33:07.264361 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.base_scheduler [None req-e885970a-bd07-490e-acbf-45a3a8301eed admin admin] Resources bound (agent type, host, resource id):  {{(pid=91687) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:33:07.311734 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning for port 4e511e4a-69db-4a8c-b460-faca77e2e63e completed by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:33:07.321000 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning complete for port 4e511e4a-69db-4a8c-b460-faca77e2e63e triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:33:07.321656 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:07.460420 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:07.469318 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e885970a-bd07-490e-acbf-45a3a8301eed admin admin] Router d4b509ec-ef18-4627-a6cf-1d7baff4e160 has already been hosted by L3 agent 02733fc0-fc9c-4e29-bc03-c27a792d539d {{(pid=91687) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 04:33:07.478322 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] For port 4e511e4a-69db-4a8c-b460-faca77e2e63e, host dv-cinder-790910-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=4e511e4a-69db-4a8c-b460-faca77e2e63e,segment=NetworkSegment(8df49ec5-3fb9-4715-bc9a-f4019a6b55f9),segment_id=8df49ec5-3fb9-4715-bc9a-f4019a6b55f9)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:33:07.483233 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:07.484282 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device afceb3be-dac0-4a64-8295-7d082bff4ea3 up at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:33:07.508757 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:33:07.607656 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Pushing event updated for resources: {'Port': ['ID=4e511e4a-69db-4a8c-b460-faca77e2e63e,revision_number=4']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:33:07.612173 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:33:07.612742 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-bea4799c-4734-4f43-9b59-6f38ebce99d0 None None] Provisioning complete for port 6bbd99c0-ca71-4a0a-8b11-1bb2be75a9c9 triggered by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:33:07.613142 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-bea4799c-4734-4f43-9b59-6f38ebce99d0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:07.650146 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e885970a-bd07-490e-acbf-45a3a8301eed admin admin] Notify agent at l3_agent.dv-cinder-790910-4-iscsi the message routers_updated {{(pid=91687) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 04:33:07.661678 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-e885970a-bd07-490e-acbf-45a3a8301eed admin admin] 10.222.0.71 "PUT /v2.0/routers/d4b509ec-ef18-4627-a6cf-1d7baff4e160/add_router_interface HTTP/1.1" status: 200  len: 503 time: 2.6865482
May 20 04:33:07.672669 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-bea4799c-4734-4f43-9b59-6f38ebce99d0 None None] Port 6bbd99c0-ca71-4a0a-8b11-1bb2be75a9c9 cannot update to ACTIVE because it is not bound. {{(pid=91688) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 20 04:33:07.674957 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning complete for port afceb3be-dac0-4a64-8295-7d082bff4ea3 triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:33:07.675358 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:08.166109 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-00a93fc0-8e08-4792-982c-5919c3d16885 None None] Sync routers for ids ['d4b509ec-ef18-4627-a6cf-1d7baff4e160'] in dv-cinder-790910-4-iscsi {{(pid=91688) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 04:33:08.175969 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-00a93fc0-8e08-4792-982c-5919c3d16885 None None] Routers {'d4b509ec-ef18-4627-a6cf-1d7baff4e160'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91688) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:33:08.176592 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-00a93fc0-8e08-4792-982c-5919c3d16885 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced17e5400>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:33:03Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['d4b509ec-ef18-4627-a6cf-1d7baff4e160'], 'active': True} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:33:08.180944 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 46266) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:33:08.186335 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.v2.base [None req-4e223aa3-480f-45c0-9b88-935cedd480fe tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Request body: {'security_group': {'name': 'tempest-securitygroup--677999764', 'description': 'tempest-description--2007228100'}} {{(pid=91686) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:33:08.192295 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-4e223aa3-480f-45c0-9b88-935cedd480fe tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:33:08.196340 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-4e223aa3-480f-45c0-9b88-935cedd480fe tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Usage tracker for resource:security_group and tenant:2035da004a584b4ea1f637e593596cd7 is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:33:08.199326 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-4e223aa3-480f-45c0-9b88-935cedd480fe tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:33:08.206114 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-4e223aa3-480f-45c0-9b88-935cedd480fe tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:33:08.218165 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-4e223aa3-480f-45c0-9b88-935cedd480fe tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks [] for security_group, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:08.238542 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-4e223aa3-480f-45c0-9b88-935cedd480fe tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:33:08.242515 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-4e223aa3-480f-45c0-9b88-935cedd480fe tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Usage tracker for resource:security_group_rule and tenant:2035da004a584b4ea1f637e593596cd7 is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:33:08.245312 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-4e223aa3-480f-45c0-9b88-935cedd480fe tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:33:08.250921 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-4e223aa3-480f-45c0-9b88-935cedd480fe tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:33:08.322141 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-4e223aa3-480f-45c0-9b88-935cedd480fe tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks [] for security_group, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:08.327155 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-4e223aa3-480f-45c0-9b88-935cedd480fe tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:08.331106 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-f55805ab-ca55-4021-b8aa-676c29032970 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:33:08.354883 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvr_db [None req-00a93fc0-8e08-4792-982c-5919c3d16885 None None] Set router d4b509ec-ef18-4627-a6cf-1d7baff4e160 gateway port host: dv-cinder-790910-4-iscsi {{(pid=91688) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:33:08.370103 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e223aa3-480f-45c0-9b88-935cedd480fe tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Pushing event updated for resources: {'SecurityGroup': ['ID=a91e9b1a-ef38-4317-bbea-c290d296dc7b,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:33:08.373222 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-4e223aa3-480f-45c0-9b88-935cedd480fe tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:33:08.377532 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-4e223aa3-480f-45c0-9b88-935cedd480fe tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks [] for security_group, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:08.382725 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-4e223aa3-480f-45c0-9b88-935cedd480fe tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1779 time: 0.1971591
May 20 04:33:08.382725 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 46270) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:33:08.387907 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.v2.base [None req-6b162f69-852d-4b2d-871e-c2f8efcd1591 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Request body: {'security_group_rule': {'security_group_id': 'a91e9b1a-ef38-4317-bbea-c290d296dc7b', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=91686) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:33:08.394017 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-6b162f69-852d-4b2d-871e-c2f8efcd1591 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:33:08.398146 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-6b162f69-852d-4b2d-871e-c2f8efcd1591 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Usage tracker for resource:security_group_rule and tenant:2035da004a584b4ea1f637e593596cd7 is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:33:08.401568 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-6b162f69-852d-4b2d-871e-c2f8efcd1591 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:33:08.407278 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-6b162f69-852d-4b2d-871e-c2f8efcd1591 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:33:08.424616 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-6b162f69-852d-4b2d-871e-c2f8efcd1591 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:08.489934 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-6b162f69-852d-4b2d-871e-c2f8efcd1591 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:08.494677 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-6b162f69-852d-4b2d-871e-c2f8efcd1591 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1597377'] for security_group_rule, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:08.496873 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-4794d716-6870-4865-85fa-057ed91e056f tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:33:08.519879 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b162f69-852d-4b2d-871e-c2f8efcd1591 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ed3374a7-5092-482e-9219-3c7b9b64c727,revision_number=0']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:33:08.522396 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-6b162f69-852d-4b2d-871e-c2f8efcd1591 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:33:08.531253 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-6b162f69-852d-4b2d-871e-c2f8efcd1591 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:08.535193 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-6b162f69-852d-4b2d-871e-c2f8efcd1591 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.1491196
May 20 04:33:08.535341 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 46274) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:33:08.540406 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.v2.base [None req-fdc25304-1dd6-4413-8430-d2666417ab5c tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Request body: {'security_group_rule': {'security_group_id': 'a91e9b1a-ef38-4317-bbea-c290d296dc7b', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=91686) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:33:08.546407 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-fdc25304-1dd6-4413-8430-d2666417ab5c tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:33:08.550330 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-fdc25304-1dd6-4413-8430-d2666417ab5c tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Usage tracker for resource:security_group_rule and tenant:2035da004a584b4ea1f637e593596cd7 is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:33:08.553254 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-fdc25304-1dd6-4413-8430-d2666417ab5c tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:33:08.559027 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-fdc25304-1dd6-4413-8430-d2666417ab5c tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:33:08.576427 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-fdc25304-1dd6-4413-8430-d2666417ab5c tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:08.639880 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-fdc25304-1dd6-4413-8430-d2666417ab5c tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:08.644744 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-fdc25304-1dd6-4413-8430-d2666417ab5c tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1597377'] for security_group_rule, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:08.653252 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:33:08.669516 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-00a93fc0-8e08-4792-982c-5919c3d16885 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced17e5400>, [{'id': 'd4b509ec-ef18-4627-a6cf-1d7baff4e160', 'name': 'tempest-AttachVolumeTestJSON-1012860640-router', 'tenant_id': '2035da004a584b4ea1f637e593596cd7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.206'}], 'enable_snat': True}, 'gw_port_id': '4e511e4a-69db-4a8c-b460-faca77e2e63e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:33:02Z', 'updated_at': '2021-05-20T04:33:06Z', 'revision_number': 4, 'project_id': '2035da004a584b4ea1f637e593596cd7', 'gw_port': {'id': '4e511e4a-69db-4a8c-b460-faca77e2e63e', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:59:ad', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd4b509ec-ef18-4627-a6cf-1d7baff4e160', 'device_owner': 'network:router_gateway', 'standard_attr_id': 608, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.206', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:33:03Z', 'updated_at': '2021-05-20T04:33:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_interfaces': [{'id': '6bbd99c0-ca71-4a0a-8b11-1bb2be75a9c9', 'name': '', 'network_id': '4c58b50e-1091-40dd-b4fa-ff2da87b1475', 'tenant_id': '2035da004a584b4ea1f637e593596cd7', 'mac_address': 'fa:16:3e:70:97:1f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd4b509ec-ef18-4627-a6cf-1d7baff4e160', 'device_owner': 'network:router_interface', 'standard_attr_id': 609, 'fixed_ips': [{'subnet_id': '24a65302-95b2-4d66-9d40-a9959babbe40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:33:05Z', 'updated_at': '2021-05-20T04:33:06Z', 'revision_number': 2, 'project_id': '2035da004a584b4ea1f637e593596cd7', 'subnets': [{'id': '24a65302-95b2-4d66-9d40-a9959babbe40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:33:08.671753 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdc25304-1dd6-4413-8430-d2666417ab5c tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=64c9d133-84bc-46e9-96b4-14ec3a614c08,revision_number=0']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:33:08.673607 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-00a93fc0-8e08-4792-982c-5919c3d16885 None None] Checking router: d4b509ec-ef18-4627-a6cf-1d7baff4e160 for host: dv-cinder-790910-4-iscsi {{(pid=91688) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 04:33:08.673936 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-00a93fc0-8e08-4792-982c-5919c3d16885 None None] Updating router d4b509ec-ef18-4627-a6cf-1d7baff4e160 port 6bbd99c0-ca71-4a0a-8b11-1bb2be75a9c9 binding host dv-cinder-790910-4-iscsi {{(pid=91688) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 20 04:33:08.674642 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-fdc25304-1dd6-4413-8430-d2666417ab5c tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:33:08.682807 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-fdc25304-1dd6-4413-8430-d2666417ab5c tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:08.684216 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-fdc25304-1dd6-4413-8430-d2666417ab5c tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.1478953
May 20 04:33:08.687348 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 46278) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:33:08.692512 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.v2.base [None req-42b2f377-61e8-4d25-ba0b-954cda0a1747 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Request body: {'floatingip': {'floating_network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90'}} {{(pid=91686) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:33:08.698967 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-42b2f377-61e8-4d25-ba0b-954cda0a1747 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:33:08.703060 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-42b2f377-61e8-4d25-ba0b-954cda0a1747 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Usage tracker for resource:floatingip and tenant:2035da004a584b4ea1f637e593596cd7 is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:33:08.706180 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-42b2f377-61e8-4d25-ba0b-954cda0a1747 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:33:08.712356 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-42b2f377-61e8-4d25-ba0b-954cda0a1747 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:33:08.724181 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-42b2f377-61e8-4d25-ba0b-954cda0a1747 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks [] for floatingip, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:08.728106 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-00a93fc0-8e08-4792-982c-5919c3d16885 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:08.864465 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-42b2f377-61e8-4d25-ba0b-954cda0a1747 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:09.001874 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.db_base_plugin_common [None req-42b2f377-61e8-4d25-ba0b-954cda0a1747 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Allocated IP 172.27.1.225 (aec557db-0c02-4008-8c9f-2efcd7462f90/217f4b55-4415-4d57-8b43-2ff4c8ac8e81/f7120f16-e33b-427a-9fed-c364fe9ee65c) {{(pid=91686) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 04:33:09.067917 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-00a93fc0-8e08-4792-982c-5919c3d16885 None None] Notify callbacks [] for port, precommit_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:09.081972 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-00a93fc0-8e08-4792-982c-5919c3d16885 None None] Transition to ACTIVE for port object 6bbd99c0-ca71-4a0a-8b11-1bb2be75a9c9 will not be triggered until provisioned by entity L2. {{(pid=91688) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:33:09.089534 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-00a93fc0-8e08-4792-982c-5919c3d16885 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:09.096781 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-46ba1de9-de0c-472d-bb51-bd40ff197921 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:33:09.153799 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 4e511e4a-69db-4a8c-b460-faca77e2e63e up at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:33:09.155109 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-42b2f377-61e8-4d25-ba0b-954cda0a1747 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks [] for port, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:09.195600 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-42b2f377-61e8-4d25-ba0b-954cda0a1747 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8782892106231', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2145052'] for port, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:09.201847 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-daeb77f8-e2ec-4bd9-a2cc-d83f1ceaf958 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:33:09.269164 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-42b2f377-61e8-4d25-ba0b-954cda0a1747 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Network aec557db-0c02-4008-8c9f-2efcd7462f90 is already hosted by enough agents. {{(pid=91686) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:33:09.278523 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.base_scheduler [None req-42b2f377-61e8-4d25-ba0b-954cda0a1747 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Resources bound (agent type, host, resource id):  {{(pid=91686) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:33:09.281511 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.l3_dvrscheduler_db [None req-42b2f377-61e8-4d25-ba0b-954cda0a1747 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Received port after_create {{(pid=91686) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 04:33:09.285014 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7d99886-d264-484f-b440-21221f3fd5d2 None None] Pushing event updated for resources: {'Port': ['ID=6bbd99c0-ca71-4a0a-8b11-1bb2be75a9c9,revision_number=3']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:33:09.318884 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-b7d99886-d264-484f-b440-21221f3fd5d2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.222s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:33:09.341638 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42b2f377-61e8-4d25-ba0b-954cda0a1747 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Pushing event updated for resources: {'Port': ['ID=f7120f16-e33b-427a-9fed-c364fe9ee65c,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:33:09.345825 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-42b2f377-61e8-4d25-ba0b-954cda0a1747 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.144s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:33:09.382412 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-42b2f377-61e8-4d25-ba0b-954cda0a1747 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks [] for floatingip, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:09.383301 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.managers [None req-00a93fc0-8e08-4792-982c-5919c3d16885 None None] Attempting to bind port 6bbd99c0-ca71-4a0a-8b11-1bb2be75a9c9 on host dv-cinder-790910-4-iscsi for vnic_type normal with profile  {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 04:33:09.383924 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.managers [None req-00a93fc0-8e08-4792-982c-5919c3d16885 None None] Attempting to bind port 6bbd99c0-ca71-4a0a-8b11-1bb2be75a9c9 by drivers openvswitch,hyperv on host dv-cinder-790910-4-iscsi at level 0 using segments [{'id': '12af0450-da1a-4552-85ca-9149ff5b7f01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 871, 'network_id': '4c58b50e-1091-40dd-b4fa-ff2da87b1475'}] {{(pid=91688) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 04:33:09.384294 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-00a93fc0-8e08-4792-982c-5919c3d16885 None None] Attempting to bind port 6bbd99c0-ca71-4a0a-8b11-1bb2be75a9c9 on network 4c58b50e-1091-40dd-b4fa-ff2da87b1475 {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:33:09.392334 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-00a93fc0-8e08-4792-982c-5919c3d16885 None None] Checking agent: {'id': '333121d4-1023-4a33-a54c-f4dd052e1612', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-790910-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 4, 13, 33), 'started_at': datetime.datetime(2021, 5, 20, 4, 14, 3), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 4, 33, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-790910-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 04:33:09.392737 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-00a93fc0-8e08-4792-982c-5919c3d16885 None None] Checking segment: {'id': '12af0450-da1a-4552-85ca-9149ff5b7f01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 871, 'network_id': '4c58b50e-1091-40dd-b4fa-ff2da87b1475'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91688) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:33:09.393169 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-00a93fc0-8e08-4792-982c-5919c3d16885 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:09.393576 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-00a93fc0-8e08-4792-982c-5919c3d16885 None None] Bound using segment: {'id': '12af0450-da1a-4552-85ca-9149ff5b7f01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 871, 'network_id': '4c58b50e-1091-40dd-b4fa-ff2da87b1475'} {{(pid=91688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 04:33:09.394058 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.managers [None req-00a93fc0-8e08-4792-982c-5919c3d16885 None None] Bound port: 6bbd99c0-ca71-4a0a-8b11-1bb2be75a9c9, host: dv-cinder-790910-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '12af0450-da1a-4552-85ca-9149ff5b7f01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 871, 'network_id': '4c58b50e-1091-40dd-b4fa-ff2da87b1475'}}] {{(pid=91688) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 04:33:09.394442 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-00a93fc0-8e08-4792-982c-5919c3d16885 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:09.421836 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning complete for port 4e511e4a-69db-4a8c-b460-faca77e2e63e triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:33:09.422202 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:09.450844 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-42b2f377-61e8-4d25-ba0b-954cda0a1747 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:09.594331 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-00a93fc0-8e08-4792-982c-5919c3d16885 None None] For port 6bbd99c0-ca71-4a0a-8b11-1bb2be75a9c9, host dv-cinder-790910-4-iscsi, cleared binding levels {{(pid=91688) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 04:33:09.598179 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-00a93fc0-8e08-4792-982c-5919c3d16885 None None] For port 6bbd99c0-ca71-4a0a-8b11-1bb2be75a9c9, host dv-cinder-790910-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=6bbd99c0-ca71-4a0a-8b11-1bb2be75a9c9,segment=NetworkSegment(12af0450-da1a-4552-85ca-9149ff5b7f01),segment_id=12af0450-da1a-4552-85ca-9149ff5b7f01)] {{(pid=91688) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 04:33:09.627570 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-00a93fc0-8e08-4792-982c-5919c3d16885 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:09.637697 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:33:09.662381 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-42b2f377-61e8-4d25-ba0b-954cda0a1747 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks [] for port, precommit_update {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:09.667776 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-42b2f377-61e8-4d25-ba0b-954cda0a1747 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2145029'] for port, after_update {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:09.671543 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-44b3366a-cabd-41a6-95ca-a39afcf09098 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:33:09.731126 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-00a93fc0-8e08-4792-982c-5919c3d16885 None None] Routers {'d4b509ec-ef18-4627-a6cf-1d7baff4e160'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91688) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:33:09.731569 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-00a93fc0-8e08-4792-982c-5919c3d16885 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced17e5400>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:33:03Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['d4b509ec-ef18-4627-a6cf-1d7baff4e160'], 'active': True} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:33:09.778069 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42b2f377-61e8-4d25-ba0b-954cda0a1747 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Pushing event updated for resources: {'Port': ['ID=f7120f16-e33b-427a-9fed-c364fe9ee65c,revision_number=2']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:33:09.782290 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-42b2f377-61e8-4d25-ba0b-954cda0a1747 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:33:09.792392 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-42b2f377-61e8-4d25-ba0b-954cda0a1747 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1716406'] for floatingip, after_update {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:09.795134 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7d99886-d264-484f-b440-21221f3fd5d2 None None] Pushing event updated for resources: {'Port': ['ID=6bbd99c0-ca71-4a0a-8b11-1bb2be75a9c9,revision_number=4']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:33:09.800169 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-b7d99886-d264-484f-b440-21221f3fd5d2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.162s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:33:09.819128 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-42b2f377-61e8-4d25-ba0b-954cda0a1747 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for floatingip, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:09.820891 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-42b2f377-61e8-4d25-ba0b-954cda0a1747 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 693 time: 1.1322668
May 20 04:33:09.927744 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvr_db [None req-00a93fc0-8e08-4792-982c-5919c3d16885 None None] Set router d4b509ec-ef18-4627-a6cf-1d7baff4e160 gateway port host: dv-cinder-790910-4-iscsi {{(pid=91688) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:33:09.999386 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-83c196c0-4e30-4dcd-9fed-3dc64d031f1e req-283061c6-5ee4-4d0b-b358-d2556cb76e6e tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/security-groups?name=tempest-securitygroup--677999764&fields=id&tenant_id=2035da004a584b4ea1f637e593596cd7 HTTP/1.1" status: 200  len: 267 time: 0.0407634
May 20 04:33:10.154838 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83c196c0-4e30-4dcd-9fed-3dc64d031f1e req-107669c0-a68f-412a-997b-b566e0cd1d11 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:33:10.156204 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-83c196c0-4e30-4dcd-9fed-3dc64d031f1e req-107669c0-a68f-412a-997b-b566e0cd1d11 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/networks?id=4c58b50e-1091-40dd-b4fa-ff2da87b1475 HTTP/1.1" status: 200  len: 811 time: 0.1494343
May 20 04:33:10.171523 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-83c196c0-4e30-4dcd-9fed-3dc64d031f1e req-aa801084-65c6-4daf-b6a7-8528d9e5bdf1 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/quotas/2035da004a584b4ea1f637e593596cd7 HTTP/1.1" status: 200  len: 375 time: 0.0093575
May 20 04:33:10.252027 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-00a93fc0-8e08-4792-982c-5919c3d16885 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced17e5400>, [{'id': 'd4b509ec-ef18-4627-a6cf-1d7baff4e160', 'name': 'tempest-AttachVolumeTestJSON-1012860640-router', 'tenant_id': '2035da004a584b4ea1f637e593596cd7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.206'}], 'enable_snat': True}, 'gw_port_id': '4e511e4a-69db-4a8c-b460-faca77e2e63e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:33:02Z', 'updated_at': '2021-05-20T04:33:06Z', 'revision_number': 4, 'project_id': '2035da004a584b4ea1f637e593596cd7', 'gw_port': {'id': '4e511e4a-69db-4a8c-b460-faca77e2e63e', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:59:ad', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd4b509ec-ef18-4627-a6cf-1d7baff4e160', 'device_owner': 'network:router_gateway', 'standard_attr_id': 608, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.206', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:33:03Z', 'updated_at': '2021-05-20T04:33:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_interfaces': [{'id': '6bbd99c0-ca71-4a0a-8b11-1bb2be75a9c9', 'name': '', 'network_id': '4c58b50e-1091-40dd-b4fa-ff2da87b1475', 'tenant_id': '2035da004a584b4ea1f637e593596cd7', 'mac_address': 'fa:16:3e:70:97:1f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd4b509ec-ef18-4627-a6cf-1d7baff4e160', 'device_owner': 'network:router_interface', 'standard_attr_id': 609, 'fixed_ips': [{'subnet_id': '24a65302-95b2-4d66-9d40-a9959babbe40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:33:05Z', 'updated_at': '2021-05-20T04:33:09Z', 'revision_number': 4, 'project_id': '2035da004a584b4ea1f637e593596cd7', 'subnets': [{'id': '24a65302-95b2-4d66-9d40-a9959babbe40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:33:10.256519 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-00a93fc0-8e08-4792-982c-5919c3d16885 None None] The sync data for ids ['d4b509ec-ef18-4627-a6cf-1d7baff4e160'] in dv-cinder-790910-4-iscsi is: [{'id': 'd4b509ec-ef18-4627-a6cf-1d7baff4e160', 'name': 'tempest-AttachVolumeTestJSON-1012860640-router', 'tenant_id': '2035da004a584b4ea1f637e593596cd7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.206'}], 'enable_snat': True}, 'gw_port_id': '4e511e4a-69db-4a8c-b460-faca77e2e63e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:33:02Z', 'updated_at': '2021-05-20T04:33:06Z', 'revision_number': 4, 'project_id': '2035da004a584b4ea1f637e593596cd7', 'gw_port': {'id': '4e511e4a-69db-4a8c-b460-faca77e2e63e', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:59:ad', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd4b509ec-ef18-4627-a6cf-1d7baff4e160', 'device_owner': 'network:router_gateway', 'standard_attr_id': 608, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.206', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:33:03Z', 'updated_at': '2021-05-20T04:33:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_interfaces': [{'id': '6bbd99c0-ca71-4a0a-8b11-1bb2be75a9c9', 'name': '', 'network_id': '4c58b50e-1091-40dd-b4fa-ff2da87b1475', 'tenant_id': '2035da004a584b4ea1f637e593596cd7', 'mac_address': 'fa:16:3e:70:97:1f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd4b509ec-ef18-4627-a6cf-1d7baff4e160', 'device_owner': 'network:router_interface', 'standard_attr_id': 609, 'fixed_ips': [{'subnet_id': '24a65302-95b2-4d66-9d40-a9959babbe40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:33:05Z', 'updated_at': '2021-05-20T04:33:09Z', 'revision_number': 4, 'project_id': '2035da004a584b4ea1f637e593596cd7', 'subnets': [{'id': '24a65302-95b2-4d66-9d40-a9959babbe40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91688) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 04:33:10.258648 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-83c196c0-4e30-4dcd-9fed-3dc64d031f1e req-f6b966da-fd21-4da2-98e8-e9a261a09fcc tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Synchronizing usage tracker for tenant:2035da004a584b4ea1f637e593596cd7 on resource:port {{(pid=91687) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:33:10.278784 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-83c196c0-4e30-4dcd-9fed-3dc64d031f1e req-f6b966da-fd21-4da2-98e8-e9a261a09fcc tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Unset dirty status for tenant:2035da004a584b4ea1f637e593596cd7 on resource:port {{(pid=91687) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:33:10.280343 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-83c196c0-4e30-4dcd-9fed-3dc64d031f1e req-f6b966da-fd21-4da2-98e8-e9a261a09fcc tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/ports?tenant_id=2035da004a584b4ea1f637e593596cd7&fields=id HTTP/1.1" status: 200  len: 348 time: 0.1032109
May 20 04:33:10.360635 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [req-83c196c0-4e30-4dcd-9fed-3dc64d031f1e req-b4a6ebeb-6404-4bf3-93d9-fe670bac3718 service neutron] http://10.222.0.71:9696/v2.0/extensions returned with HTTP 200 {{(pid=91687) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 20 04:33:10.364078 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-83c196c0-4e30-4dcd-9fed-3dc64d031f1e req-b4a6ebeb-6404-4bf3-93d9-fe670bac3718 service neutron] 10.222.0.71 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0669825
May 20 04:33:10.502505 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-83c196c0-4e30-4dcd-9fed-3dc64d031f1e req-07d6a9b9-f376-459d-9d5b-f5da588eeda0 service neutron] 10.222.0.71 "GET /v2.0/networks/4c58b50e-1091-40dd-b4fa-ff2da87b1475?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1344557
May 20 04:33:10.640060 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-83c196c0-4e30-4dcd-9fed-3dc64d031f1e req-305f04fc-d533-4b38-ab94-d3ed767f2bf6 service neutron] 10.222.0.71 "GET /v2.0/networks/4c58b50e-1091-40dd-b4fa-ff2da87b1475?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1307209
May 20 04:33:10.833546 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-09dd09d3-84fd-4dfd-b599-7140723a9c04 req-c51f46be-8d45-427e-90d3-8ee18d31ccae tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/ports?device_id=e9041636-d49b-4bde-b686-3fb6ecbf907a HTTP/1.1" status: 200  len: 210 time: 0.0473092
May 20 04:33:11.169859 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 6bbd99c0-ca71-4a0a-8b11-1bb2be75a9c9 up at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:33:11.240252 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning for port 6bbd99c0-ca71-4a0a-8b11-1bb2be75a9c9 completed by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:33:11.245507 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning complete for port 6bbd99c0-ca71-4a0a-8b11-1bb2be75a9c9 triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:33:11.246135 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:11.371015 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:11.404487 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] For port 6bbd99c0-ca71-4a0a-8b11-1bb2be75a9c9, host dv-cinder-790910-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=6bbd99c0-ca71-4a0a-8b11-1bb2be75a9c9,segment=NetworkSegment(12af0450-da1a-4552-85ca-9149ff5b7f01),segment_id=12af0450-da1a-4552-85ca-9149ff5b7f01)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:33:11.408068 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:11.409963 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-65794c0e-7ad1-47f5-98b6-5287a957af80 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:33:11.483614 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Pushing event updated for resources: {'Port': ['ID=6bbd99c0-ca71-4a0a-8b11-1bb2be75a9c9,revision_number=5']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:33:11.487343 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:33:11.956709 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.agents_db [None req-92d61f12-17bc-4bf9-9eab-8a69b8c6da2f None None] Agent healthcheck: found 6 active agents {{(pid=91689) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 04:33:11.982768 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-41264ead-fe08-4240-aa5b-b2f374b70c0f req-8ccb8f98-5d82-4f42-9d00-dca2ba994a18 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/ports?device_id=e9041636-d49b-4bde-b686-3fb6ecbf907a HTTP/1.1" status: 200  len: 210 time: 0.0430975
May 20 04:33:12.288420 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83c196c0-4e30-4dcd-9fed-3dc64d031f1e req-463533e3-3d24-4fd7-b920-9903428ec28e tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:33:12.289878 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-83c196c0-4e30-4dcd-9fed-3dc64d031f1e req-463533e3-3d24-4fd7-b920-9903428ec28e tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.82 "GET /v2.0/networks?id=4c58b50e-1091-40dd-b4fa-ff2da87b1475 HTTP/1.1" status: 200  len: 811 time: 0.2610781
May 20 04:33:12.347624 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-83c196c0-4e30-4dcd-9fed-3dc64d031f1e req-c6857a20-a357-4bfd-b900-49f0cd8ecc46 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.82 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=2035da004a584b4ea1f637e593596cd7 HTTP/1.1" status: 200  len: 379 time: 0.0471842
May 20 04:33:12.357887 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [req-83c196c0-4e30-4dcd-9fed-3dc64d031f1e req-dba7276f-7f3a-4bd8-94c7-337d873d3f8d tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Request body: {'port': {'device_id': 'e9041636-d49b-4bde-b686-3fb6ecbf907a', 'network_id': '4c58b50e-1091-40dd-b4fa-ff2da87b1475', 'admin_state_up': True, 'tenant_id': '2035da004a584b4ea1f637e593596cd7', 'security_groups': ['a91e9b1a-ef38-4317-bbea-c290d296dc7b']}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:33:12.503315 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [req-83c196c0-4e30-4dcd-9fed-3dc64d031f1e req-dba7276f-7f3a-4bd8-94c7-337d873d3f8d tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:33:12.518224 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [req-83c196c0-4e30-4dcd-9fed-3dc64d031f1e req-dba7276f-7f3a-4bd8-94c7-337d873d3f8d tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:33:12.531026 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-83c196c0-4e30-4dcd-9fed-3dc64d031f1e req-dba7276f-7f3a-4bd8-94c7-337d873d3f8d tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Made reservation on behalf of 2035da004a584b4ea1f637e593596cd7 for: {'port': 1} {{(pid=91687) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 04:33:12.534786 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-83c196c0-4e30-4dcd-9fed-3dc64d031f1e req-dba7276f-7f3a-4bd8-94c7-337d873d3f8d tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:12.713293 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.db_base_plugin_common [req-83c196c0-4e30-4dcd-9fed-3dc64d031f1e req-dba7276f-7f3a-4bd8-94c7-337d873d3f8d tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Allocated IP 172.20.0.9 (4c58b50e-1091-40dd-b4fa-ff2da87b1475/24a65302-95b2-4d66-9d40-a9959babbe40/cda24ac9-3c25-4710-85ff-bcd2091b8d14) {{(pid=91687) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 04:33:12.912380 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-83c196c0-4e30-4dcd-9fed-3dc64d031f1e req-dba7276f-7f3a-4bd8-94c7-337d873d3f8d tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks [] for port, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:12.934146 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.provisioning_blocks [req-83c196c0-4e30-4dcd-9fed-3dc64d031f1e req-dba7276f-7f3a-4bd8-94c7-337d873d3f8d tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Transition to ACTIVE for port object cda24ac9-3c25-4710-85ff-bcd2091b8d14 will not be triggered until provisioned by entity DHCP. {{(pid=91687) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:33:12.963854 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-83c196c0-4e30-4dcd-9fed-3dc64d031f1e req-dba7276f-7f3a-4bd8-94c7-337d873d3f8d tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8782892106231', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4162192'] for port, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:12.969688 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-c5dc61f5-9524-48e1-a16e-7d689db23333 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:33:13.035042 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-83c196c0-4e30-4dcd-9fed-3dc64d031f1e req-dba7276f-7f3a-4bd8-94c7-337d873d3f8d tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Network 4c58b50e-1091-40dd-b4fa-ff2da87b1475 is already hosted by enough agents. {{(pid=91687) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:33:13.038215 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.base_scheduler [req-83c196c0-4e30-4dcd-9fed-3dc64d031f1e req-dba7276f-7f3a-4bd8-94c7-337d873d3f8d tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Resources bound (agent type, host, resource id):  {{(pid=91687) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:33:13.042359 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.l3_dvrscheduler_db [req-83c196c0-4e30-4dcd-9fed-3dc64d031f1e req-dba7276f-7f3a-4bd8-94c7-337d873d3f8d tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Received port after_create {{(pid=91687) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 04:33:13.083595 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dba7276f-7f3a-4bd8-94c7-337d873d3f8d tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Pushing event updated for resources: {'Port': ['ID=cda24ac9-3c25-4710-85ff-bcd2091b8d14,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:33:13.092269 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-dba7276f-7f3a-4bd8-94c7-337d873d3f8d tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.123s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:33:13.114724 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83c196c0-4e30-4dcd-9fed-3dc64d031f1e req-dba7276f-7f3a-4bd8-94c7-337d873d3f8d tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:33:13.115401 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-83c196c0-4e30-4dcd-9fed-3dc64d031f1e req-dba7276f-7f3a-4bd8-94c7-337d873d3f8d tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for port, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:13.155656 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-83c196c0-4e30-4dcd-9fed-3dc64d031f1e req-dba7276f-7f3a-4bd8-94c7-337d873d3f8d tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 0.8018293
May 20 04:33:13.168018 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [req-83c196c0-4e30-4dcd-9fed-3dc64d031f1e req-246ff940-c941-4029-b89c-00e3e5568c6a service neutron] Request body: {'port': {'device_id': 'e9041636-d49b-4bde-b686-3fb6ecbf907a', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79091'}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:33:13.178066 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 6bbd99c0-ca71-4a0a-8b11-1bb2be75a9c9 up at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:33:13.194744 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7b87f73-b9c8-4870-b854-3eb8427305b1 req-4b1f2510-b8d2-4248-9e95-4cbf023a52f6 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:33:13.196664 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-f7b87f73-b9c8-4870-b854-3eb8427305b1 req-4b1f2510-b8d2-4248-9e95-4cbf023a52f6 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/ports?device_id=e9041636-d49b-4bde-b686-3fb6ecbf907a HTTP/1.1" status: 200  len: 931 time: 0.0926144
May 20 04:33:13.263142 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Provisioning complete for port 6bbd99c0-ca71-4a0a-8b11-1bb2be75a9c9 triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:33:13.263541 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:13.296988 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-83c196c0-4e30-4dcd-9fed-3dc64d031f1e req-246ff940-c941-4029-b89c-00e3e5568c6a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:13.333149 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-7bf19cd4-f012-4e07-a3c3-55b8fb90dd67 None None] Provisioning for port cda24ac9-3c25-4710-85ff-bcd2091b8d14 completed by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:33:13.340375 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-7bf19cd4-f012-4e07-a3c3-55b8fb90dd67 None None] Provisioning complete for port cda24ac9-3c25-4710-85ff-bcd2091b8d14 triggered by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:33:13.340750 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-7bf19cd4-f012-4e07-a3c3-55b8fb90dd67 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:13.369309 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [req-f7b87f73-b9c8-4870-b854-3eb8427305b1 req-3827dbde-c8a2-47b7-a8bd-2a9b5b77bd28 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Synchronizing usage tracker for tenant:2035da004a584b4ea1f637e593596cd7 on resource:security_group {{(pid=91686) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:33:13.389909 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [req-f7b87f73-b9c8-4870-b854-3eb8427305b1 req-3827dbde-c8a2-47b7-a8bd-2a9b5b77bd28 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Unset dirty status for tenant:2035da004a584b4ea1f637e593596cd7 on resource:security_group {{(pid=91686) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:33:13.391146 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-f7b87f73-b9c8-4870-b854-3eb8427305b1 req-3827dbde-c8a2-47b7-a8bd-2a9b5b77bd28 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/security-groups?id=a91e9b1a-ef38-4317-bbea-c290d296dc7b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1864305
May 20 04:33:13.442836 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-7bf19cd4-f012-4e07-a3c3-55b8fb90dd67 None None] Port cda24ac9-3c25-4710-85ff-bcd2091b8d14 cannot update to ACTIVE because it is not bound. {{(pid=91688) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 20 04:33:13.652945 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.notifiers.nova [req-83c196c0-4e30-4dcd-9fed-3dc64d031f1e req-246ff940-c941-4029-b89c-00e3e5568c6a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id cda24ac9-3c25-4710-85ff-bcd2091b8d14 {{(pid=91687) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 04:33:13.664127 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-83c196c0-4e30-4dcd-9fed-3dc64d031f1e req-246ff940-c941-4029-b89c-00e3e5568c6a service neutron] Notify callbacks [] for port, precommit_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:13.678653 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.provisioning_blocks [req-83c196c0-4e30-4dcd-9fed-3dc64d031f1e req-246ff940-c941-4029-b89c-00e3e5568c6a service neutron] Transition to ACTIVE for port object cda24ac9-3c25-4710-85ff-bcd2091b8d14 will not be triggered until provisioned by entity L2. {{(pid=91687) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:33:13.685627 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-83c196c0-4e30-4dcd-9fed-3dc64d031f1e req-246ff940-c941-4029-b89c-00e3e5568c6a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4162185'] for port, after_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:13.689186 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-6e2e2d2d-b7bf-459b-a9db-ab914a7a69e7 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:33:13.839171 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-246ff940-c941-4029-b89c-00e3e5568c6a service neutron] Pushing event updated for resources: {'Port': ['ID=cda24ac9-3c25-4710-85ff-bcd2091b8d14,revision_number=2']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:33:13.847027 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-246ff940-c941-4029-b89c-00e3e5568c6a service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.158s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:33:13.924404 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.managers [req-83c196c0-4e30-4dcd-9fed-3dc64d031f1e req-246ff940-c941-4029-b89c-00e3e5568c6a service neutron] Attempting to bind port cda24ac9-3c25-4710-85ff-bcd2091b8d14 on host hv-cinder-79091 for vnic_type normal with profile  {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 04:33:13.924654 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.managers [req-83c196c0-4e30-4dcd-9fed-3dc64d031f1e req-246ff940-c941-4029-b89c-00e3e5568c6a service neutron] Attempting to bind port cda24ac9-3c25-4710-85ff-bcd2091b8d14 by drivers openvswitch,hyperv on host hv-cinder-79091 at level 0 using segments [{'id': '12af0450-da1a-4552-85ca-9149ff5b7f01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 871, 'network_id': '4c58b50e-1091-40dd-b4fa-ff2da87b1475'}] {{(pid=91687) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 04:33:13.925033 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-83c196c0-4e30-4dcd-9fed-3dc64d031f1e req-246ff940-c941-4029-b89c-00e3e5568c6a service neutron] Attempting to bind port cda24ac9-3c25-4710-85ff-bcd2091b8d14 on network 4c58b50e-1091-40dd-b4fa-ff2da87b1475 {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:33:13.929853 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-83c196c0-4e30-4dcd-9fed-3dc64d031f1e req-246ff940-c941-4029-b89c-00e3e5568c6a service neutron] Port cda24ac9-3c25-4710-85ff-bcd2091b8d14 on network 4c58b50e-1091-40dd-b4fa-ff2da87b1475 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79091 {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 20 04:33:13.930329 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-83c196c0-4e30-4dcd-9fed-3dc64d031f1e req-246ff940-c941-4029-b89c-00e3e5568c6a service neutron] Attempting to bind port cda24ac9-3c25-4710-85ff-bcd2091b8d14 on network 4c58b50e-1091-40dd-b4fa-ff2da87b1475 {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:33:13.935369 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-83c196c0-4e30-4dcd-9fed-3dc64d031f1e req-246ff940-c941-4029-b89c-00e3e5568c6a service neutron] Checking agent: {'id': '7cc947fd-92eb-4d43-ad6b-ea002afff217', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79091', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 4, 19, 34), 'started_at': datetime.datetime(2021, 5, 20, 4, 19, 34), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 4, 33, 7), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 04:33:13.935699 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-83c196c0-4e30-4dcd-9fed-3dc64d031f1e req-246ff940-c941-4029-b89c-00e3e5568c6a service neutron] Checking segment: {'id': '12af0450-da1a-4552-85ca-9149ff5b7f01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 871, 'network_id': '4c58b50e-1091-40dd-b4fa-ff2da87b1475'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91687) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:33:13.936085 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-83c196c0-4e30-4dcd-9fed-3dc64d031f1e req-246ff940-c941-4029-b89c-00e3e5568c6a service neutron] Bound using segment: {'id': '12af0450-da1a-4552-85ca-9149ff5b7f01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 871, 'network_id': '4c58b50e-1091-40dd-b4fa-ff2da87b1475'} {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 04:33:13.936513 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.managers [req-83c196c0-4e30-4dcd-9fed-3dc64d031f1e req-246ff940-c941-4029-b89c-00e3e5568c6a service neutron] Bound port: cda24ac9-3c25-4710-85ff-bcd2091b8d14, host: hv-cinder-79091, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '12af0450-da1a-4552-85ca-9149ff5b7f01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 871, 'network_id': '4c58b50e-1091-40dd-b4fa-ff2da87b1475'}}] {{(pid=91687) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 04:33:13.936864 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-83c196c0-4e30-4dcd-9fed-3dc64d031f1e req-246ff940-c941-4029-b89c-00e3e5568c6a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:14.028023 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [req-83c196c0-4e30-4dcd-9fed-3dc64d031f1e req-246ff940-c941-4029-b89c-00e3e5568c6a service neutron] For port cda24ac9-3c25-4710-85ff-bcd2091b8d14, host hv-cinder-79091, cleared binding levels {{(pid=91687) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 04:33:14.031061 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [req-83c196c0-4e30-4dcd-9fed-3dc64d031f1e req-246ff940-c941-4029-b89c-00e3e5568c6a service neutron] For port cda24ac9-3c25-4710-85ff-bcd2091b8d14, host hv-cinder-79091, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=cda24ac9-3c25-4710-85ff-bcd2091b8d14,segment=NetworkSegment(12af0450-da1a-4552-85ca-9149ff5b7f01),segment_id=12af0450-da1a-4552-85ca-9149ff5b7f01)] {{(pid=91687) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 04:33:14.037075 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-83c196c0-4e30-4dcd-9fed-3dc64d031f1e req-246ff940-c941-4029-b89c-00e3e5568c6a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4162185'] for port, after_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:14.040904 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-9dba5fc7-e8e0-4c5c-a026-2e7b8bc8848e tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:33:14.217925 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83c196c0-4e30-4dcd-9fed-3dc64d031f1e req-246ff940-c941-4029-b89c-00e3e5568c6a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:33:14.218650 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-83c196c0-4e30-4dcd-9fed-3dc64d031f1e req-246ff940-c941-4029-b89c-00e3e5568c6a service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for port, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:14.219925 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-83c196c0-4e30-4dcd-9fed-3dc64d031f1e req-246ff940-c941-4029-b89c-00e3e5568c6a service neutron] 10.222.0.82 "PUT /v2.0/ports/cda24ac9-3c25-4710-85ff-bcd2091b8d14 HTTP/1.1" status: 200  len: 1093 time: 1.0564380
May 20 04:33:14.220442 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e9041636-d49b-4bde-b686-3fb6ecbf907a', 'tag': 'cda24ac9-3c25-4710-85ff-bcd2091b8d14'}] {{(pid=91687) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:33:14.240680 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-246ff940-c941-4029-b89c-00e3e5568c6a service neutron] Pushing event updated for resources: {'Port': ['ID=cda24ac9-3c25-4710-85ff-bcd2091b8d14,revision_number=3']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:33:14.244060 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-246ff940-c941-4029-b89c-00e3e5568c6a service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.203s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:33:14.295169 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e9041636-d49b-4bde-b686-3fb6ecbf907a', 'tag': 'cda24ac9-3c25-4710-85ff-bcd2091b8d14', 'status': 'completed', 'code': 200}
May 20 04:33:14.344428 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83c196c0-4e30-4dcd-9fed-3dc64d031f1e req-36674cbe-f5e8-4a2b-87ea-94523d2b8903 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:33:14.345986 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-83c196c0-4e30-4dcd-9fed-3dc64d031f1e req-36674cbe-f5e8-4a2b-87ea-94523d2b8903 service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=2035da004a584b4ea1f637e593596cd7&device_id=e9041636-d49b-4bde-b686-3fb6ecbf907a HTTP/1.1" status: 200  len: 1096 time: 0.0834515
May 20 04:33:14.418052 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-83c196c0-4e30-4dcd-9fed-3dc64d031f1e req-46ab460b-4622-4c44-bd6a-b21a6a8bff54 service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=cda24ac9-3c25-4710-85ff-bcd2091b8d14 HTTP/1.1" status: 200  len: 217 time: 0.0638368
May 20 04:33:14.483278 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83c196c0-4e30-4dcd-9fed-3dc64d031f1e req-870c2cbf-63cd-483a-8c22-e0867ace920b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:33:14.484690 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-83c196c0-4e30-4dcd-9fed-3dc64d031f1e req-870c2cbf-63cd-483a-8c22-e0867ace920b service neutron] 10.222.0.82 "GET /v2.0/subnets?id=24a65302-95b2-4d66-9d40-a9959babbe40 HTTP/1.1" status: 200  len: 850 time: 0.0591598
May 20 04:33:14.570825 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83c196c0-4e30-4dcd-9fed-3dc64d031f1e req-d67bad4e-85a1-4fdd-9c53-9b1ad7c51c4d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:33:14.572488 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-83c196c0-4e30-4dcd-9fed-3dc64d031f1e req-d67bad4e-85a1-4fdd-9c53-9b1ad7c51c4d service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=4c58b50e-1091-40dd-b4fa-ff2da87b1475&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0803354
May 20 04:33:14.585779 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-934cd845-6f42-4245-9a6f-a4e18655da7e req-dc2d9f28-d311-4c59-8b82-57caf15ed8da tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:33:14.587294 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-934cd845-6f42-4245-9a6f-a4e18655da7e req-dc2d9f28-d311-4c59-8b82-57caf15ed8da tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/ports?device_id=e9041636-d49b-4bde-b686-3fb6ecbf907a HTTP/1.1" status: 200  len: 943 time: 0.0833547
May 20 04:33:14.643609 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-934cd845-6f42-4245-9a6f-a4e18655da7e req-f96074f4-3f59-44d1-908d-76c3145b3c9e tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/security-groups?id=a91e9b1a-ef38-4317-bbea-c290d296dc7b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0476227
May 20 04:33:14.710925 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-83c196c0-4e30-4dcd-9fed-3dc64d031f1e req-a843a434-da7e-4a38-a849-54a242b307c4 service neutron] 10.222.0.82 "GET /v2.0/networks/4c58b50e-1091-40dd-b4fa-ff2da87b1475?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1313493
May 20 04:33:14.853293 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-83c196c0-4e30-4dcd-9fed-3dc64d031f1e req-7fe5a869-5a67-4571-8417-18de984a8cfb service neutron] 10.222.0.82 "GET /v2.0/networks/4c58b50e-1091-40dd-b4fa-ff2da87b1475?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1350434
May 20 04:33:14.981014 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4803610-23db-4a41-be85-574e7633ad75 req-e87a238e-9771-4219-89da-4fef62fa84e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:33:14.981014 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-f4803610-23db-4a41-be85-574e7633ad75 req-e87a238e-9771-4219-89da-4fef62fa84e8 service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=2035da004a584b4ea1f637e593596cd7&device_id=e9041636-d49b-4bde-b686-3fb6ecbf907a HTTP/1.1" status: 200  len: 1096 time: 0.0768187
May 20 04:33:15.121512 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4803610-23db-4a41-be85-574e7633ad75 req-4e1c40a7-1b26-4a9f-9d5f-5fb9c5781fe2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:33:15.122857 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-f4803610-23db-4a41-be85-574e7633ad75 req-4e1c40a7-1b26-4a9f-9d5f-5fb9c5781fe2 service neutron] 10.222.0.82 "GET /v2.0/networks?id=4c58b50e-1091-40dd-b4fa-ff2da87b1475 HTTP/1.1" status: 200  len: 912 time: 0.1348262
May 20 04:33:15.194272 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-f4803610-23db-4a41-be85-574e7633ad75 req-da122425-ac96-4a38-804f-8ef84a05e6ce service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=cda24ac9-3c25-4710-85ff-bcd2091b8d14 HTTP/1.1" status: 200  len: 217 time: 0.0642524
May 20 04:33:15.258557 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4803610-23db-4a41-be85-574e7633ad75 req-9d2a6722-9f53-4a33-a315-0cab7e925eb4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:33:15.261294 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-f4803610-23db-4a41-be85-574e7633ad75 req-9d2a6722-9f53-4a33-a315-0cab7e925eb4 service neutron] 10.222.0.82 "GET /v2.0/subnets?id=24a65302-95b2-4d66-9d40-a9959babbe40 HTTP/1.1" status: 200  len: 850 time: 0.0594089
May 20 04:33:15.342601 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4803610-23db-4a41-be85-574e7633ad75 req-51237642-5472-4fee-90ac-b2a76f0894fc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:33:15.344781 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-f4803610-23db-4a41-be85-574e7633ad75 req-51237642-5472-4fee-90ac-b2a76f0894fc service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=4c58b50e-1091-40dd-b4fa-ff2da87b1475&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0767598
May 20 04:33:15.492747 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-f4803610-23db-4a41-be85-574e7633ad75 req-ab507248-05e1-4412-b53e-978b3d9a6f94 service neutron] 10.222.0.82 "GET /v2.0/networks/4c58b50e-1091-40dd-b4fa-ff2da87b1475?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1336355
May 20 04:33:15.636101 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-f4803610-23db-4a41-be85-574e7633ad75 req-eea5b9dd-872b-4fad-8d15-1bc6bb58c4e7 service neutron] 10.222.0.82 "GET /v2.0/networks/4c58b50e-1091-40dd-b4fa-ff2da87b1475?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1409187
May 20 04:33:15.839703 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bc68160-24ca-4108-be52-4f3f87d8ae4d req-928e6338-96ad-4edf-8fa1-8fe2880e9f66 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:33:15.840327 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-6bc68160-24ca-4108-be52-4f3f87d8ae4d req-928e6338-96ad-4edf-8fa1-8fe2880e9f66 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Synchronizing usage tracker for tenant:2035da004a584b4ea1f637e593596cd7 on resource:port {{(pid=91687) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:33:15.857569 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-6bc68160-24ca-4108-be52-4f3f87d8ae4d req-928e6338-96ad-4edf-8fa1-8fe2880e9f66 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Unset dirty status for tenant:2035da004a584b4ea1f637e593596cd7 on resource:port {{(pid=91687) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:33:15.858824 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-6bc68160-24ca-4108-be52-4f3f87d8ae4d req-928e6338-96ad-4edf-8fa1-8fe2880e9f66 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/ports?device_id=e9041636-d49b-4bde-b686-3fb6ecbf907a HTTP/1.1" status: 200  len: 943 time: 0.1066053
May 20 04:33:15.907833 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-6bc68160-24ca-4108-be52-4f3f87d8ae4d req-5b8c6346-f478-42ff-9330-2a8e7c04325a tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/security-groups?id=a91e9b1a-ef38-4317-bbea-c290d296dc7b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0417650
May 20 04:33:16.521904 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device cda24ac9-3c25-4710-85ff-bcd2091b8d14 details requested by agent hyperv_hv-cinder-79091 with host hv-cinder-79091 {{(pid=91688) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 20 04:33:16.663476 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port cda24ac9-3c25-4710-85ff-bcd2091b8d14, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=cda24ac9-3c25-4710-85ff-bcd2091b8d14,segment=NetworkSegment(12af0450-da1a-4552-85ca-9149ff5b7f01),segment_id=12af0450-da1a-4552-85ca-9149ff5b7f01)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:33:16.677184 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Returning: {'device': 'cda24ac9-3c25-4710-85ff-bcd2091b8d14', 'network_id': '4c58b50e-1091-40dd-b4fa-ff2da87b1475', 'port_id': 'cda24ac9-3c25-4710-85ff-bcd2091b8d14', 'mac_address': 'fa:16:3e:4a:b7:24', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 871, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '24a65302-95b2-4d66-9d40-a9959babbe40', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91688) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 20 04:33:16.736033 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:16.753663 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.notifiers.nova [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id cda24ac9-3c25-4710-85ff-bcd2091b8d14 {{(pid=91688) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 04:33:16.770471 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port cda24ac9-3c25-4710-85ff-bcd2091b8d14, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=cda24ac9-3c25-4710-85ff-bcd2091b8d14,segment=NetworkSegment(12af0450-da1a-4552-85ca-9149ff5b7f01),segment_id=12af0450-da1a-4552-85ca-9149ff5b7f01)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:33:16.776245 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:16.778086 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-0be21ee8-33df-4171-a4b0-f09b552bb024 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:33:16.844750 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Pushing event updated for resources: {'Port': ['ID=cda24ac9-3c25-4710-85ff-bcd2091b8d14,revision_number=4']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:33:16.848050 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:33:17.106169 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5fb8eda-2335-4aa1-8fb6-19465c01f260 req-dd5905a2-b70c-4c9c-8685-9ac955104648 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:33:17.107659 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-e5fb8eda-2335-4aa1-8fb6-19465c01f260 req-dd5905a2-b70c-4c9c-8685-9ac955104648 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/ports?device_id=e9041636-d49b-4bde-b686-3fb6ecbf907a HTTP/1.1" status: 200  len: 944 time: 0.0906146
May 20 04:33:17.115929 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] get_ports_and_sgs() called for port_ids ['cda24ac9-3c25-4710-85ff-bcd2091b8d14'] {{(pid=91688) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 04:33:17.156086 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-e5fb8eda-2335-4aa1-8fb6-19465c01f260 req-8503fce2-3d75-4d4a-bb08-e2dd73b2ae69 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/security-groups?id=a91e9b1a-ef38-4317-bbea-c290d296dc7b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0408247
May 20 04:33:18.347310 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ba5e9b0-12f1-4f61-88bc-b45d33436795 req-11998e0d-89cf-44b6-a7bf-d1d0f0e95488 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:33:18.348788 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-5ba5e9b0-12f1-4f61-88bc-b45d33436795 req-11998e0d-89cf-44b6-a7bf-d1d0f0e95488 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/ports?device_id=e9041636-d49b-4bde-b686-3fb6ecbf907a HTTP/1.1" status: 200  len: 944 time: 0.0866809
May 20 04:33:18.395800 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-5ba5e9b0-12f1-4f61-88bc-b45d33436795 req-144bfc9c-2f30-433c-82d9-cef4bf8f8256 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/security-groups?id=a91e9b1a-ef38-4317-bbea-c290d296dc7b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0411813
May 20 04:33:18.536624 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device cda24ac9-3c25-4710-85ff-bcd2091b8d14 up at agent hyperv_hv-cinder-79091 {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:33:18.609897 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Provisioning for port cda24ac9-3c25-4710-85ff-bcd2091b8d14 completed by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:33:18.614773 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Provisioning complete for port cda24ac9-3c25-4710-85ff-bcd2091b8d14 triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:33:18.615153 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:18.732653 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:18.760280 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e9041636-d49b-4bde-b686-3fb6ecbf907a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cda24ac9-3c25-4710-85ff-bcd2091b8d14'}] {{(pid=91688) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:33:18.771288 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port cda24ac9-3c25-4710-85ff-bcd2091b8d14, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=cda24ac9-3c25-4710-85ff-bcd2091b8d14,segment=NetworkSegment(12af0450-da1a-4552-85ca-9149ff5b7f01),segment_id=12af0450-da1a-4552-85ca-9149ff5b7f01)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:33:18.776338 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:18.778319 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:33:18.850012 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Pushing event updated for resources: {'Port': ['ID=cda24ac9-3c25-4710-85ff-bcd2091b8d14,revision_number=5']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:33:18.853183 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:33:18.878454 dv-cinder-790910-4-iscsi neutron-server[91688]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e9041636-d49b-4bde-b686-3fb6ecbf907a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cda24ac9-3c25-4710-85ff-bcd2091b8d14', 'code': 200}
May 20 04:33:19.123104 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e403df17-ff71-457a-a083-625ee31d6ccd req-2b4a97e1-b565-4002-bf53-d1e72d2708f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:33:19.124568 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-e403df17-ff71-457a-a083-625ee31d6ccd req-2b4a97e1-b565-4002-bf53-d1e72d2708f3 service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=e9041636-d49b-4bde-b686-3fb6ecbf907a HTTP/1.1" status: 200  len: 1098 time: 0.0729799
May 20 04:33:19.176945 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-e403df17-ff71-457a-a083-625ee31d6ccd req-353e0bf2-943e-4089-9746-94a4add2a002 service neutron] 10.222.0.82 "GET /v2.0/security-groups?id=a91e9b1a-ef38-4317-bbea-c290d296dc7b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0405221
May 20 04:33:19.705267 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2713b948-9329-401d-9cb9-dc7052fb9df2 req-abfa4a69-c5d6-4492-98c5-74d5be455f2f tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:33:19.706683 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-2713b948-9329-401d-9cb9-dc7052fb9df2 req-abfa4a69-c5d6-4492-98c5-74d5be455f2f tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/ports?device_id=e9041636-d49b-4bde-b686-3fb6ecbf907a HTTP/1.1" status: 200  len: 945 time: 0.1886203
May 20 04:33:19.754606 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-2713b948-9329-401d-9cb9-dc7052fb9df2 req-9c167b36-e8df-468a-a847-6418056745e0 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/security-groups?id=a91e9b1a-ef38-4317-bbea-c290d296dc7b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0417380
May 20 04:33:20.959349 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-780177bb-70aa-4f90-af3e-7299b317dc6a req-1c390e6a-01fd-4982-abc5-380069c6e04a tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:33:20.960804 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-780177bb-70aa-4f90-af3e-7299b317dc6a req-1c390e6a-01fd-4982-abc5-380069c6e04a tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/ports?device_id=e9041636-d49b-4bde-b686-3fb6ecbf907a HTTP/1.1" status: 200  len: 945 time: 0.0835519
May 20 04:33:21.009128 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-780177bb-70aa-4f90-af3e-7299b317dc6a req-a3dc4a93-beac-4c6d-bff6-1565ad799b95 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/security-groups?id=a91e9b1a-ef38-4317-bbea-c290d296dc7b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0423985
May 20 04:33:21.212193 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68b0e626-aa69-4c12-b713-53963e7d4dcd req-e5f02e54-6af6-49e5-845c-22238d6d7479 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:33:21.214100 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-68b0e626-aa69-4c12-b713-53963e7d4dcd req-e5f02e54-6af6-49e5-845c-22238d6d7479 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/ports?device_id=e9041636-d49b-4bde-b686-3fb6ecbf907a HTTP/1.1" status: 200  len: 945 time: 0.0966418
May 20 04:33:21.222876 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 46344) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:33:21.228523 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [None req-325b4d97-47a7-4797-a139-a175ac180fec tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Request body: {'floatingip': {'port_id': 'cda24ac9-3c25-4710-85ff-bcd2091b8d14'}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:33:21.306581 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-325b4d97-47a7-4797-a139-a175ac180fec tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks [] for floatingip, before_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:21.992733 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-325b4d97-47a7-4797-a139-a175ac180fec tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks [] for floatingip, precommit_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:21.998450 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-325b4d97-47a7-4797-a139-a175ac180fec tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1716406'] for floatingip, after_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:22.172647 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.db.l3_db [None req-325b4d97-47a7-4797-a139-a175ac180fec tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Floating IP 11e49eaa-8133-4dc8-926d-cc77d7c124a1 associated. External IP: 172.27.1.225, port: cda24ac9-3c25-4710-85ff-bcd2091b8d14.
May 20 04:33:22.667191 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-325b4d97-47a7-4797-a139-a175ac180fec tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Router d4b509ec-ef18-4627-a6cf-1d7baff4e160 has already been hosted by L3 agent 02733fc0-fc9c-4e29-bc03-c27a792d539d {{(pid=91687) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 04:33:22.853878 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-325b4d97-47a7-4797-a139-a175ac180fec tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify agent at l3_agent.dv-cinder-790910-4-iscsi the message routers_updated {{(pid=91687) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 04:33:22.858253 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-325b4d97-47a7-4797-a139-a175ac180fec tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for floatingip, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:22.864579 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-06e01542-7efd-430a-bf86-e6f7168b61bc None None] Sync routers for ids ['d4b509ec-ef18-4627-a6cf-1d7baff4e160'] in dv-cinder-790910-4-iscsi {{(pid=91689) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 04:33:22.873999 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-06e01542-7efd-430a-bf86-e6f7168b61bc None None] Routers {'d4b509ec-ef18-4627-a6cf-1d7baff4e160'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91689) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:33:22.874603 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-06e01542-7efd-430a-bf86-e6f7168b61bc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced186d610>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:33:03Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['d4b509ec-ef18-4627-a6cf-1d7baff4e160'], 'active': True} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:33:22.918155 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-325b4d97-47a7-4797-a139-a175ac180fec tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "PUT /v2.0/floatingips/11e49eaa-8133-4dc8-926d-cc77d7c124a1 HTTP/1.1" status: 200  len: 991 time: 1.6941640
May 20 04:33:22.918710 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e9041636-d49b-4bde-b686-3fb6ecbf907a', 'tag': 'cda24ac9-3c25-4710-85ff-bcd2091b8d14'}] {{(pid=91687) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:33:22.973464 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e9041636-d49b-4bde-b686-3fb6ecbf907a', 'tag': 'cda24ac9-3c25-4710-85ff-bcd2091b8d14', 'status': 'completed', 'code': 200}
May 20 04:33:23.052570 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvr_db [None req-06e01542-7efd-430a-bf86-e6f7168b61bc None None] Set router d4b509ec-ef18-4627-a6cf-1d7baff4e160 gateway port host: dv-cinder-790910-4-iscsi {{(pid=91689) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:33:23.069987 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f7bb538-11b9-4f57-afb5-3b1aee02b45b req-ba534fac-2003-4742-83a8-d5221fc22dbd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:33:23.071529 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-7f7bb538-11b9-4f57-afb5-3b1aee02b45b req-ba534fac-2003-4742-83a8-d5221fc22dbd service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=2035da004a584b4ea1f637e593596cd7&device_id=e9041636-d49b-4bde-b686-3fb6ecbf907a HTTP/1.1" status: 200  len: 1098 time: 0.0769026
May 20 04:33:23.207929 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f7bb538-11b9-4f57-afb5-3b1aee02b45b req-4279c5b2-4203-4f78-a30e-12c737c46473 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:33:23.209348 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-7f7bb538-11b9-4f57-afb5-3b1aee02b45b req-4279c5b2-4203-4f78-a30e-12c737c46473 service neutron] 10.222.0.82 "GET /v2.0/networks?id=4c58b50e-1091-40dd-b4fa-ff2da87b1475 HTTP/1.1" status: 200  len: 912 time: 0.1273625
May 20 04:33:23.309206 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-7f7bb538-11b9-4f57-afb5-3b1aee02b45b req-36431382-35c8-4e46-a2d2-5f2734d6b76b service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=cda24ac9-3c25-4710-85ff-bcd2091b8d14 HTTP/1.1" status: 200  len: 999 time: 0.0934687
May 20 04:33:23.375976 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f7bb538-11b9-4f57-afb5-3b1aee02b45b req-bd0b6e0a-b345-4668-86fd-b1a13972c097 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:33:23.377450 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-7f7bb538-11b9-4f57-afb5-3b1aee02b45b req-bd0b6e0a-b345-4668-86fd-b1a13972c097 service neutron] 10.222.0.82 "GET /v2.0/subnets?id=24a65302-95b2-4d66-9d40-a9959babbe40 HTTP/1.1" status: 200  len: 850 time: 0.0618305
May 20 04:33:23.398411 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-06e01542-7efd-430a-bf86-e6f7168b61bc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced186d610>, [{'id': 'd4b509ec-ef18-4627-a6cf-1d7baff4e160', 'name': 'tempest-AttachVolumeTestJSON-1012860640-router', 'tenant_id': '2035da004a584b4ea1f637e593596cd7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.206'}], 'enable_snat': True}, 'gw_port_id': '4e511e4a-69db-4a8c-b460-faca77e2e63e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:33:02Z', 'updated_at': '2021-05-20T04:33:06Z', 'revision_number': 4, 'project_id': '2035da004a584b4ea1f637e593596cd7', 'gw_port': {'id': '4e511e4a-69db-4a8c-b460-faca77e2e63e', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:59:ad', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd4b509ec-ef18-4627-a6cf-1d7baff4e160', 'device_owner': 'network:router_gateway', 'standard_attr_id': 608, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.206', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:33:03Z', 'updated_at': '2021-05-20T04:33:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_floatingips': [{'id': '11e49eaa-8133-4dc8-926d-cc77d7c124a1', 'tenant_id': '2035da004a584b4ea1f637e593596cd7', 'floating_ip_address': '172.27.1.225', 'floating_network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'router_id': 'd4b509ec-ef18-4627-a6cf-1d7baff4e160', 'port_id': 'cda24ac9-3c25-4710-85ff-bcd2091b8d14', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 616, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4c58b50e-1091-40dd-b4fa-ff2da87b1475', 'mac_address': 'fa:16:3e:4a:b7:24', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e9041636-d49b-4bde-b686-3fb6ecbf907a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T04:33:09Z', 'updated_at': '2021-05-20T04:33:21Z', 'revision_number': 1, 'project_id': '2035da004a584b4ea1f637e593596cd7', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6bbd99c0-ca71-4a0a-8b11-1bb2be75a9c9', 'name': '', 'network_id': '4c58b50e-1091-40dd-b4fa-ff2da87b1475', 'tenant_id': '2035da004a584b4ea1f637e593596cd7', 'mac_address': 'fa:16:3e:70:97:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd4b509ec-ef18-4627-a6cf-1d7baff4e160', 'device_owner': 'network:router_interface', 'standard_attr_id': 609, 'fixed_ips': [{'subnet_id': '24a65302-95b2-4d66-9d40-a9959babbe40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:33:05Z', 'updated_at': '2021-05-20T04:33:11Z', 'revision_number': 5, 'project_id': '2035da004a584b4ea1f637e593596cd7', 'subnets': [{'id': '24a65302-95b2-4d66-9d40-a9959babbe40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:33:23.402628 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-06e01542-7efd-430a-bf86-e6f7168b61bc None None] Checking router: d4b509ec-ef18-4627-a6cf-1d7baff4e160 for host: dv-cinder-790910-4-iscsi {{(pid=91689) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 04:33:23.410947 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-06e01542-7efd-430a-bf86-e6f7168b61bc None None] Routers {'d4b509ec-ef18-4627-a6cf-1d7baff4e160'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91689) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:33:23.411540 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-06e01542-7efd-430a-bf86-e6f7168b61bc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced186d610>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:33:03Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['d4b509ec-ef18-4627-a6cf-1d7baff4e160'], 'active': True} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:33:23.454154 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f7bb538-11b9-4f57-afb5-3b1aee02b45b req-15aa77c3-674f-4ea9-ac2c-aa9528d9e551 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:33:23.455620 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-7f7bb538-11b9-4f57-afb5-3b1aee02b45b req-15aa77c3-674f-4ea9-ac2c-aa9528d9e551 service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=4c58b50e-1091-40dd-b4fa-ff2da87b1475&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0719779
May 20 04:33:23.587246 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-7f7bb538-11b9-4f57-afb5-3b1aee02b45b req-fa5128ed-ad58-4c9c-8c9b-20c9beb66cda service neutron] 10.222.0.82 "GET /v2.0/networks/4c58b50e-1091-40dd-b4fa-ff2da87b1475?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1251845
May 20 04:33:23.608017 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvr_db [None req-06e01542-7efd-430a-bf86-e6f7168b61bc None None] Set router d4b509ec-ef18-4627-a6cf-1d7baff4e160 gateway port host: dv-cinder-790910-4-iscsi {{(pid=91689) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:33:23.722138 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-7f7bb538-11b9-4f57-afb5-3b1aee02b45b req-0803e786-6535-4757-b0d1-2512f83505d9 service neutron] 10.222.0.82 "GET /v2.0/networks/4c58b50e-1091-40dd-b4fa-ff2da87b1475?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1270130
May 20 04:33:23.970256 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-06e01542-7efd-430a-bf86-e6f7168b61bc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced186d610>, [{'id': 'd4b509ec-ef18-4627-a6cf-1d7baff4e160', 'name': 'tempest-AttachVolumeTestJSON-1012860640-router', 'tenant_id': '2035da004a584b4ea1f637e593596cd7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.206'}], 'enable_snat': True}, 'gw_port_id': '4e511e4a-69db-4a8c-b460-faca77e2e63e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:33:02Z', 'updated_at': '2021-05-20T04:33:06Z', 'revision_number': 4, 'project_id': '2035da004a584b4ea1f637e593596cd7', 'gw_port': {'id': '4e511e4a-69db-4a8c-b460-faca77e2e63e', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:59:ad', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd4b509ec-ef18-4627-a6cf-1d7baff4e160', 'device_owner': 'network:router_gateway', 'standard_attr_id': 608, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.206', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:33:03Z', 'updated_at': '2021-05-20T04:33:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_floatingips': [{'id': '11e49eaa-8133-4dc8-926d-cc77d7c124a1', 'tenant_id': '2035da004a584b4ea1f637e593596cd7', 'floating_ip_address': '172.27.1.225', 'floating_network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'router_id': 'd4b509ec-ef18-4627-a6cf-1d7baff4e160', 'port_id': 'cda24ac9-3c25-4710-85ff-bcd2091b8d14', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 616, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4c58b50e-1091-40dd-b4fa-ff2da87b1475', 'mac_address': 'fa:16:3e:4a:b7:24', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e9041636-d49b-4bde-b686-3fb6ecbf907a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T04:33:09Z', 'updated_at': '2021-05-20T04:33:21Z', 'revision_number': 1, 'project_id': '2035da004a584b4ea1f637e593596cd7', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6bbd99c0-ca71-4a0a-8b11-1bb2be75a9c9', 'name': '', 'network_id': '4c58b50e-1091-40dd-b4fa-ff2da87b1475', 'tenant_id': '2035da004a584b4ea1f637e593596cd7', 'mac_address': 'fa:16:3e:70:97:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd4b509ec-ef18-4627-a6cf-1d7baff4e160', 'device_owner': 'network:router_interface', 'standard_attr_id': 609, 'fixed_ips': [{'subnet_id': '24a65302-95b2-4d66-9d40-a9959babbe40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:33:05Z', 'updated_at': '2021-05-20T04:33:11Z', 'revision_number': 5, 'project_id': '2035da004a584b4ea1f637e593596cd7', 'subnets': [{'id': '24a65302-95b2-4d66-9d40-a9959babbe40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:33:23.974757 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-06e01542-7efd-430a-bf86-e6f7168b61bc None None] The sync data for ids ['d4b509ec-ef18-4627-a6cf-1d7baff4e160'] in dv-cinder-790910-4-iscsi is: [{'id': 'd4b509ec-ef18-4627-a6cf-1d7baff4e160', 'name': 'tempest-AttachVolumeTestJSON-1012860640-router', 'tenant_id': '2035da004a584b4ea1f637e593596cd7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.206'}], 'enable_snat': True}, 'gw_port_id': '4e511e4a-69db-4a8c-b460-faca77e2e63e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:33:02Z', 'updated_at': '2021-05-20T04:33:06Z', 'revision_number': 4, 'project_id': '2035da004a584b4ea1f637e593596cd7', 'gw_port': {'id': '4e511e4a-69db-4a8c-b460-faca77e2e63e', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:59:ad', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd4b509ec-ef18-4627-a6cf-1d7baff4e160', 'device_owner': 'network:router_gateway', 'standard_attr_id': 608, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.206', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:33:03Z', 'updated_at': '2021-05-20T04:33:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_floatingips': [{'id': '11e49eaa-8133-4dc8-926d-cc77d7c124a1', 'tenant_id': '2035da004a584b4ea1f637e593596cd7', 'floating_ip_address': '172.27.1.225', 'floating_network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'router_id': 'd4b509ec-ef18-4627-a6cf-1d7baff4e160', 'port_id': 'cda24ac9-3c25-4710-85ff-bcd2091b8d14', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 616, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4c58b50e-1091-40dd-b4fa-ff2da87b1475', 'mac_address': 'fa:16:3e:4a:b7:24', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e9041636-d49b-4bde-b686-3fb6ecbf907a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T04:33:09Z', 'updated_at': '2021-05-20T04:33:21Z', 'revision_number': 1, 'project_id': '2035da004a584b4ea1f637e593596cd7', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6bbd99c0-ca71-4a0a-8b11-1bb2be75a9c9', 'name': '', 'network_id': '4c58b50e-1091-40dd-b4fa-ff2da87b1475', 'tenant_id': '2035da004a584b4ea1f637e593596cd7', 'mac_address': 'fa:16:3e:70:97:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd4b509ec-ef18-4627-a6cf-1d7baff4e160', 'device_owner': 'network:router_interface', 'standard_attr_id': 609, 'fixed_ips': [{'subnet_id': '24a65302-95b2-4d66-9d40-a9959babbe40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:33:05Z', 'updated_at': '2021-05-20T04:33:11Z', 'revision_number': 5, 'project_id': '2035da004a584b4ea1f637e593596cd7', 'subnets': [{'id': '24a65302-95b2-4d66-9d40-a9959babbe40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91689) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 04:33:24.167119 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-47cc4634-2e70-4df2-ac7a-488151373e90 None None] New status for floating IP 11e49eaa-8133-4dc8-926d-cc77d7c124a1: ACTIVE {{(pid=91688) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 20 04:33:29.863542 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-e5be65e9-65a0-40ae-9b05-30972a53179c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:32.575187 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:32.717538 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-4cd0e3af-3e7b-4643-9e24-db001ff439e4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:33.374259 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ea4803bd-878f-47d5-9084-1ec41953c9db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:35.225884 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f21320cc-6a25-4ec1-8a32-8b119b35fd55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:36.598869 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:33:39.587244 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4a25f0c2-8082-47cb-abd9-9812bee89727 req-fd2c3ec2-4224-4223-b219-16f269c15787 service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=de26e049-9f19-44e7-93d5-64ccd77cb9de&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0972722
May 20 04:33:39.678775 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a25f0c2-8082-47cb-abd9-9812bee89727 req-ab92f420-cb79-4fe0-ab8d-613692068cc9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:33:39.680223 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4a25f0c2-8082-47cb-abd9-9812bee89727 req-ab92f420-cb79-4fe0-ab8d-613692068cc9 service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=9b6fb271a7a546a38b0c6df5beaf22fc&device_id=de26e049-9f19-44e7-93d5-64ccd77cb9de HTTP/1.1" status: 200  len: 1099 time: 0.0723026
May 20 04:33:39.835653 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a25f0c2-8082-47cb-abd9-9812bee89727 req-4764e2ac-3950-42fd-8ef8-ff5ae7045fb7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:33:39.837146 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4a25f0c2-8082-47cb-abd9-9812bee89727 req-4764e2ac-3950-42fd-8ef8-ff5ae7045fb7 service neutron] 10.222.0.82 "GET /v2.0/networks?id=11c994a8-6ede-4290-84f0-71af466860db HTTP/1.1" status: 200  len: 912 time: 0.1320736
May 20 04:33:39.952245 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4a25f0c2-8082-47cb-abd9-9812bee89727 req-e50ed4a3-e7c4-4d72-81cf-91483b49bc3f service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=b1bae5dc-7bbe-4c23-b60b-26cf817da0ee HTTP/1.1" status: 200  len: 1001 time: 0.1073658
May 20 04:33:40.019808 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a25f0c2-8082-47cb-abd9-9812bee89727 req-faa81e18-b35a-4dde-b31e-eaf4cbcaff22 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:33:40.021521 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4a25f0c2-8082-47cb-abd9-9812bee89727 req-faa81e18-b35a-4dde-b31e-eaf4cbcaff22 service neutron] 10.222.0.82 "GET /v2.0/subnets?id=51af45f1-449a-400c-8714-8d713d4a7993 HTTP/1.1" status: 200  len: 850 time: 0.0613987
May 20 04:33:40.211080 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a25f0c2-8082-47cb-abd9-9812bee89727 req-f1be53e3-76bd-4bb3-8655-df10fb344984 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:33:40.212429 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4a25f0c2-8082-47cb-abd9-9812bee89727 req-f1be53e3-76bd-4bb3-8655-df10fb344984 service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=11c994a8-6ede-4290-84f0-71af466860db&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1827462
May 20 04:33:40.346676 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4a25f0c2-8082-47cb-abd9-9812bee89727 req-56c4f07a-5429-4c06-9b3a-85b919995fa8 service neutron] 10.222.0.82 "GET /v2.0/networks/11c994a8-6ede-4290-84f0-71af466860db?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1266427
May 20 04:33:40.480253 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4a25f0c2-8082-47cb-abd9-9812bee89727 req-b0a2fe5a-2403-49a0-b828-8d7fc2ebc856 service neutron] 10.222.0.82 "GET /v2.0/networks/11c994a8-6ede-4290-84f0-71af466860db?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1257277
May 20 04:33:48.957150 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.agents_db [None req-92d61f12-17bc-4bf9-9eab-8a69b8c6da2f None None] Agent healthcheck: found 6 active agents {{(pid=91689) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 04:33:59.865202 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-2b8d38d3-4964-4e23-a6af-7b0f1c84dec8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:34:02.580889 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:34:02.723307 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ac52c656-9783-4f99-879f-33beec952f87 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:34:03.377818 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ea4803bd-878f-47d5-9084-1ec41953c9db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:34:05.233383 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f21320cc-6a25-4ec1-8a32-8b119b35fd55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:34:06.621740 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:34:14.088815 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-85dd133e-9978-4afd-812f-37cf0b29b12b req-0df28168-b398-4054-988a-567658e040db tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1603607005&fields=id&tenant_id=9b6fb271a7a546a38b0c6df5beaf22fc HTTP/1.1" status: 200  len: 267 time: 0.0459554
May 20 04:34:14.260647 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85dd133e-9978-4afd-812f-37cf0b29b12b req-ae5105f9-c5a4-42f5-9381-11d801494700 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:34:14.262169 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-85dd133e-9978-4afd-812f-37cf0b29b12b req-ae5105f9-c5a4-42f5-9381-11d801494700 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/networks?id=11c994a8-6ede-4290-84f0-71af466860db HTTP/1.1" status: 200  len: 811 time: 0.1631880
May 20 04:34:14.278078 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-85dd133e-9978-4afd-812f-37cf0b29b12b req-3f5c74a0-d0a2-477e-9816-da5312f89cbf tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/quotas/9b6fb271a7a546a38b0c6df5beaf22fc HTTP/1.1" status: 200  len: 375 time: 0.0100479
May 20 04:34:14.373551 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-85dd133e-9978-4afd-812f-37cf0b29b12b req-235c0409-e4ef-40e2-b0c5-7c5ffee85ce0 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/ports?tenant_id=9b6fb271a7a546a38b0c6df5beaf22fc&fields=id HTTP/1.1" status: 200  len: 440 time: 0.0902967
May 20 04:34:14.599941 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-85dd133e-9978-4afd-812f-37cf0b29b12b req-718dd217-90f9-4a3a-b720-21de8a07cff8 service neutron] 10.222.0.71 "GET /v2.0/networks/11c994a8-6ede-4290-84f0-71af466860db?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2114069
May 20 04:34:14.730177 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-85dd133e-9978-4afd-812f-37cf0b29b12b req-78a182ce-aa3f-4fd5-b63c-0a8e6d589a73 service neutron] 10.222.0.71 "GET /v2.0/networks/11c994a8-6ede-4290-84f0-71af466860db?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1243205
May 20 04:34:15.140697 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-d3901b05-718d-4580-b45e-031e9c1984a9 req-64c41f96-d648-4f7c-ad04-e597b05b9fd7 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/ports?device_id=45272356-d63b-4804-88a7-a122c4ed71ca HTTP/1.1" status: 200  len: 210 time: 0.0422528
May 20 04:34:16.305936 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85dd133e-9978-4afd-812f-37cf0b29b12b req-b7704d22-47c5-49da-a5a6-b367be90621c tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:34:16.307341 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-85dd133e-9978-4afd-812f-37cf0b29b12b req-b7704d22-47c5-49da-a5a6-b367be90621c tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.82 "GET /v2.0/networks?id=11c994a8-6ede-4290-84f0-71af466860db HTTP/1.1" status: 200  len: 811 time: 0.1893470
May 20 04:34:16.309497 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-666cb571-75de-44ec-951d-222a8793cb0d req-90b06f28-9ecf-41bb-9d3f-1a1e90e74592 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/ports?device_id=45272356-d63b-4804-88a7-a122c4ed71ca HTTP/1.1" status: 200  len: 210 time: 0.0579627
May 20 04:34:16.356871 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-85dd133e-9978-4afd-812f-37cf0b29b12b req-855c0313-f66b-4976-824e-7248e9046559 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.82 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=9b6fb271a7a546a38b0c6df5beaf22fc HTTP/1.1" status: 200  len: 380 time: 0.0407999
May 20 04:34:16.366758 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [req-85dd133e-9978-4afd-812f-37cf0b29b12b req-8648ccb0-fd9c-42ca-ad7b-bec435a7135a tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Request body: {'port': {'device_id': '45272356-d63b-4804-88a7-a122c4ed71ca', 'network_id': '11c994a8-6ede-4290-84f0-71af466860db', 'admin_state_up': True, 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'security_groups': ['ef28d688-789b-4282-a30c-d7d731615fbf']}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:34:16.505108 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [req-85dd133e-9978-4afd-812f-37cf0b29b12b req-8648ccb0-fd9c-42ca-ad7b-bec435a7135a tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:34:16.515836 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [req-85dd133e-9978-4afd-812f-37cf0b29b12b req-8648ccb0-fd9c-42ca-ad7b-bec435a7135a tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attempting to reserve 1 items for resource port. Total usage: 4; quota limit: 500; headroom:496 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:34:16.528197 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-85dd133e-9978-4afd-812f-37cf0b29b12b req-8648ccb0-fd9c-42ca-ad7b-bec435a7135a tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Made reservation on behalf of 9b6fb271a7a546a38b0c6df5beaf22fc for: {'port': 1} {{(pid=91687) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 04:34:16.532220 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-85dd133e-9978-4afd-812f-37cf0b29b12b req-8648ccb0-fd9c-42ca-ad7b-bec435a7135a tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:34:16.708490 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.db_base_plugin_common [req-85dd133e-9978-4afd-812f-37cf0b29b12b req-8648ccb0-fd9c-42ca-ad7b-bec435a7135a tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Allocated IP 172.20.0.9 (11c994a8-6ede-4290-84f0-71af466860db/51af45f1-449a-400c-8714-8d713d4a7993/1549cd2e-e51f-42cf-9024-803e9fae98be) {{(pid=91687) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 04:34:16.900523 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-85dd133e-9978-4afd-812f-37cf0b29b12b req-8648ccb0-fd9c-42ca-ad7b-bec435a7135a tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks [] for port, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:34:16.915605 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.provisioning_blocks [req-85dd133e-9978-4afd-812f-37cf0b29b12b req-8648ccb0-fd9c-42ca-ad7b-bec435a7135a tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Transition to ACTIVE for port object 1549cd2e-e51f-42cf-9024-803e9fae98be will not be triggered until provisioned by entity DHCP. {{(pid=91687) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:34:16.939551 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-85dd133e-9978-4afd-812f-37cf0b29b12b req-8648ccb0-fd9c-42ca-ad7b-bec435a7135a tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8782892106231', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4162192'] for port, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:34:16.945686 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-a081b454-f278-43ba-955f-0b89597da459 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:34:17.009573 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-85dd133e-9978-4afd-812f-37cf0b29b12b req-8648ccb0-fd9c-42ca-ad7b-bec435a7135a tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Network 11c994a8-6ede-4290-84f0-71af466860db is already hosted by enough agents. {{(pid=91687) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:34:17.010783 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.base_scheduler [req-85dd133e-9978-4afd-812f-37cf0b29b12b req-8648ccb0-fd9c-42ca-ad7b-bec435a7135a tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Resources bound (agent type, host, resource id):  {{(pid=91687) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:34:17.014765 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.l3_dvrscheduler_db [req-85dd133e-9978-4afd-812f-37cf0b29b12b req-8648ccb0-fd9c-42ca-ad7b-bec435a7135a tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Received port after_create {{(pid=91687) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 04:34:17.062196 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8648ccb0-fd9c-42ca-ad7b-bec435a7135a tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Pushing event updated for resources: {'Port': ['ID=1549cd2e-e51f-42cf-9024-803e9fae98be,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:34:17.080101 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8648ccb0-fd9c-42ca-ad7b-bec435a7135a tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:34:17.080479 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8648ccb0-fd9c-42ca-ad7b-bec435a7135a tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:34:17.080855 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8648ccb0-fd9c-42ca-ad7b-bec435a7135a tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:34:17.081324 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8648ccb0-fd9c-42ca-ad7b-bec435a7135a tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:34:17.081682 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8648ccb0-fd9c-42ca-ad7b-bec435a7135a tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:34:17.082042 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8648ccb0-fd9c-42ca-ad7b-bec435a7135a tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:34:17.082395 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8648ccb0-fd9c-42ca-ad7b-bec435a7135a tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:34:17.082746 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8648ccb0-fd9c-42ca-ad7b-bec435a7135a tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:34:17.083097 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8648ccb0-fd9c-42ca-ad7b-bec435a7135a tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:34:17.083430 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8648ccb0-fd9c-42ca-ad7b-bec435a7135a tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:34:17.083764 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8648ccb0-fd9c-42ca-ad7b-bec435a7135a tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:34:17.084169 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8648ccb0-fd9c-42ca-ad7b-bec435a7135a tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:34:17.089896 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-8648ccb0-fd9c-42ca-ad7b-bec435a7135a tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.144s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:34:17.103819 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85dd133e-9978-4afd-812f-37cf0b29b12b req-8648ccb0-fd9c-42ca-ad7b-bec435a7135a tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:34:17.104440 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-85dd133e-9978-4afd-812f-37cf0b29b12b req-8648ccb0-fd9c-42ca-ad7b-bec435a7135a tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for port, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:34:17.133601 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-85dd133e-9978-4afd-812f-37cf0b29b12b req-8648ccb0-fd9c-42ca-ad7b-bec435a7135a tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 0.7713659
May 20 04:34:17.147339 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [req-85dd133e-9978-4afd-812f-37cf0b29b12b req-7d91dbea-3e0a-4d97-8ab8-63f028e45104 service neutron] Request body: {'port': {'device_id': '45272356-d63b-4804-88a7-a122c4ed71ca', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79091'}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:34:17.215370 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-642b726a-f605-459e-a78e-f0911f43e674 None None] Provisioning for port 1549cd2e-e51f-42cf-9024-803e9fae98be completed by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:34:17.220064 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-642b726a-f605-459e-a78e-f0911f43e674 None None] Provisioning complete for port 1549cd2e-e51f-42cf-9024-803e9fae98be triggered by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:34:17.220442 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-642b726a-f605-459e-a78e-f0911f43e674 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:34:17.262770 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-85dd133e-9978-4afd-812f-37cf0b29b12b req-7d91dbea-3e0a-4d97-8ab8-63f028e45104 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:34:17.272985 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-642b726a-f605-459e-a78e-f0911f43e674 None None] Port 1549cd2e-e51f-42cf-9024-803e9fae98be cannot update to ACTIVE because it is not bound. {{(pid=91688) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 20 04:34:17.722223 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de4c8108-d738-43a7-98c5-0921745c722d req-3c863edb-129c-4f7d-ac54-1d4c1477851d tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:34:17.722894 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-de4c8108-d738-43a7-98c5-0921745c722d req-3c863edb-129c-4f7d-ac54-1d4c1477851d tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Synchronizing usage tracker for tenant:9b6fb271a7a546a38b0c6df5beaf22fc on resource:port {{(pid=91687) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:34:17.791196 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-de4c8108-d738-43a7-98c5-0921745c722d req-3c863edb-129c-4f7d-ac54-1d4c1477851d tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Unset dirty status for tenant:9b6fb271a7a546a38b0c6df5beaf22fc on resource:port {{(pid=91687) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:34:17.792356 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-de4c8108-d738-43a7-98c5-0921745c722d req-3c863edb-129c-4f7d-ac54-1d4c1477851d tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/ports?device_id=45272356-d63b-4804-88a7-a122c4ed71ca HTTP/1.1" status: 200  len: 931 time: 0.3660941
May 20 04:34:17.798005 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.notifiers.nova [req-85dd133e-9978-4afd-812f-37cf0b29b12b req-7d91dbea-3e0a-4d97-8ab8-63f028e45104 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 1549cd2e-e51f-42cf-9024-803e9fae98be {{(pid=91687) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 04:34:17.818070 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-85dd133e-9978-4afd-812f-37cf0b29b12b req-7d91dbea-3e0a-4d97-8ab8-63f028e45104 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:34:17.848795 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.provisioning_blocks [req-85dd133e-9978-4afd-812f-37cf0b29b12b req-7d91dbea-3e0a-4d97-8ab8-63f028e45104 service neutron] Transition to ACTIVE for port object 1549cd2e-e51f-42cf-9024-803e9fae98be will not be triggered until provisioned by entity L2. {{(pid=91687) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:34:17.855163 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-85dd133e-9978-4afd-812f-37cf0b29b12b req-7d91dbea-3e0a-4d97-8ab8-63f028e45104 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4162185'] for port, after_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:34:17.860300 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-92f6027b-1196-45b3-880e-014689c17643 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:34:17.891902 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-de4c8108-d738-43a7-98c5-0921745c722d req-eeae26da-ec1d-4824-8e8a-392227e0f127 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/security-groups?id=ef28d688-789b-4282-a30c-d7d731615fbf&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0892828
May 20 04:34:18.013187 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d91dbea-3e0a-4d97-8ab8-63f028e45104 service neutron] Pushing event updated for resources: {'Port': ['ID=1549cd2e-e51f-42cf-9024-803e9fae98be,revision_number=2']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:34:18.020719 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-7d91dbea-3e0a-4d97-8ab8-63f028e45104 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.160s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:34:18.095083 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.managers [req-85dd133e-9978-4afd-812f-37cf0b29b12b req-7d91dbea-3e0a-4d97-8ab8-63f028e45104 service neutron] Attempting to bind port 1549cd2e-e51f-42cf-9024-803e9fae98be on host hv-cinder-79091 for vnic_type normal with profile  {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 04:34:18.095424 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.managers [req-85dd133e-9978-4afd-812f-37cf0b29b12b req-7d91dbea-3e0a-4d97-8ab8-63f028e45104 service neutron] Attempting to bind port 1549cd2e-e51f-42cf-9024-803e9fae98be by drivers openvswitch,hyperv on host hv-cinder-79091 at level 0 using segments [{'id': 'e9f32492-7a41-4dc9-bc94-b8bce4a8e65d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': '11c994a8-6ede-4290-84f0-71af466860db'}] {{(pid=91687) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 04:34:18.095755 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-85dd133e-9978-4afd-812f-37cf0b29b12b req-7d91dbea-3e0a-4d97-8ab8-63f028e45104 service neutron] Attempting to bind port 1549cd2e-e51f-42cf-9024-803e9fae98be on network 11c994a8-6ede-4290-84f0-71af466860db {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:34:18.100738 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-85dd133e-9978-4afd-812f-37cf0b29b12b req-7d91dbea-3e0a-4d97-8ab8-63f028e45104 service neutron] Port 1549cd2e-e51f-42cf-9024-803e9fae98be on network 11c994a8-6ede-4290-84f0-71af466860db not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79091 {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 20 04:34:18.101094 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-85dd133e-9978-4afd-812f-37cf0b29b12b req-7d91dbea-3e0a-4d97-8ab8-63f028e45104 service neutron] Attempting to bind port 1549cd2e-e51f-42cf-9024-803e9fae98be on network 11c994a8-6ede-4290-84f0-71af466860db {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:34:18.106708 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-85dd133e-9978-4afd-812f-37cf0b29b12b req-7d91dbea-3e0a-4d97-8ab8-63f028e45104 service neutron] Checking agent: {'id': '7cc947fd-92eb-4d43-ad6b-ea002afff217', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79091', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 4, 19, 34), 'started_at': datetime.datetime(2021, 5, 20, 4, 19, 34), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 4, 34, 7), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 04:34:18.107090 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-85dd133e-9978-4afd-812f-37cf0b29b12b req-7d91dbea-3e0a-4d97-8ab8-63f028e45104 service neutron] Checking segment: {'id': 'e9f32492-7a41-4dc9-bc94-b8bce4a8e65d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': '11c994a8-6ede-4290-84f0-71af466860db'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91687) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:34:18.107473 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-85dd133e-9978-4afd-812f-37cf0b29b12b req-7d91dbea-3e0a-4d97-8ab8-63f028e45104 service neutron] Bound using segment: {'id': 'e9f32492-7a41-4dc9-bc94-b8bce4a8e65d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': '11c994a8-6ede-4290-84f0-71af466860db'} {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 04:34:18.107899 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.managers [req-85dd133e-9978-4afd-812f-37cf0b29b12b req-7d91dbea-3e0a-4d97-8ab8-63f028e45104 service neutron] Bound port: 1549cd2e-e51f-42cf-9024-803e9fae98be, host: hv-cinder-79091, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'e9f32492-7a41-4dc9-bc94-b8bce4a8e65d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': '11c994a8-6ede-4290-84f0-71af466860db'}}] {{(pid=91687) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 04:34:18.108247 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-85dd133e-9978-4afd-812f-37cf0b29b12b req-7d91dbea-3e0a-4d97-8ab8-63f028e45104 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:34:18.205149 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [req-85dd133e-9978-4afd-812f-37cf0b29b12b req-7d91dbea-3e0a-4d97-8ab8-63f028e45104 service neutron] For port 1549cd2e-e51f-42cf-9024-803e9fae98be, host hv-cinder-79091, cleared binding levels {{(pid=91687) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 04:34:18.208363 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [req-85dd133e-9978-4afd-812f-37cf0b29b12b req-7d91dbea-3e0a-4d97-8ab8-63f028e45104 service neutron] For port 1549cd2e-e51f-42cf-9024-803e9fae98be, host hv-cinder-79091, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=1549cd2e-e51f-42cf-9024-803e9fae98be,segment=NetworkSegment(e9f32492-7a41-4dc9-bc94-b8bce4a8e65d),segment_id=e9f32492-7a41-4dc9-bc94-b8bce4a8e65d)] {{(pid=91687) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 04:34:18.215526 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-85dd133e-9978-4afd-812f-37cf0b29b12b req-7d91dbea-3e0a-4d97-8ab8-63f028e45104 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4162185'] for port, after_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:34:18.221330 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-fb63cdb0-ec06-4fd9-a9a0-eba94daa4568 tempest-AttachVolumeShelveTestJSON-24030006 tempest-AttachVolumeShelveTestJSON-24030006-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:34:18.278503 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85dd133e-9978-4afd-812f-37cf0b29b12b req-7d91dbea-3e0a-4d97-8ab8-63f028e45104 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:34:18.279149 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-85dd133e-9978-4afd-812f-37cf0b29b12b req-7d91dbea-3e0a-4d97-8ab8-63f028e45104 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for port, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:34:18.280450 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-85dd133e-9978-4afd-812f-37cf0b29b12b req-7d91dbea-3e0a-4d97-8ab8-63f028e45104 service neutron] 10.222.0.82 "PUT /v2.0/ports/1549cd2e-e51f-42cf-9024-803e9fae98be HTTP/1.1" status: 200  len: 1093 time: 1.1379199
May 20 04:34:18.280945 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '45272356-d63b-4804-88a7-a122c4ed71ca', 'tag': '1549cd2e-e51f-42cf-9024-803e9fae98be'}] {{(pid=91687) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:34:18.306150 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d91dbea-3e0a-4d97-8ab8-63f028e45104 service neutron] Pushing event updated for resources: {'Port': ['ID=1549cd2e-e51f-42cf-9024-803e9fae98be,revision_number=3']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:34:18.310149 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-7d91dbea-3e0a-4d97-8ab8-63f028e45104 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:34:18.372397 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '45272356-d63b-4804-88a7-a122c4ed71ca', 'tag': '1549cd2e-e51f-42cf-9024-803e9fae98be', 'status': 'completed', 'code': 200}
May 20 04:34:18.412562 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85dd133e-9978-4afd-812f-37cf0b29b12b req-388e68b0-cee6-4ea0-803d-f9c72ff01f52 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:34:18.414117 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-85dd133e-9978-4afd-812f-37cf0b29b12b req-388e68b0-cee6-4ea0-803d-f9c72ff01f52 service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=9b6fb271a7a546a38b0c6df5beaf22fc&device_id=45272356-d63b-4804-88a7-a122c4ed71ca HTTP/1.1" status: 200  len: 1096 time: 0.0813167
May 20 04:34:18.485331 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-85dd133e-9978-4afd-812f-37cf0b29b12b req-a5b82aa5-0225-4110-8134-8cd7776017bb service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=1549cd2e-e51f-42cf-9024-803e9fae98be HTTP/1.1" status: 200  len: 217 time: 0.0630221
May 20 04:34:18.560753 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85dd133e-9978-4afd-812f-37cf0b29b12b req-a99589aa-658c-4dba-bb86-c44531153d75 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:34:18.562192 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-85dd133e-9978-4afd-812f-37cf0b29b12b req-a99589aa-658c-4dba-bb86-c44531153d75 service neutron] 10.222.0.82 "GET /v2.0/subnets?id=51af45f1-449a-400c-8714-8d713d4a7993 HTTP/1.1" status: 200  len: 850 time: 0.0710614
May 20 04:34:18.640461 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85dd133e-9978-4afd-812f-37cf0b29b12b req-c8cc8737-57fe-479f-926a-d78d3fbdacf2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:34:18.641994 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-85dd133e-9978-4afd-812f-37cf0b29b12b req-c8cc8737-57fe-479f-926a-d78d3fbdacf2 service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=11c994a8-6ede-4290-84f0-71af466860db&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0723035
May 20 04:34:18.778310 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-85dd133e-9978-4afd-812f-37cf0b29b12b req-da1eb57a-c942-4bfa-8a6d-f0a36120bacc service neutron] 10.222.0.82 "GET /v2.0/networks/11c994a8-6ede-4290-84f0-71af466860db?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1291413
May 20 04:34:18.922517 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-85dd133e-9978-4afd-812f-37cf0b29b12b req-40d5f1ed-8a43-4179-8999-04320ef4c36f service neutron] 10.222.0.82 "GET /v2.0/networks/11c994a8-6ede-4290-84f0-71af466860db?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1367910
May 20 04:34:19.047298 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a07448b7-3561-4665-a66a-8dc03fb014c6 req-b4a93eb8-cbc1-44e0-9dfc-608a8ef622c8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:34:19.048785 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a07448b7-3561-4665-a66a-8dc03fb014c6 req-b4a93eb8-cbc1-44e0-9dfc-608a8ef622c8 service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=9b6fb271a7a546a38b0c6df5beaf22fc&device_id=45272356-d63b-4804-88a7-a122c4ed71ca HTTP/1.1" status: 200  len: 1096 time: 0.0782754
May 20 04:34:19.084443 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45fa6fba-098c-4837-a20e-8ecb576f2348 req-a23a22ee-04b9-4856-816c-43a4c4098597 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:34:19.085958 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-45fa6fba-098c-4837-a20e-8ecb576f2348 req-a23a22ee-04b9-4856-816c-43a4c4098597 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/ports?device_id=45272356-d63b-4804-88a7-a122c4ed71ca HTTP/1.1" status: 200  len: 943 time: 0.0854740
May 20 04:34:19.131239 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-45fa6fba-098c-4837-a20e-8ecb576f2348 req-bf47baba-a450-4a8f-ba5a-cba9c710dd22 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/security-groups?id=ef28d688-789b-4282-a30c-d7d731615fbf&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0392926
May 20 04:34:19.182714 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a07448b7-3561-4665-a66a-8dc03fb014c6 req-e7f19272-97ef-4420-9068-57ec77849762 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:34:19.184157 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a07448b7-3561-4665-a66a-8dc03fb014c6 req-e7f19272-97ef-4420-9068-57ec77849762 service neutron] 10.222.0.82 "GET /v2.0/networks?id=11c994a8-6ede-4290-84f0-71af466860db HTTP/1.1" status: 200  len: 912 time: 0.1279290
May 20 04:34:19.251148 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a07448b7-3561-4665-a66a-8dc03fb014c6 req-314cf13c-9ad5-4339-9536-3d2b6dd528b2 service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=1549cd2e-e51f-42cf-9024-803e9fae98be HTTP/1.1" status: 200  len: 217 time: 0.0596566
May 20 04:34:19.326207 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a07448b7-3561-4665-a66a-8dc03fb014c6 req-efe65c33-6700-4f48-8ba4-c44215cc58e6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:34:19.328362 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a07448b7-3561-4665-a66a-8dc03fb014c6 req-efe65c33-6700-4f48-8ba4-c44215cc58e6 service neutron] 10.222.0.82 "GET /v2.0/subnets?id=51af45f1-449a-400c-8714-8d713d4a7993 HTTP/1.1" status: 200  len: 850 time: 0.0710025
May 20 04:34:19.408291 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a07448b7-3561-4665-a66a-8dc03fb014c6 req-a8bd7f31-9168-4805-a4c1-16284fa42b8d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:34:19.409824 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a07448b7-3561-4665-a66a-8dc03fb014c6 req-a8bd7f31-9168-4805-a4c1-16284fa42b8d service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=11c994a8-6ede-4290-84f0-71af466860db&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0749733
May 20 04:34:19.643583 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a07448b7-3561-4665-a66a-8dc03fb014c6 req-c6dac927-fa87-43dd-9f0c-43b182cf86a4 service neutron] 10.222.0.82 "GET /v2.0/networks/11c994a8-6ede-4290-84f0-71af466860db?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2263355
May 20 04:34:19.786528 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a07448b7-3561-4665-a66a-8dc03fb014c6 req-d0a2ab02-ae42-4bad-afc0-abda11a2a1e4 service neutron] 10.222.0.82 "GET /v2.0/networks/11c994a8-6ede-4290-84f0-71af466860db?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1357217
May 20 04:34:20.328167 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fa78ad3-0791-48ae-b981-85ff04b2c05d req-5452254e-571b-46bb-b56f-701c25bd0c7d tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:34:20.329630 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-6fa78ad3-0791-48ae-b981-85ff04b2c05d req-5452254e-571b-46bb-b56f-701c25bd0c7d tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/ports?device_id=45272356-d63b-4804-88a7-a122c4ed71ca HTTP/1.1" status: 200  len: 943 time: 0.0868828
May 20 04:34:20.379679 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-6fa78ad3-0791-48ae-b981-85ff04b2c05d req-6d3ac582-f19e-4073-9e80-525f7feff197 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/security-groups?id=ef28d688-789b-4282-a30c-d7d731615fbf&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0414670
May 20 04:34:21.581580 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-455f3f69-d666-4395-8d51-ca98cb958cbe req-c5bdaa90-02a3-4d6f-87f8-e2a680e30fce tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:34:21.583124 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-455f3f69-d666-4395-8d51-ca98cb958cbe req-c5bdaa90-02a3-4d6f-87f8-e2a680e30fce tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/ports?device_id=45272356-d63b-4804-88a7-a122c4ed71ca HTTP/1.1" status: 200  len: 943 time: 0.0828209
May 20 04:34:21.629601 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-455f3f69-d666-4395-8d51-ca98cb958cbe req-1f540c08-c786-4bfa-b0e0-528b5f252ab1 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/security-groups?id=ef28d688-789b-4282-a30c-d7d731615fbf&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0400059
May 20 04:34:22.840665 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db236a7b-8350-45da-8303-2252d88bdac7 req-38f5eee4-a148-42ee-9f7d-e185ba55bafe tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:34:22.842224 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-db236a7b-8350-45da-8303-2252d88bdac7 req-38f5eee4-a148-42ee-9f7d-e185ba55bafe tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/ports?device_id=45272356-d63b-4804-88a7-a122c4ed71ca HTTP/1.1" status: 200  len: 943 time: 0.0958817
May 20 04:34:22.890550 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-db236a7b-8350-45da-8303-2252d88bdac7 req-431e8e3a-59eb-4aef-b512-67065701c257 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/security-groups?id=ef28d688-789b-4282-a30c-d7d731615fbf&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0424237
May 20 04:34:24.076975 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a46b02c6-828e-4765-b5e3-67a710188b92 req-a385052c-0cae-4299-9d7c-ea6ec14c7b3d tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:34:24.078459 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-a46b02c6-828e-4765-b5e3-67a710188b92 req-a385052c-0cae-4299-9d7c-ea6ec14c7b3d tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/ports?device_id=45272356-d63b-4804-88a7-a122c4ed71ca HTTP/1.1" status: 200  len: 943 time: 0.0817704
May 20 04:34:24.130437 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-a46b02c6-828e-4765-b5e3-67a710188b92 req-dfdbe982-74a6-4e47-83b0-425e1b25ebb2 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/security-groups?id=ef28d688-789b-4282-a30c-d7d731615fbf&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0431287
May 20 04:34:25.334010 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0543e94-01c5-4489-a8a0-f410a7e8fabd req-27d62633-2996-4c9b-b55e-8d76e5177638 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:34:25.335510 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-b0543e94-01c5-4489-a8a0-f410a7e8fabd req-27d62633-2996-4c9b-b55e-8d76e5177638 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/ports?device_id=45272356-d63b-4804-88a7-a122c4ed71ca HTTP/1.1" status: 200  len: 943 time: 0.0929806
May 20 04:34:25.381509 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-b0543e94-01c5-4489-a8a0-f410a7e8fabd req-b7f1e039-63ce-41f0-b9ad-10bd69d29eb1 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/security-groups?id=ef28d688-789b-4282-a30c-d7d731615fbf&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0401542
May 20 04:34:25.959155 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.agents_db [None req-92d61f12-17bc-4bf9-9eab-8a69b8c6da2f None None] Agent healthcheck: found 6 active agents {{(pid=91689) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 04:34:26.595592 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbbac9ed-b828-421b-838b-296ef374a952 req-6fbdd42e-25d9-4096-85ce-6c83df161b60 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:34:26.597268 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-cbbac9ed-b828-421b-838b-296ef374a952 req-6fbdd42e-25d9-4096-85ce-6c83df161b60 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/ports?device_id=45272356-d63b-4804-88a7-a122c4ed71ca HTTP/1.1" status: 200  len: 943 time: 0.1064904
May 20 04:34:26.643670 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-cbbac9ed-b828-421b-838b-296ef374a952 req-942e8d6e-7c4c-4c5a-b047-27c4011373c2 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/security-groups?id=ef28d688-789b-4282-a30c-d7d731615fbf&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0401843
May 20 04:34:27.835698 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2abf45dc-419c-4c5d-9795-f27bf5b76a05 req-82591df8-dbcb-4d49-b62b-49fc47569c22 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:34:27.837656 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-2abf45dc-419c-4c5d-9795-f27bf5b76a05 req-82591df8-dbcb-4d49-b62b-49fc47569c22 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/ports?device_id=45272356-d63b-4804-88a7-a122c4ed71ca HTTP/1.1" status: 200  len: 943 time: 0.0840435
May 20 04:34:27.884752 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-2abf45dc-419c-4c5d-9795-f27bf5b76a05 req-d4bc745b-eecc-49ee-bb20-96bedd1e58ec tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/security-groups?id=ef28d688-789b-4282-a30c-d7d731615fbf&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0411704
May 20 04:34:28.804867 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 1549cd2e-e51f-42cf-9024-803e9fae98be details requested by agent hyperv_hv-cinder-79091 with host hv-cinder-79091 {{(pid=91688) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 20 04:34:28.940043 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port 1549cd2e-e51f-42cf-9024-803e9fae98be, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=1549cd2e-e51f-42cf-9024-803e9fae98be,segment=NetworkSegment(e9f32492-7a41-4dc9-bc94-b8bce4a8e65d),segment_id=e9f32492-7a41-4dc9-bc94-b8bce4a8e65d)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:34:28.953276 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Returning: {'device': '1549cd2e-e51f-42cf-9024-803e9fae98be', 'network_id': '11c994a8-6ede-4290-84f0-71af466860db', 'port_id': '1549cd2e-e51f-42cf-9024-803e9fae98be', 'mac_address': 'fa:16:3e:b7:f6:e1', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 874, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '51af45f1-449a-400c-8714-8d713d4a7993', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91688) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 20 04:34:29.015314 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:34:29.033568 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.notifiers.nova [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 1549cd2e-e51f-42cf-9024-803e9fae98be {{(pid=91688) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 04:34:29.050195 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port 1549cd2e-e51f-42cf-9024-803e9fae98be, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=1549cd2e-e51f-42cf-9024-803e9fae98be,segment=NetworkSegment(e9f32492-7a41-4dc9-bc94-b8bce4a8e65d),segment_id=e9f32492-7a41-4dc9-bc94-b8bce4a8e65d)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:34:29.055762 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:34:29.057550 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-b7d99886-d264-484f-b440-21221f3fd5d2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:34:29.125382 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Pushing event updated for resources: {'Port': ['ID=1549cd2e-e51f-42cf-9024-803e9fae98be,revision_number=4']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:34:29.132999 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:34:29.133350 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:34:29.133759 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:34:29.134081 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:34:29.134408 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:34:29.134738 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:34:29.135056 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:34:29.135377 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:34:29.135701 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:34:29.136021 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:34:29.136336 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:34:29.136654 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:34:29.141438 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:34:29.175132 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66b0cc72-bcd9-4e0f-9984-44a743a93a98 req-9f4acecb-750f-47f9-a970-9aa6a2176353 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:34:29.176588 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-66b0cc72-bcd9-4e0f-9984-44a743a93a98 req-9f4acecb-750f-47f9-a970-9aa6a2176353 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/ports?device_id=45272356-d63b-4804-88a7-a122c4ed71ca HTTP/1.1" status: 200  len: 943 time: 0.1827130
May 20 04:34:29.225675 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-66b0cc72-bcd9-4e0f-9984-44a743a93a98 req-ed4b30de-5b2e-41f8-a7f8-e424d6790008 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/security-groups?id=ef28d688-789b-4282-a30c-d7d731615fbf&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0430210
May 20 04:34:29.401013 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] get_ports_and_sgs() called for port_ids ['1549cd2e-e51f-42cf-9024-803e9fae98be'] {{(pid=91688) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 04:34:29.859965 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-7576c651-ca98-4ddb-965e-e77a1b9fca90 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:34:30.414904 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f49ee7e3-789d-470d-8e8d-73f5902bdbf5 req-9776422b-b02f-4f27-a245-d6a6843835a5 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:34:30.416458 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-f49ee7e3-789d-470d-8e8d-73f5902bdbf5 req-9776422b-b02f-4f27-a245-d6a6843835a5 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/ports?device_id=45272356-d63b-4804-88a7-a122c4ed71ca HTTP/1.1" status: 200  len: 944 time: 0.0848894
May 20 04:34:30.467087 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-f49ee7e3-789d-470d-8e8d-73f5902bdbf5 req-b450bf08-61fc-491a-a2cd-68fd3990fccd tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/security-groups?id=ef28d688-789b-4282-a30c-d7d731615fbf&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0444551
May 20 04:34:30.816138 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 1549cd2e-e51f-42cf-9024-803e9fae98be up at agent hyperv_hv-cinder-79091 {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:34:30.887159 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Provisioning for port 1549cd2e-e51f-42cf-9024-803e9fae98be completed by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:34:30.892089 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Provisioning complete for port 1549cd2e-e51f-42cf-9024-803e9fae98be triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:34:30.892467 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:34:31.013457 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:34:31.041149 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '45272356-d63b-4804-88a7-a122c4ed71ca', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1549cd2e-e51f-42cf-9024-803e9fae98be'}] {{(pid=91688) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:34:31.051846 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port 1549cd2e-e51f-42cf-9024-803e9fae98be, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=1549cd2e-e51f-42cf-9024-803e9fae98be,segment=NetworkSegment(e9f32492-7a41-4dc9-bc94-b8bce4a8e65d),segment_id=e9f32492-7a41-4dc9-bc94-b8bce4a8e65d)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:34:31.057434 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:34:31.059778 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:34:31.088900 dv-cinder-790910-4-iscsi neutron-server[91688]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '45272356-d63b-4804-88a7-a122c4ed71ca', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1549cd2e-e51f-42cf-9024-803e9fae98be', 'code': 200}
May 20 04:34:31.130346 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Pushing event updated for resources: {'Port': ['ID=1549cd2e-e51f-42cf-9024-803e9fae98be,revision_number=5']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:34:31.133569 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:34:31.394389 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d06bb23-2f3f-45a5-a917-efc724025eb5 req-feb41650-4390-4a4b-b246-30987c6c21ff service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:34:31.395902 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-0d06bb23-2f3f-45a5-a917-efc724025eb5 req-feb41650-4390-4a4b-b246-30987c6c21ff service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=45272356-d63b-4804-88a7-a122c4ed71ca HTTP/1.1" status: 200  len: 1098 time: 0.0787926
May 20 04:34:31.444302 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-0d06bb23-2f3f-45a5-a917-efc724025eb5 req-90138894-db25-401c-970d-70e563e351a9 service neutron] 10.222.0.82 "GET /v2.0/security-groups?id=ef28d688-789b-4282-a30c-d7d731615fbf&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0385420
May 20 04:34:31.658387 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de042375-2b90-4593-9942-04ec5d3382e4 req-9094cf3d-6b81-402c-a14e-c631fbd216d2 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:34:31.659802 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-de042375-2b90-4593-9942-04ec5d3382e4 req-9094cf3d-6b81-402c-a14e-c631fbd216d2 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/ports?device_id=45272356-d63b-4804-88a7-a122c4ed71ca HTTP/1.1" status: 200  len: 945 time: 0.0818083
May 20 04:34:31.712168 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-de042375-2b90-4593-9942-04ec5d3382e4 req-1d5d9ee5-965e-4f39-adaf-c98a0378c212 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/security-groups?id=ef28d688-789b-4282-a30c-d7d731615fbf&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0459845
May 20 04:34:32.577564 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:34:32.719547 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-9621f317-3076-49c7-a591-cf76575ee5f8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:34:32.911106 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9377b54e-b590-4ed8-b83e-d5c1dde26f69 req-e7a01f3c-89d8-48e0-93d8-56e122794692 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:34:32.912576 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9377b54e-b590-4ed8-b83e-d5c1dde26f69 req-e7a01f3c-89d8-48e0-93d8-56e122794692 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/ports?device_id=45272356-d63b-4804-88a7-a122c4ed71ca HTTP/1.1" status: 200  len: 945 time: 0.0832059
May 20 04:34:32.959722 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9377b54e-b590-4ed8-b83e-d5c1dde26f69 req-71c127ff-78fc-478b-baa7-c22e70c7fda3 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/security-groups?id=ef28d688-789b-4282-a30c-d7d731615fbf&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0409987
May 20 04:34:33.152815 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87d43367-f83f-4e35-8da2-1c97beff11b5 req-9833ce05-24e5-41a4-8156-0e6c45741b5c tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:34:33.154317 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-87d43367-f83f-4e35-8da2-1c97beff11b5 req-9833ce05-24e5-41a4-8156-0e6c45741b5c tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/ports?device_id=45272356-d63b-4804-88a7-a122c4ed71ca HTTP/1.1" status: 200  len: 945 time: 0.0865159
May 20 04:34:33.201429 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-87d43367-f83f-4e35-8da2-1c97beff11b5 req-595bd831-f51f-44cf-943a-86d94e2dc356 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/security-groups?id=ef28d688-789b-4282-a30c-d7d731615fbf&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0407844
May 20 04:34:33.225368 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 46566) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:34:33.379135 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ea4803bd-878f-47d5-9084-1ec41953c9db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:34:33.430707 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c5b9b2d7-cd25-4983-ae56-13b718fadfa7 tempest-TestVolumeBootPattern-89884506 tempest-TestVolumeBootPattern-89884506-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:34:33.432144 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-c5b9b2d7-cd25-4983-ae56-13b718fadfa7 tempest-TestVolumeBootPattern-89884506 tempest-TestVolumeBootPattern-89884506-project-admin] 10.222.0.71 "GET /v2.0/ports?device_id=45272356-d63b-4804-88a7-a122c4ed71ca HTTP/1.1" status: 200  len: 1093 time: 0.2057788
May 20 04:34:33.435449 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 46572) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:34:33.440844 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.v2.base [None req-db517965-60c7-487d-b03a-34baf252e67c tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Request body: {'floatingip': {'floating_network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'port_id': '1549cd2e-e51f-42cf-9024-803e9fae98be', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'fixed_ip_address': '172.20.0.9'}} {{(pid=91686) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:34:33.447379 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-db517965-60c7-487d-b03a-34baf252e67c tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:34:33.451351 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-db517965-60c7-487d-b03a-34baf252e67c tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Usage tracker for resource:floatingip and tenant:9b6fb271a7a546a38b0c6df5beaf22fc is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:34:33.454314 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-db517965-60c7-487d-b03a-34baf252e67c tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Quota usage for floatingip was recalculated. Used quota:2. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:34:33.459967 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-db517965-60c7-487d-b03a-34baf252e67c tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attempting to reserve 1 items for resource floatingip. Total usage: 2; quota limit: 50; headroom:48 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:34:33.470902 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-db517965-60c7-487d-b03a-34baf252e67c tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks [] for floatingip, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:34:33.618021 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-db517965-60c7-487d-b03a-34baf252e67c tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:34:33.767987 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.db_base_plugin_common [None req-db517965-60c7-487d-b03a-34baf252e67c tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Allocated IP 172.27.1.108 (aec557db-0c02-4008-8c9f-2efcd7462f90/217f4b55-4415-4d57-8b43-2ff4c8ac8e81/9096b4ae-90b2-4318-9d1f-a460637615dd) {{(pid=91686) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 04:34:33.926706 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-db517965-60c7-487d-b03a-34baf252e67c tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks [] for port, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:34:33.958414 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-db517965-60c7-487d-b03a-34baf252e67c tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8782892106231', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2145052'] for port, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:34:33.962658 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-42b2f377-61e8-4d25-ba0b-954cda0a1747 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:34:34.031808 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-db517965-60c7-487d-b03a-34baf252e67c tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Network aec557db-0c02-4008-8c9f-2efcd7462f90 is already hosted by enough agents. {{(pid=91686) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:34:34.034883 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.base_scheduler [None req-db517965-60c7-487d-b03a-34baf252e67c tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Resources bound (agent type, host, resource id):  {{(pid=91686) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:34:34.038832 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.l3_dvrscheduler_db [None req-db517965-60c7-487d-b03a-34baf252e67c tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Received port after_create {{(pid=91686) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 04:34:34.077437 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db517965-60c7-487d-b03a-34baf252e67c tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Pushing event updated for resources: {'Port': ['ID=9096b4ae-90b2-4318-9d1f-a460637615dd,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:34:34.094111 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db517965-60c7-487d-b03a-34baf252e67c tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:34:34.094482 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db517965-60c7-487d-b03a-34baf252e67c tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:34:34.094854 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db517965-60c7-487d-b03a-34baf252e67c tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:34:34.095219 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db517965-60c7-487d-b03a-34baf252e67c tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:34:34.095574 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db517965-60c7-487d-b03a-34baf252e67c tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:34:34.095935 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db517965-60c7-487d-b03a-34baf252e67c tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:34:34.096290 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db517965-60c7-487d-b03a-34baf252e67c tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:34:34.096641 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db517965-60c7-487d-b03a-34baf252e67c tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:34:34.097018 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db517965-60c7-487d-b03a-34baf252e67c tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:34:34.097374 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db517965-60c7-487d-b03a-34baf252e67c tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:34:34.097723 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db517965-60c7-487d-b03a-34baf252e67c tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:34:34.098069 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db517965-60c7-487d-b03a-34baf252e67c tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:34:34.103194 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-db517965-60c7-487d-b03a-34baf252e67c tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.141s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:34:34.475823 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-db517965-60c7-487d-b03a-34baf252e67c tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks [] for floatingip, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:34:34.560867 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-db517965-60c7-487d-b03a-34baf252e67c tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:34:34.799503 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-db517965-60c7-487d-b03a-34baf252e67c tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks [] for port, precommit_update {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:34:34.806316 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-db517965-60c7-487d-b03a-34baf252e67c tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2145029'] for port, after_update {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:34:34.810360 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:34:35.018825 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db517965-60c7-487d-b03a-34baf252e67c tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Pushing event updated for resources: {'Port': ['ID=9096b4ae-90b2-4318-9d1f-a460637615dd,revision_number=2']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:34:35.022886 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-db517965-60c7-487d-b03a-34baf252e67c tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.212s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:34:35.032318 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-db517965-60c7-487d-b03a-34baf252e67c tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1716406'] for floatingip, after_update {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:34:35.206487 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.db.l3_db [None req-db517965-60c7-487d-b03a-34baf252e67c tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Floating IP 4a030eff-52d4-4f0d-b4c3-a18100b68cc4 associated. External IP: 172.27.1.108, port: 1549cd2e-e51f-42cf-9024-803e9fae98be.
May 20 04:34:35.231138 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f21320cc-6a25-4ec1-8a32-8b119b35fd55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:34:35.565411 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-db517965-60c7-487d-b03a-34baf252e67c tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Router a7f66c4d-6b4f-4053-bd69-e1bea7db4c61 has already been hosted by L3 agent 02733fc0-fc9c-4e29-bc03-c27a792d539d {{(pid=91686) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 04:34:35.749797 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-db517965-60c7-487d-b03a-34baf252e67c tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify agent at l3_agent.dv-cinder-790910-4-iscsi the message routers_updated {{(pid=91686) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 04:34:35.759652 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-557aefda-65bb-4bda-8eb3-2b6bde10f1b5 None None] Sync routers for ids ['a7f66c4d-6b4f-4053-bd69-e1bea7db4c61'] in dv-cinder-790910-4-iscsi {{(pid=91689) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 04:34:35.770774 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-557aefda-65bb-4bda-8eb3-2b6bde10f1b5 None None] Routers {'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91689) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:34:35.771391 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-557aefda-65bb-4bda-8eb3-2b6bde10f1b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced1700790>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:34:33Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['a7f66c4d-6b4f-4053-bd69-e1bea7db4c61'], 'active': True} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:34:35.778154 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-db517965-60c7-487d-b03a-34baf252e67c tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for floatingip, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:34:35.841068 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-db517965-60c7-487d-b03a-34baf252e67c tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 996 time: 2.4041522
May 20 04:34:35.842493 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '45272356-d63b-4804-88a7-a122c4ed71ca', 'tag': '1549cd2e-e51f-42cf-9024-803e9fae98be'}] {{(pid=91686) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:34:35.960836 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '45272356-d63b-4804-88a7-a122c4ed71ca', 'tag': '1549cd2e-e51f-42cf-9024-803e9fae98be', 'status': 'completed', 'code': 200}
May 20 04:34:35.974887 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvr_db [None req-557aefda-65bb-4bda-8eb3-2b6bde10f1b5 None None] Set router a7f66c4d-6b4f-4053-bd69-e1bea7db4c61 gateway port host: dv-cinder-790910-4-iscsi {{(pid=91689) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:34:36.059186 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1d9eb25-6be3-4cff-afeb-3e2266024980 req-c82bebf4-142f-4ccd-91c4-8ffa5d9bc4da service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:34:36.060684 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a1d9eb25-6be3-4cff-afeb-3e2266024980 req-c82bebf4-142f-4ccd-91c4-8ffa5d9bc4da service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=9b6fb271a7a546a38b0c6df5beaf22fc&device_id=45272356-d63b-4804-88a7-a122c4ed71ca HTTP/1.1" status: 200  len: 1098 time: 0.0762029
May 20 04:34:36.199265 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1d9eb25-6be3-4cff-afeb-3e2266024980 req-9790f505-acf0-4644-a41b-406a9318ff4d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:34:36.200652 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a1d9eb25-6be3-4cff-afeb-3e2266024980 req-9790f505-acf0-4644-a41b-406a9318ff4d service neutron] 10.222.0.82 "GET /v2.0/networks?id=11c994a8-6ede-4290-84f0-71af466860db HTTP/1.1" status: 200  len: 912 time: 0.1326761
May 20 04:34:36.302448 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a1d9eb25-6be3-4cff-afeb-3e2266024980 req-8d0bfde7-17ef-4412-8496-4ce64de102d0 service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=1549cd2e-e51f-42cf-9024-803e9fae98be HTTP/1.1" status: 200  len: 999 time: 0.0938799
May 20 04:34:36.330854 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-557aefda-65bb-4bda-8eb3-2b6bde10f1b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced1700790>, [{'id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'name': 'tempest-TestVolumeBootPattern-857163320-router', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.91'}], 'enable_snat': True}, 'gw_port_id': '866cc6c0-5986-4eb4-8827-b255811a13de', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:28:09Z', 'updated_at': '2021-05-20T04:28:12Z', 'revision_number': 4, 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'gw_port': {'id': '866cc6c0-5986-4eb4-8827-b255811a13de', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:f5:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'device_owner': 'network:router_gateway', 'standard_attr_id': 511, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:28:09Z', 'updated_at': '2021-05-20T04:28:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_floatingips': [{'id': '3e823655-ee96-49c4-9d83-df544348d4cf', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'floating_ip_address': '172.27.1.86', 'floating_network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'router_id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'port_id': 'b1bae5dc-7bbe-4c23-b60b-26cf817da0ee', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 597, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '11c994a8-6ede-4290-84f0-71af466860db', 'mac_address': 'fa:16:3e:43:d1:db', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'de26e049-9f19-44e7-93d5-64ccd77cb9de', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T04:32:07Z', 'updated_at': '2021-05-20T04:32:10Z', 'revision_number': 1, 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'fixed_ip_address_scope': None}, {'id': '4a030eff-52d4-4f0d-b4c3-a18100b68cc4', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'floating_ip_address': '172.27.1.108', 'floating_network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'router_id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'port_id': '1549cd2e-e51f-42cf-9024-803e9fae98be', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 620, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '11c994a8-6ede-4290-84f0-71af466860db', 'mac_address': 'fa:16:3e:b7:f6:e1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '45272356-d63b-4804-88a7-a122c4ed71ca', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T04:34:34Z', 'updated_at': '2021-05-20T04:34:34Z', 'revision_number': 0, 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0bcb5c14-319d-4871-bef1-50d60ad3f5b8', 'name': '', 'network_id': '11c994a8-6ede-4290-84f0-71af466860db', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'mac_address': 'fa:16:3e:2c:84:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'device_owner': 'network:router_interface', 'standard_attr_id': 512, 'fixed_ips': [{'subnet_id': '51af45f1-449a-400c-8714-8d713d4a7993', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:28:12Z', 'updated_at': '2021-05-20T04:28:19Z', 'revision_number': 5, 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'subnets': [{'id': '51af45f1-449a-400c-8714-8d713d4a7993', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:34:36.334963 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-557aefda-65bb-4bda-8eb3-2b6bde10f1b5 None None] Checking router: a7f66c4d-6b4f-4053-bd69-e1bea7db4c61 for host: dv-cinder-790910-4-iscsi {{(pid=91689) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 04:34:36.343608 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-557aefda-65bb-4bda-8eb3-2b6bde10f1b5 None None] Routers {'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91689) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:34:36.344208 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-557aefda-65bb-4bda-8eb3-2b6bde10f1b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced1700790>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:34:33Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['a7f66c4d-6b4f-4053-bd69-e1bea7db4c61'], 'active': True} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:34:36.371202 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1d9eb25-6be3-4cff-afeb-3e2266024980 req-a1893888-62b1-4596-a5f0-54bcbc963471 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:34:36.372395 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a1d9eb25-6be3-4cff-afeb-3e2266024980 req-a1893888-62b1-4596-a5f0-54bcbc963471 service neutron] 10.222.0.82 "GET /v2.0/subnets?id=51af45f1-449a-400c-8714-8d713d4a7993 HTTP/1.1" status: 200  len: 850 time: 0.0627925
May 20 04:34:36.451945 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1d9eb25-6be3-4cff-afeb-3e2266024980 req-00d68889-98c7-4650-8c3b-2d7e57dbf3c7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:34:36.453406 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a1d9eb25-6be3-4cff-afeb-3e2266024980 req-00d68889-98c7-4650-8c3b-2d7e57dbf3c7 service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=11c994a8-6ede-4290-84f0-71af466860db&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0736468
May 20 04:34:36.553322 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvr_db [None req-557aefda-65bb-4bda-8eb3-2b6bde10f1b5 None None] Set router a7f66c4d-6b4f-4053-bd69-e1bea7db4c61 gateway port host: dv-cinder-790910-4-iscsi {{(pid=91689) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:34:36.600637 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a1d9eb25-6be3-4cff-afeb-3e2266024980 req-648a3c61-441c-40b6-ae95-3182f70b4e00 service neutron] 10.222.0.82 "GET /v2.0/networks/11c994a8-6ede-4290-84f0-71af466860db?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1330423
May 20 04:34:36.605554 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:34:36.742026 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a1d9eb25-6be3-4cff-afeb-3e2266024980 req-44bfe14c-cb4a-415a-ac50-38d8778886f3 service neutron] 10.222.0.82 "GET /v2.0/networks/11c994a8-6ede-4290-84f0-71af466860db?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1346860
May 20 04:34:36.903463 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-557aefda-65bb-4bda-8eb3-2b6bde10f1b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced1700790>, [{'id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'name': 'tempest-TestVolumeBootPattern-857163320-router', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.91'}], 'enable_snat': True}, 'gw_port_id': '866cc6c0-5986-4eb4-8827-b255811a13de', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:28:09Z', 'updated_at': '2021-05-20T04:28:12Z', 'revision_number': 4, 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'gw_port': {'id': '866cc6c0-5986-4eb4-8827-b255811a13de', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:f5:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'device_owner': 'network:router_gateway', 'standard_attr_id': 511, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:28:09Z', 'updated_at': '2021-05-20T04:28:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_floatingips': [{'id': '3e823655-ee96-49c4-9d83-df544348d4cf', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'floating_ip_address': '172.27.1.86', 'floating_network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'router_id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'port_id': 'b1bae5dc-7bbe-4c23-b60b-26cf817da0ee', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 597, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '11c994a8-6ede-4290-84f0-71af466860db', 'mac_address': 'fa:16:3e:43:d1:db', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'de26e049-9f19-44e7-93d5-64ccd77cb9de', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T04:32:07Z', 'updated_at': '2021-05-20T04:32:10Z', 'revision_number': 1, 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'fixed_ip_address_scope': None}, {'id': '4a030eff-52d4-4f0d-b4c3-a18100b68cc4', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'floating_ip_address': '172.27.1.108', 'floating_network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'router_id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'port_id': '1549cd2e-e51f-42cf-9024-803e9fae98be', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 620, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '11c994a8-6ede-4290-84f0-71af466860db', 'mac_address': 'fa:16:3e:b7:f6:e1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '45272356-d63b-4804-88a7-a122c4ed71ca', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T04:34:34Z', 'updated_at': '2021-05-20T04:34:34Z', 'revision_number': 0, 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0bcb5c14-319d-4871-bef1-50d60ad3f5b8', 'name': '', 'network_id': '11c994a8-6ede-4290-84f0-71af466860db', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'mac_address': 'fa:16:3e:2c:84:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'device_owner': 'network:router_interface', 'standard_attr_id': 512, 'fixed_ips': [{'subnet_id': '51af45f1-449a-400c-8714-8d713d4a7993', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:28:12Z', 'updated_at': '2021-05-20T04:28:19Z', 'revision_number': 5, 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'subnets': [{'id': '51af45f1-449a-400c-8714-8d713d4a7993', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:34:36.907817 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-557aefda-65bb-4bda-8eb3-2b6bde10f1b5 None None] The sync data for ids ['a7f66c4d-6b4f-4053-bd69-e1bea7db4c61'] in dv-cinder-790910-4-iscsi is: [{'id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'name': 'tempest-TestVolumeBootPattern-857163320-router', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.91'}], 'enable_snat': True}, 'gw_port_id': '866cc6c0-5986-4eb4-8827-b255811a13de', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:28:09Z', 'updated_at': '2021-05-20T04:28:12Z', 'revision_number': 4, 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'gw_port': {'id': '866cc6c0-5986-4eb4-8827-b255811a13de', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:f5:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'device_owner': 'network:router_gateway', 'standard_attr_id': 511, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:28:09Z', 'updated_at': '2021-05-20T04:28:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_floatingips': [{'id': '3e823655-ee96-49c4-9d83-df544348d4cf', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'floating_ip_address': '172.27.1.86', 'floating_network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'router_id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'port_id': 'b1bae5dc-7bbe-4c23-b60b-26cf817da0ee', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 597, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '11c994a8-6ede-4290-84f0-71af466860db', 'mac_address': 'fa:16:3e:43:d1:db', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'de26e049-9f19-44e7-93d5-64ccd77cb9de', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T04:32:07Z', 'updated_at': '2021-05-20T04:32:10Z', 'revision_number': 1, 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'fixed_ip_address_scope': None}, {'id': '4a030eff-52d4-4f0d-b4c3-a18100b68cc4', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'floating_ip_address': '172.27.1.108', 'floating_network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'router_id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'port_id': '1549cd2e-e51f-42cf-9024-803e9fae98be', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 620, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '11c994a8-6ede-4290-84f0-71af466860db', 'mac_address': 'fa:16:3e:b7:f6:e1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '45272356-d63b-4804-88a7-a122c4ed71ca', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T04:34:34Z', 'updated_at': '2021-05-20T04:34:34Z', 'revision_number': 0, 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0bcb5c14-319d-4871-bef1-50d60ad3f5b8', 'name': '', 'network_id': '11c994a8-6ede-4290-84f0-71af466860db', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'mac_address': 'fa:16:3e:2c:84:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'device_owner': 'network:router_interface', 'standard_attr_id': 512, 'fixed_ips': [{'subnet_id': '51af45f1-449a-400c-8714-8d713d4a7993', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:28:12Z', 'updated_at': '2021-05-20T04:28:19Z', 'revision_number': 5, 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'subnets': [{'id': '51af45f1-449a-400c-8714-8d713d4a7993', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91689) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 04:34:37.098714 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-78e9ddf1-2564-4afa-b8ed-1157cf92d03f None None] New status for floating IP 4a030eff-52d4-4f0d-b4c3-a18100b68cc4: ACTIVE {{(pid=91688) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 20 04:34:39.528341 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a5c79d6b-2a83-400c-86a9-0b1088971e95 req-6e5ad4b9-ea25-4a48-beb0-6814e6392dae service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=de26e049-9f19-44e7-93d5-64ccd77cb9de&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0791492
May 20 04:34:39.677818 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5c79d6b-2a83-400c-86a9-0b1088971e95 req-1e4e3638-cd16-4677-b39a-9e2b6f9151a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:34:39.679274 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a5c79d6b-2a83-400c-86a9-0b1088971e95 req-1e4e3638-cd16-4677-b39a-9e2b6f9151a9 service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=9b6fb271a7a546a38b0c6df5beaf22fc&device_id=de26e049-9f19-44e7-93d5-64ccd77cb9de HTTP/1.1" status: 200  len: 1099 time: 0.0718369
May 20 04:34:39.833627 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5c79d6b-2a83-400c-86a9-0b1088971e95 req-7c37e578-b5d6-4aba-8993-cb6b526b7b31 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:34:39.835087 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a5c79d6b-2a83-400c-86a9-0b1088971e95 req-7c37e578-b5d6-4aba-8993-cb6b526b7b31 service neutron] 10.222.0.82 "GET /v2.0/networks?id=11c994a8-6ede-4290-84f0-71af466860db HTTP/1.1" status: 200  len: 912 time: 0.1353726
May 20 04:34:39.944433 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a5c79d6b-2a83-400c-86a9-0b1088971e95 req-feb7343f-b73e-4fd5-b2ec-84f44ef5fc08 service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=b1bae5dc-7bbe-4c23-b60b-26cf817da0ee HTTP/1.1" status: 200  len: 1001 time: 0.1020677
May 20 04:34:40.009729 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5c79d6b-2a83-400c-86a9-0b1088971e95 req-bf83cdac-36a3-459a-a880-16970c516a0f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:34:40.011176 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a5c79d6b-2a83-400c-86a9-0b1088971e95 req-bf83cdac-36a3-459a-a880-16970c516a0f service neutron] 10.222.0.82 "GET /v2.0/subnets?id=51af45f1-449a-400c-8714-8d713d4a7993 HTTP/1.1" status: 200  len: 850 time: 0.0599256
May 20 04:34:40.093298 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5c79d6b-2a83-400c-86a9-0b1088971e95 req-d52bad9b-87a1-4723-a67b-dcdde43b95c3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:34:40.094809 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a5c79d6b-2a83-400c-86a9-0b1088971e95 req-d52bad9b-87a1-4723-a67b-dcdde43b95c3 service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=11c994a8-6ede-4290-84f0-71af466860db&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0770631
May 20 04:34:40.338949 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a5c79d6b-2a83-400c-86a9-0b1088971e95 req-9779179a-7b73-49a9-9786-8392efd22244 service neutron] 10.222.0.82 "GET /v2.0/networks/11c994a8-6ede-4290-84f0-71af466860db?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2365341
May 20 04:34:40.481964 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a5c79d6b-2a83-400c-86a9-0b1088971e95 req-1192d677-f417-40f3-a086-0892e70b38ec service neutron] 10.222.0.82 "GET /v2.0/networks/11c994a8-6ede-4290-84f0-71af466860db?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1359098
May 20 04:34:50.412524 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-101d4f6c-9cfb-48d4-b3b8-9aeec861ce69 req-94809305-238c-4982-96ef-a7530c9b420b tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:34:50.413905 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-101d4f6c-9cfb-48d4-b3b8-9aeec861ce69 req-94809305-238c-4982-96ef-a7530c9b420b tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/ports?device_id=e9041636-d49b-4bde-b686-3fb6ecbf907a HTTP/1.1" status: 200  len: 945 time: 0.0870163
May 20 04:34:50.464456 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-101d4f6c-9cfb-48d4-b3b8-9aeec861ce69 req-ed7ff90c-c245-4cde-8efc-1e95475dfae2 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/security-groups?id=a91e9b1a-ef38-4317-bbea-c290d296dc7b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0398245
May 20 04:34:51.679022 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c3bc6a5-8d3f-430f-b0a0-838800a41f0d req-bc254579-6711-4c8e-bcef-238ae07e7002 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:34:51.680496 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-4c3bc6a5-8d3f-430f-b0a0-838800a41f0d req-bc254579-6711-4c8e-bcef-238ae07e7002 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/ports?device_id=e9041636-d49b-4bde-b686-3fb6ecbf907a HTTP/1.1" status: 200  len: 945 time: 0.0891697
May 20 04:34:51.725864 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-4c3bc6a5-8d3f-430f-b0a0-838800a41f0d req-9ca8d1bd-3619-4ee1-8d46-9508de0b3b36 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/security-groups?id=a91e9b1a-ef38-4317-bbea-c290d296dc7b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0395339
May 20 04:34:52.943585 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-905a6050-2fd9-42c3-8c45-bea2fc9134c1 req-13aac9d4-7ed7-4972-ab86-cb9b6b2edd00 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:34:52.945064 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-905a6050-2fd9-42c3-8c45-bea2fc9134c1 req-13aac9d4-7ed7-4972-ab86-cb9b6b2edd00 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/ports?device_id=e9041636-d49b-4bde-b686-3fb6ecbf907a HTTP/1.1" status: 200  len: 945 time: 0.1073635
May 20 04:34:52.994911 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-905a6050-2fd9-42c3-8c45-bea2fc9134c1 req-b9144501-289a-499c-9a6e-7e8393371d2b tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/security-groups?id=a91e9b1a-ef38-4317-bbea-c290d296dc7b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0412354
May 20 04:34:54.200583 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49843a5f-325f-493d-b591-57059dcb13fd req-f9abe562-5e59-4a61-bef2-dadf3ccff051 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:34:54.202306 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-49843a5f-325f-493d-b591-57059dcb13fd req-f9abe562-5e59-4a61-bef2-dadf3ccff051 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/ports?device_id=e9041636-d49b-4bde-b686-3fb6ecbf907a HTTP/1.1" status: 200  len: 945 time: 0.0927036
May 20 04:34:54.252717 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-49843a5f-325f-493d-b591-57059dcb13fd req-7cf1d862-8b88-4672-9670-7f1e8bd0d16c tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/security-groups?id=a91e9b1a-ef38-4317-bbea-c290d296dc7b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0416446
May 20 04:34:55.458124 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fa13069-5e37-447e-9630-ce61afa8ac7c req-e0f0b05d-751b-4e41-80bb-b5eb104ede40 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:34:55.459488 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9fa13069-5e37-447e-9630-ce61afa8ac7c req-e0f0b05d-751b-4e41-80bb-b5eb104ede40 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/ports?device_id=e9041636-d49b-4bde-b686-3fb6ecbf907a HTTP/1.1" status: 200  len: 945 time: 0.0848575
May 20 04:34:55.512779 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9fa13069-5e37-447e-9630-ce61afa8ac7c req-726a7e92-9bfc-4e12-89b9-ae6554facace tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/security-groups?id=a91e9b1a-ef38-4317-bbea-c290d296dc7b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0443223
May 20 04:34:56.714044 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e3e1a6b-910c-4ecb-b409-9391990b9917 req-518a8146-13ee-4e59-ba25-9582f02474f2 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:34:56.715514 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-7e3e1a6b-910c-4ecb-b409-9391990b9917 req-518a8146-13ee-4e59-ba25-9582f02474f2 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/ports?device_id=e9041636-d49b-4bde-b686-3fb6ecbf907a HTTP/1.1" status: 200  len: 945 time: 0.0863047
May 20 04:34:56.763059 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-7e3e1a6b-910c-4ecb-b409-9391990b9917 req-f5a78e65-6711-47b2-bbd1-1cfaecdcb38e tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/security-groups?id=a91e9b1a-ef38-4317-bbea-c290d296dc7b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0415242
May 20 04:34:57.963118 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ba25bbf-a0e6-4763-8070-8e59d6d95382 req-ed5e4dda-0b41-4e2e-bc58-6d91bc111044 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:34:57.964588 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4ba25bbf-a0e6-4763-8070-8e59d6d95382 req-ed5e4dda-0b41-4e2e-bc58-6d91bc111044 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/ports?device_id=e9041636-d49b-4bde-b686-3fb6ecbf907a HTTP/1.1" status: 200  len: 945 time: 0.0931709
May 20 04:34:58.009939 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4ba25bbf-a0e6-4763-8070-8e59d6d95382 req-48e8438d-e7e1-4e08-96b4-6109967e8418 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/security-groups?id=a91e9b1a-ef38-4317-bbea-c290d296dc7b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0394499
May 20 04:34:59.212137 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd7e0e2b-5a2d-4357-a19b-bb1d9fac572c req-cb07a459-d3c0-4ba4-b3d1-c9482e1f6075 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:34:59.213624 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-fd7e0e2b-5a2d-4357-a19b-bb1d9fac572c req-cb07a459-d3c0-4ba4-b3d1-c9482e1f6075 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/ports?device_id=e9041636-d49b-4bde-b686-3fb6ecbf907a HTTP/1.1" status: 200  len: 945 time: 0.0931523
May 20 04:34:59.263289 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-fd7e0e2b-5a2d-4357-a19b-bb1d9fac572c req-36e63757-b874-4d02-82ef-2d5d2ce2fb11 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/security-groups?id=a91e9b1a-ef38-4317-bbea-c290d296dc7b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0410671
May 20 04:34:59.863754 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-b750eb7b-3d59-444f-8cbb-2268dfbd527b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:35:00.476521 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60d8328a-c013-47f2-bcec-eafc03f4ce6f req-d6d30664-21fd-49ee-a6be-6d350758b1c4 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:35:00.477994 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-60d8328a-c013-47f2-bcec-eafc03f4ce6f req-d6d30664-21fd-49ee-a6be-6d350758b1c4 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/ports?device_id=e9041636-d49b-4bde-b686-3fb6ecbf907a HTTP/1.1" status: 200  len: 945 time: 0.0918527
May 20 04:35:00.525965 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-60d8328a-c013-47f2-bcec-eafc03f4ce6f req-61709ca6-8262-4e19-a832-7e039f6852df tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/security-groups?id=a91e9b1a-ef38-4317-bbea-c290d296dc7b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0397723
May 20 04:35:01.723106 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2087d6ff-7bef-4cbb-9c8c-401092a5c59e req-9861a3ef-acb8-4aa5-ae1d-c07dd1e1b4de tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:35:01.724552 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-2087d6ff-7bef-4cbb-9c8c-401092a5c59e req-9861a3ef-acb8-4aa5-ae1d-c07dd1e1b4de tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/ports?device_id=e9041636-d49b-4bde-b686-3fb6ecbf907a HTTP/1.1" status: 200  len: 945 time: 0.0846751
May 20 04:35:01.783655 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-2087d6ff-7bef-4cbb-9c8c-401092a5c59e req-a7d2ffa2-afde-4dc5-b699-ff8f4c6070fb tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/security-groups?id=a91e9b1a-ef38-4317-bbea-c290d296dc7b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0532358
May 20 04:35:02.572452 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:35:02.724761 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f78939ad-d210-443e-b92d-916aa001c221 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:35:02.959257 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.agents_db [None req-92d61f12-17bc-4bf9-9eab-8a69b8c6da2f None None] Agent healthcheck: found 6 active agents {{(pid=91689) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 04:35:02.988972 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-509a091a-ecb9-4ea4-8231-51e3575e8cc8 req-4a7e9ee7-9a98-42cb-8e52-4a652a73cf48 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:35:02.990448 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-509a091a-ecb9-4ea4-8231-51e3575e8cc8 req-4a7e9ee7-9a98-42cb-8e52-4a652a73cf48 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/ports?device_id=e9041636-d49b-4bde-b686-3fb6ecbf907a HTTP/1.1" status: 200  len: 945 time: 0.0872209
May 20 04:35:03.036879 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-509a091a-ecb9-4ea4-8231-51e3575e8cc8 req-76fe51fd-7630-4f49-9fd8-602ddded3a0a tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/security-groups?id=a91e9b1a-ef38-4317-bbea-c290d296dc7b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0406818
May 20 04:35:03.388347 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ea4803bd-878f-47d5-9084-1ec41953c9db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:35:04.236644 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73efbe70-8870-4fbc-b4a1-e4ea136b019d req-a2de85b0-eb91-40f8-b58a-a3eaa72c87ea tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:35:04.238152 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-73efbe70-8870-4fbc-b4a1-e4ea136b019d req-a2de85b0-eb91-40f8-b58a-a3eaa72c87ea tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/ports?device_id=e9041636-d49b-4bde-b686-3fb6ecbf907a HTTP/1.1" status: 200  len: 945 time: 0.0836985
May 20 04:35:04.286565 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-73efbe70-8870-4fbc-b4a1-e4ea136b019d req-80006e79-976f-448b-ba8d-ce90245b773e tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/security-groups?id=a91e9b1a-ef38-4317-bbea-c290d296dc7b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0398169
May 20 04:35:05.236446 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f21320cc-6a25-4ec1-8a32-8b119b35fd55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:35:05.483283 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b339ab1-ee05-443a-8a21-f5be47793e42 req-cffa4a44-31b2-4a1c-9461-a42e4067b34f tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:35:05.484759 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-7b339ab1-ee05-443a-8a21-f5be47793e42 req-cffa4a44-31b2-4a1c-9461-a42e4067b34f tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/ports?device_id=e9041636-d49b-4bde-b686-3fb6ecbf907a HTTP/1.1" status: 200  len: 945 time: 0.0925882
May 20 04:35:05.531875 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-7b339ab1-ee05-443a-8a21-f5be47793e42 req-b1d24db4-3d9b-4824-b546-feb662d9b104 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/security-groups?id=a91e9b1a-ef38-4317-bbea-c290d296dc7b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0410571
May 20 04:35:06.626237 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:35:06.848799 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9bb04f4-fae4-4ab2-ab8e-acd3ac997b2a req-487e2ac0-aa44-44a7-9751-056a8dc42ca1 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:35:06.850178 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-a9bb04f4-fae4-4ab2-ab8e-acd3ac997b2a req-487e2ac0-aa44-44a7-9751-056a8dc42ca1 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/ports?device_id=e9041636-d49b-4bde-b686-3fb6ecbf907a HTTP/1.1" status: 200  len: 945 time: 0.2036827
May 20 04:35:06.906751 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-a9bb04f4-fae4-4ab2-ab8e-acd3ac997b2a req-95963f5e-61e8-4bc6-b02d-a10d09f939a8 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/security-groups?id=a91e9b1a-ef38-4317-bbea-c290d296dc7b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0506792
May 20 04:35:07.422044 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-767ce9b9-981d-4a58-a447-cbf2adb7e667 req-0fdad99d-d8db-494f-a8e3-055b5717e358 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:35:07.423394 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-767ce9b9-981d-4a58-a447-cbf2adb7e667 req-0fdad99d-d8db-494f-a8e3-055b5717e358 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/ports?device_id=e9041636-d49b-4bde-b686-3fb6ecbf907a HTTP/1.1" status: 200  len: 945 time: 0.0838020
May 20 04:35:07.463269 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6facd06-0037-45bc-9164-eb7e1db1e3e3 req-e7d18ddc-c4f8-4cbb-a919-de39a5c42584 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:35:07.464700 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-d6facd06-0037-45bc-9164-eb7e1db1e3e3 req-e7d18ddc-c4f8-4cbb-a919-de39a5c42584 service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=2035da004a584b4ea1f637e593596cd7&device_id=e9041636-d49b-4bde-b686-3fb6ecbf907a HTTP/1.1" status: 200  len: 1098 time: 0.0734341
May 20 04:35:07.472681 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-767ce9b9-981d-4a58-a447-cbf2adb7e667 req-7feac3a3-ed0e-431d-a5c2-bc19d67ae33a tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/security-groups?id=a91e9b1a-ef38-4317-bbea-c290d296dc7b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0433104
May 20 04:35:07.597543 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6facd06-0037-45bc-9164-eb7e1db1e3e3 req-c4b0acca-ecf6-4cba-9deb-65d2af675136 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:35:07.598986 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-d6facd06-0037-45bc-9164-eb7e1db1e3e3 req-c4b0acca-ecf6-4cba-9deb-65d2af675136 service neutron] 10.222.0.82 "GET /v2.0/networks?id=4c58b50e-1091-40dd-b4fa-ff2da87b1475 HTTP/1.1" status: 200  len: 912 time: 0.1275506
May 20 04:35:07.702085 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-d6facd06-0037-45bc-9164-eb7e1db1e3e3 req-63cdeacd-15bc-475b-8514-dc021ead1bb5 service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=cda24ac9-3c25-4710-85ff-bcd2091b8d14 HTTP/1.1" status: 200  len: 1001 time: 0.0961561
May 20 04:35:07.769214 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6facd06-0037-45bc-9164-eb7e1db1e3e3 req-07eaf29b-8b97-4d5f-af79-eff6b1b58b54 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:35:07.770740 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-d6facd06-0037-45bc-9164-eb7e1db1e3e3 req-07eaf29b-8b97-4d5f-af79-eff6b1b58b54 service neutron] 10.222.0.82 "GET /v2.0/subnets?id=24a65302-95b2-4d66-9d40-a9959babbe40 HTTP/1.1" status: 200  len: 850 time: 0.0624027
May 20 04:35:07.851727 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6facd06-0037-45bc-9164-eb7e1db1e3e3 req-ba6eb8e1-c63a-4537-beea-1e9c5f460afe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:35:07.853284 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-d6facd06-0037-45bc-9164-eb7e1db1e3e3 req-ba6eb8e1-c63a-4537-beea-1e9c5f460afe service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=4c58b50e-1091-40dd-b4fa-ff2da87b1475&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0762861
May 20 04:35:07.988237 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-d6facd06-0037-45bc-9164-eb7e1db1e3e3 req-d2e41343-a57d-47dd-9ad4-f04da61e25a9 service neutron] 10.222.0.82 "GET /v2.0/networks/4c58b50e-1091-40dd-b4fa-ff2da87b1475?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1283357
May 20 04:35:08.120657 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-d6facd06-0037-45bc-9164-eb7e1db1e3e3 req-5b3912d1-fde9-4962-978f-18df6450b5b0 service neutron] 10.222.0.82 "GET /v2.0/networks/4c58b50e-1091-40dd-b4fa-ff2da87b1475?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1262197
May 20 04:35:08.679172 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e627aae-3a08-47a6-83b9-fbe99aa73cba req-2fc86a71-6119-4b79-977c-d8af30f84016 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:35:08.680649 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-1e627aae-3a08-47a6-83b9-fbe99aa73cba req-2fc86a71-6119-4b79-977c-d8af30f84016 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/ports?device_id=e9041636-d49b-4bde-b686-3fb6ecbf907a HTTP/1.1" status: 200  len: 945 time: 0.0924950
May 20 04:35:08.845003 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-1e627aae-3a08-47a6-83b9-fbe99aa73cba req-6d9fad26-53b0-4852-b15c-2b589e69f271 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/security-groups?id=a91e9b1a-ef38-4317-bbea-c290d296dc7b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1581743
May 20 04:35:10.052420 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88a44143-e081-479d-af64-c1c785c49b15 req-bdd140f0-e858-4340-8e9d-0195bea71c7c tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:35:10.054442 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-88a44143-e081-479d-af64-c1c785c49b15 req-bdd140f0-e858-4340-8e9d-0195bea71c7c tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/ports?device_id=e9041636-d49b-4bde-b686-3fb6ecbf907a HTTP/1.1" status: 200  len: 945 time: 0.0987153
May 20 04:35:10.102062 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-88a44143-e081-479d-af64-c1c785c49b15 req-1f1540fe-9370-4c29-b965-fc49fa511f47 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/security-groups?id=a91e9b1a-ef38-4317-bbea-c290d296dc7b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0413823
May 20 04:35:29.872816 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f8377284-4cf1-4945-ad86-99087f03aa16 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:35:32.576809 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:35:32.729969 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-4f12ac65-8c5b-4526-b50d-889a730e0aac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:35:33.390983 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ea4803bd-878f-47d5-9084-1ec41953c9db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:35:35.239049 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f21320cc-6a25-4ec1-8a32-8b119b35fd55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:35:36.623920 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:35:39.559908 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-86d785c8-687b-4bf8-ae45-90ede50679cc req-a349c640-e206-4a64-bc4f-5c1f2c97841f service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=e9041636-d49b-4bde-b686-3fb6ecbf907a&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0787346
May 20 04:35:39.660651 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86d785c8-687b-4bf8-ae45-90ede50679cc req-a6ba2d99-4ea0-43be-9937-55da3fce0f7e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:35:39.663066 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-86d785c8-687b-4bf8-ae45-90ede50679cc req-a6ba2d99-4ea0-43be-9937-55da3fce0f7e service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=2035da004a584b4ea1f637e593596cd7&device_id=e9041636-d49b-4bde-b686-3fb6ecbf907a HTTP/1.1" status: 200  len: 1098 time: 0.0796614
May 20 04:35:39.827101 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86d785c8-687b-4bf8-ae45-90ede50679cc req-357e98b4-4c48-430e-a8d6-2e6fd02a62e5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:35:39.828480 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-86d785c8-687b-4bf8-ae45-90ede50679cc req-357e98b4-4c48-430e-a8d6-2e6fd02a62e5 service neutron] 10.222.0.82 "GET /v2.0/networks?id=4c58b50e-1091-40dd-b4fa-ff2da87b1475 HTTP/1.1" status: 200  len: 912 time: 0.1405635
May 20 04:35:39.930947 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-86d785c8-687b-4bf8-ae45-90ede50679cc req-c605cb36-3029-4705-9e43-89897c216971 service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=cda24ac9-3c25-4710-85ff-bcd2091b8d14 HTTP/1.1" status: 200  len: 1001 time: 0.0954573
May 20 04:35:39.959084 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.agents_db [None req-92d61f12-17bc-4bf9-9eab-8a69b8c6da2f None None] Agent healthcheck: found 6 active agents {{(pid=91689) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 04:35:39.999038 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86d785c8-687b-4bf8-ae45-90ede50679cc req-f28f9bfd-a91a-4ef2-8e9b-55b768701124 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:35:40.000472 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-86d785c8-687b-4bf8-ae45-90ede50679cc req-f28f9bfd-a91a-4ef2-8e9b-55b768701124 service neutron] 10.222.0.82 "GET /v2.0/subnets?id=24a65302-95b2-4d66-9d40-a9959babbe40 HTTP/1.1" status: 200  len: 850 time: 0.0615444
May 20 04:35:40.081974 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86d785c8-687b-4bf8-ae45-90ede50679cc req-6140f895-20e4-4acc-b137-7ec453291a72 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:35:40.083330 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-86d785c8-687b-4bf8-ae45-90ede50679cc req-6140f895-20e4-4acc-b137-7ec453291a72 service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=4c58b50e-1091-40dd-b4fa-ff2da87b1475&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0719192
May 20 04:35:40.233353 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-86d785c8-687b-4bf8-ae45-90ede50679cc req-4e019484-818d-4b04-b258-fab478a7c4b3 service neutron] 10.222.0.82 "GET /v2.0/networks/4c58b50e-1091-40dd-b4fa-ff2da87b1475?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1421592
May 20 04:35:40.367210 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-86d785c8-687b-4bf8-ae45-90ede50679cc req-1a733c37-1c68-41db-8736-6b0c5119f44c service neutron] 10.222.0.82 "GET /v2.0/networks/4c58b50e-1091-40dd-b4fa-ff2da87b1475?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1268754
May 20 04:35:59.867556 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1311f498-f438-4054-805f-602c85a96542 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:02.582420 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:02.734642 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-26a99d2d-cdaa-4dca-a18a-a81b6e97af1d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:03.390606 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ea4803bd-878f-47d5-9084-1ec41953c9db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:05.241942 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f21320cc-6a25-4ec1-8a32-8b119b35fd55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:06.630214 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:07.238786 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a78547c0-a312-4bc2-a140-d19ad0412549 req-188a91db-a0da-4540-a22d-545884f4fbbd tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:36:07.240332 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a78547c0-a312-4bc2-a140-d19ad0412549 req-188a91db-a0da-4540-a22d-545884f4fbbd tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/ports?device_id=e9041636-d49b-4bde-b686-3fb6ecbf907a HTTP/1.1" status: 200  len: 945 time: 0.0932004
May 20 04:36:07.285641 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a78547c0-a312-4bc2-a140-d19ad0412549 req-dff68f86-b35b-454e-848b-7606c0f1294a tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/security-groups?id=a91e9b1a-ef38-4317-bbea-c290d296dc7b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0394084
May 20 04:36:08.495144 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d5d431e-8d3e-4789-b516-b0fdfee69b51 req-4fa461a9-20e3-4cf1-88a6-93dde8b08773 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:36:08.496614 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-3d5d431e-8d3e-4789-b516-b0fdfee69b51 req-4fa461a9-20e3-4cf1-88a6-93dde8b08773 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/ports?device_id=e9041636-d49b-4bde-b686-3fb6ecbf907a HTTP/1.1" status: 200  len: 945 time: 0.0949717
May 20 04:36:08.541991 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-3d5d431e-8d3e-4789-b516-b0fdfee69b51 req-f414cdd0-60ca-4a33-aaaf-88c9472784a2 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/security-groups?id=a91e9b1a-ef38-4317-bbea-c290d296dc7b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0393445
May 20 04:36:09.744497 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3e1c799-6c65-4a8b-b414-ce40e07dea49 req-04ab5ac0-d95b-45c3-bb62-4490bd2ac52a tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:36:09.745972 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-f3e1c799-6c65-4a8b-b414-ce40e07dea49 req-04ab5ac0-d95b-45c3-bb62-4490bd2ac52a tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/ports?device_id=e9041636-d49b-4bde-b686-3fb6ecbf907a HTTP/1.1" status: 200  len: 945 time: 0.0889101
May 20 04:36:09.794555 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-f3e1c799-6c65-4a8b-b414-ce40e07dea49 req-bd136188-8089-4975-b3a1-2059c7dd370e tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/security-groups?id=a91e9b1a-ef38-4317-bbea-c290d296dc7b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0426874
May 20 04:36:10.985879 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0a51f65-03ed-4d62-9e22-ddfb35cadd62 req-87764de3-8511-4d9d-9d7c-e690ce042851 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:36:10.988304 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-b0a51f65-03ed-4d62-9e22-ddfb35cadd62 req-87764de3-8511-4d9d-9d7c-e690ce042851 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/ports?device_id=e9041636-d49b-4bde-b686-3fb6ecbf907a HTTP/1.1" status: 200  len: 945 time: 0.0849762
May 20 04:36:11.033836 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-b0a51f65-03ed-4d62-9e22-ddfb35cadd62 req-60e1368b-32b4-4f87-bd9e-993ed14677b1 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/security-groups?id=a91e9b1a-ef38-4317-bbea-c290d296dc7b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0395031
May 20 04:36:12.351404 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34723176-a476-4dad-9633-b8d2f55cb657 req-6e68cc7e-b7b9-47aa-b263-0eea8484b88d tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:36:12.352843 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-34723176-a476-4dad-9633-b8d2f55cb657 req-6e68cc7e-b7b9-47aa-b263-0eea8484b88d tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/ports?device_id=e9041636-d49b-4bde-b686-3fb6ecbf907a HTTP/1.1" status: 200  len: 945 time: 0.1947792
May 20 04:36:12.402025 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-34723176-a476-4dad-9633-b8d2f55cb657 req-52d6b8cc-6783-4705-8b00-62b0937cb3e8 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/security-groups?id=a91e9b1a-ef38-4317-bbea-c290d296dc7b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0431318
May 20 04:36:13.683709 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a40cb17-be8b-488d-b54e-f7b22c10c24b req-483cd464-1cef-41b8-bcee-db75a591eb7a tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:36:13.685214 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-4a40cb17-be8b-488d-b54e-f7b22c10c24b req-483cd464-1cef-41b8-bcee-db75a591eb7a tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/ports?device_id=e9041636-d49b-4bde-b686-3fb6ecbf907a HTTP/1.1" status: 200  len: 945 time: 0.1566997
May 20 04:36:13.732793 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-4a40cb17-be8b-488d-b54e-f7b22c10c24b req-b0b1e064-c2e4-4b48-99bf-993f5da36aad tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/security-groups?id=a91e9b1a-ef38-4317-bbea-c290d296dc7b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0416903
May 20 04:36:14.927855 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f538222f-c628-4e3c-a3ee-ebbcd82d1a61 req-a3cc0673-7d3e-4d38-8b0e-a6cc4d9cb506 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:36:14.929351 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-f538222f-c628-4e3c-a3ee-ebbcd82d1a61 req-a3cc0673-7d3e-4d38-8b0e-a6cc4d9cb506 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/ports?device_id=e9041636-d49b-4bde-b686-3fb6ecbf907a HTTP/1.1" status: 200  len: 945 time: 0.0873413
May 20 04:36:14.975336 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-f538222f-c628-4e3c-a3ee-ebbcd82d1a61 req-2f989b51-1394-4641-a7be-253a600626f2 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/security-groups?id=a91e9b1a-ef38-4317-bbea-c290d296dc7b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0401452
May 20 04:36:16.170727 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2ff767e-9da2-4aa1-a955-a4f7bf3d7d1d req-53aac927-2396-47ab-858e-659fc246e1cc tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:36:16.172089 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-d2ff767e-9da2-4aa1-a955-a4f7bf3d7d1d req-53aac927-2396-47ab-858e-659fc246e1cc tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/ports?device_id=e9041636-d49b-4bde-b686-3fb6ecbf907a HTTP/1.1" status: 200  len: 945 time: 0.0894814
May 20 04:36:16.219556 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-d2ff767e-9da2-4aa1-a955-a4f7bf3d7d1d req-fa4f30b8-1bc8-48fa-b8de-d83a5982cbb7 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/security-groups?id=a91e9b1a-ef38-4317-bbea-c290d296dc7b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0390425
May 20 04:36:16.958557 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.agents_db [None req-92d61f12-17bc-4bf9-9eab-8a69b8c6da2f None None] Agent healthcheck: found 6 active agents {{(pid=91689) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 04:36:17.405328 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c88ac029-6510-4ade-80f7-5cb51579783b req-e833aba0-1a91-4f92-88df-957673520607 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:36:17.407127 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-c88ac029-6510-4ade-80f7-5cb51579783b req-e833aba0-1a91-4f92-88df-957673520607 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/ports?device_id=e9041636-d49b-4bde-b686-3fb6ecbf907a HTTP/1.1" status: 200  len: 945 time: 0.0835845
May 20 04:36:17.454459 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-c88ac029-6510-4ade-80f7-5cb51579783b req-058a6f98-259c-4f24-bf6b-eb4061573e83 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/security-groups?id=a91e9b1a-ef38-4317-bbea-c290d296dc7b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0414958
May 20 04:36:18.656365 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5450b88-376c-4116-b2a6-6495b030ce7d req-b7e97a38-4a1b-4655-9d43-5da54d400bbd tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:36:18.658322 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-a5450b88-376c-4116-b2a6-6495b030ce7d req-b7e97a38-4a1b-4655-9d43-5da54d400bbd tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/ports?device_id=e9041636-d49b-4bde-b686-3fb6ecbf907a HTTP/1.1" status: 200  len: 945 time: 0.0922244
May 20 04:36:18.704549 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-a5450b88-376c-4116-b2a6-6495b030ce7d req-8dec3f60-56b9-4fc5-a112-fed0f3203849 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/security-groups?id=a91e9b1a-ef38-4317-bbea-c290d296dc7b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0386736
May 20 04:36:19.071787 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-818e771e-122a-48ad-93f2-b1d72286e35f req-713d1664-20b5-4e8a-9108-7cf591e98c0d tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:36:19.073227 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-818e771e-122a-48ad-93f2-b1d72286e35f req-713d1664-20b5-4e8a-9108-7cf591e98c0d tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/ports?device_id=e9041636-d49b-4bde-b686-3fb6ecbf907a HTTP/1.1" status: 200  len: 945 time: 0.0857329
May 20 04:36:19.112995 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9cc72000-f99f-4795-bfd1-b33b3d5f05cc req-3fe49fa1-7071-4169-8dde-9d6220c64bdb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:36:19.114500 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9cc72000-f99f-4795-bfd1-b33b3d5f05cc req-3fe49fa1-7071-4169-8dde-9d6220c64bdb service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=2035da004a584b4ea1f637e593596cd7&device_id=e9041636-d49b-4bde-b686-3fb6ecbf907a HTTP/1.1" status: 200  len: 1098 time: 0.0758510
May 20 04:36:19.120420 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-818e771e-122a-48ad-93f2-b1d72286e35f req-ae558330-e7ac-4dc5-9ec9-5609a6eca3cc tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/security-groups?id=a91e9b1a-ef38-4317-bbea-c290d296dc7b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0412035
May 20 04:36:19.249801 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9cc72000-f99f-4795-bfd1-b33b3d5f05cc req-5d23ecaa-7a11-4d0d-80ba-5da7acb3e170 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:36:19.251243 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9cc72000-f99f-4795-bfd1-b33b3d5f05cc req-5d23ecaa-7a11-4d0d-80ba-5da7acb3e170 service neutron] 10.222.0.82 "GET /v2.0/networks?id=4c58b50e-1091-40dd-b4fa-ff2da87b1475 HTTP/1.1" status: 200  len: 912 time: 0.1301992
May 20 04:36:19.352070 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9cc72000-f99f-4795-bfd1-b33b3d5f05cc req-30be1fbf-a67f-4c30-b5b4-e099bf9401c3 service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=cda24ac9-3c25-4710-85ff-bcd2091b8d14 HTTP/1.1" status: 200  len: 1001 time: 0.0944867
May 20 04:36:19.511162 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9cc72000-f99f-4795-bfd1-b33b3d5f05cc req-75860a3a-d11e-42ec-adc0-668947bde7c8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:36:19.512599 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9cc72000-f99f-4795-bfd1-b33b3d5f05cc req-75860a3a-d11e-42ec-adc0-668947bde7c8 service neutron] 10.222.0.82 "GET /v2.0/subnets?id=24a65302-95b2-4d66-9d40-a9959babbe40 HTTP/1.1" status: 200  len: 850 time: 0.1541812
May 20 04:36:19.594088 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9cc72000-f99f-4795-bfd1-b33b3d5f05cc req-8f9eef68-3793-41b1-aa87-1ca0a61b2277 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:36:19.595524 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9cc72000-f99f-4795-bfd1-b33b3d5f05cc req-8f9eef68-3793-41b1-aa87-1ca0a61b2277 service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=4c58b50e-1091-40dd-b4fa-ff2da87b1475&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0758193
May 20 04:36:19.726057 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9cc72000-f99f-4795-bfd1-b33b3d5f05cc req-4111c945-544e-4b74-b9d7-daab9f8986f9 service neutron] 10.222.0.82 "GET /v2.0/networks/4c58b50e-1091-40dd-b4fa-ff2da87b1475?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1235349
May 20 04:36:19.859693 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9cc72000-f99f-4795-bfd1-b33b3d5f05cc req-fa2d9366-ddee-4cd2-8fb6-c638854c40aa service neutron] 10.222.0.82 "GET /v2.0/networks/4c58b50e-1091-40dd-b4fa-ff2da87b1475?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1264255
May 20 04:36:20.322977 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4219bf86-f4d7-4a6f-8f5c-32f4efda78aa req-7a4101a1-86f9-432f-a72a-83a54b30ef13 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:36:20.324463 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4219bf86-f4d7-4a6f-8f5c-32f4efda78aa req-7a4101a1-86f9-432f-a72a-83a54b30ef13 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/ports?device_id=e9041636-d49b-4bde-b686-3fb6ecbf907a HTTP/1.1" status: 200  len: 945 time: 0.0926547
May 20 04:36:20.369008 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4219bf86-f4d7-4a6f-8f5c-32f4efda78aa req-7513ef29-3c18-4095-a17b-9373adce3be7 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/security-groups?id=a91e9b1a-ef38-4317-bbea-c290d296dc7b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0387490
May 20 04:36:21.574096 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b29a03f1-d4d2-4bf0-84c1-f7cc2d0213e0 req-2a12ed4f-b79e-45a1-95c1-7240d5034917 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:36:21.575978 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-b29a03f1-d4d2-4bf0-84c1-f7cc2d0213e0 req-2a12ed4f-b79e-45a1-95c1-7240d5034917 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/ports?device_id=e9041636-d49b-4bde-b686-3fb6ecbf907a HTTP/1.1" status: 200  len: 945 time: 0.0936983
May 20 04:36:21.629595 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-b29a03f1-d4d2-4bf0-84c1-f7cc2d0213e0 req-306875de-4771-477c-ab8a-bbcd90052dc6 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/security-groups?id=a91e9b1a-ef38-4317-bbea-c290d296dc7b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0476973
May 20 04:36:29.873108 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-dea0654e-9131-4eea-b930-5399d37d200f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:32.585719 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:32.739274 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-c321dd28-d618-4555-a970-7c478e84fcb5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:33.399069 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ea4803bd-878f-47d5-9084-1ec41953c9db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:35.195901 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 46778) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:36:35.244632 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f21320cc-6a25-4ec1-8a32-8b119b35fd55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:35.473464 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.plugin [None req-0e9ea786-5cba-4d90-ac62-0ce45b07236f tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Deleting port 9096b4ae-90b2-4318-9d1f-a460637615dd {{(pid=91686) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 04:36:35.473726 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-0e9ea786-5cba-4d90-ac62-0ce45b07236f tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8782892520551'] for port, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:35.598206 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-0e9ea786-5cba-4d90-ac62-0ce45b07236f tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1718922'] for port, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:35.598510 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-0e9ea786-5cba-4d90-ac62-0ce45b07236f tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:35.717330 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.plugin [None req-0e9ea786-5cba-4d90-ac62-0ce45b07236f tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Calling delete_port for 9096b4ae-90b2-4318-9d1f-a460637615dd owned by network:floatingip {{(pid=91686) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 04:36:35.865781 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-0e9ea786-5cba-4d90-ac62-0ce45b07236f tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8782892522936', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8782892108804', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2145052'] for port, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:35.869870 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-6132a66e-db83-406d-88e8-7496df9df35a tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:36:36.019217 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e9ea786-5cba-4d90-ac62-0ce45b07236f tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Pushing event deleted for resources: {'Port': ['ID=9096b4ae-90b2-4318-9d1f-a460637615dd,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:36:36.062087 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e9ea786-5cba-4d90-ac62-0ce45b07236f tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:36:36.062469 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e9ea786-5cba-4d90-ac62-0ce45b07236f tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:36:36.062844 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e9ea786-5cba-4d90-ac62-0ce45b07236f tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:36:36.063212 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e9ea786-5cba-4d90-ac62-0ce45b07236f tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:36:36.063572 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e9ea786-5cba-4d90-ac62-0ce45b07236f tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:36:36.063926 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e9ea786-5cba-4d90-ac62-0ce45b07236f tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:36:36.064293 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e9ea786-5cba-4d90-ac62-0ce45b07236f tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:36:36.064645 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e9ea786-5cba-4d90-ac62-0ce45b07236f tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:36:36.065095 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e9ea786-5cba-4d90-ac62-0ce45b07236f tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:36:36.065453 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e9ea786-5cba-4d90-ac62-0ce45b07236f tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:36:36.065803 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e9ea786-5cba-4d90-ac62-0ce45b07236f tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:36:36.066154 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e9ea786-5cba-4d90-ac62-0ce45b07236f tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:36:36.095404 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-0e9ea786-5cba-4d90-ac62-0ce45b07236f tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.225s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:36:36.126969 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-0e9ea786-5cba-4d90-ac62-0ce45b07236f tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks [] for floatingip, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:36.127231 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.db.l3_db [None req-0e9ea786-5cba-4d90-ac62-0ce45b07236f tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Floating IP 4a030eff-52d4-4f0d-b4c3-a18100b68cc4 disassociated (deleted). External IP: 172.27.1.108, port: 1549cd2e-e51f-42cf-9024-803e9fae98be.
May 20 04:36:36.485013 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0e9ea786-5cba-4d90-ac62-0ce45b07236f tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Router a7f66c4d-6b4f-4053-bd69-e1bea7db4c61 has already been hosted by L3 agent 02733fc0-fc9c-4e29-bc03-c27a792d539d {{(pid=91686) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 04:36:36.626619 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:36.678516 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0e9ea786-5cba-4d90-ac62-0ce45b07236f tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify agent at l3_agent.dv-cinder-790910-4-iscsi the message routers_updated {{(pid=91686) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 04:36:36.687823 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6670459c-8e4e-4433-ad6f-842e8541e13f None None] Sync routers for ids ['a7f66c4d-6b4f-4053-bd69-e1bea7db4c61'] in dv-cinder-790910-4-iscsi {{(pid=91689) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 04:36:36.699024 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6670459c-8e4e-4433-ad6f-842e8541e13f None None] Routers {'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91689) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:36:36.699631 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-6670459c-8e4e-4433-ad6f-842e8541e13f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced17df040>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:36:33Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['a7f66c4d-6b4f-4053-bd69-e1bea7db4c61'], 'active': True} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:36:36.700976 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-0e9ea786-5cba-4d90-ac62-0ce45b07236f tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for floatingip, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:36.755277 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-0e9ea786-5cba-4d90-ac62-0ce45b07236f tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "DELETE /v2.0/floatingips/4a030eff-52d4-4f0d-b4c3-a18100b68cc4 HTTP/1.1" status: 204  len: 168 time: 1.5582449
May 20 04:36:36.755837 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '45272356-d63b-4804-88a7-a122c4ed71ca', 'tag': '1549cd2e-e51f-42cf-9024-803e9fae98be'}] {{(pid=91686) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:36:36.808154 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '45272356-d63b-4804-88a7-a122c4ed71ca', 'tag': '1549cd2e-e51f-42cf-9024-803e9fae98be', 'status': 'completed', 'code': 200}
May 20 04:36:36.878934 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvr_db [None req-6670459c-8e4e-4433-ad6f-842e8541e13f None None] Set router a7f66c4d-6b4f-4053-bd69-e1bea7db4c61 gateway port host: dv-cinder-790910-4-iscsi {{(pid=91689) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:36:36.990209 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f8bf17a-0645-4f3c-bcd6-68b2fe9608b5 req-bcfb831f-671b-4403-86cb-329caa040233 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:36:36.991713 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4f8bf17a-0645-4f3c-bcd6-68b2fe9608b5 req-bcfb831f-671b-4403-86cb-329caa040233 service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=9b6fb271a7a546a38b0c6df5beaf22fc&device_id=45272356-d63b-4804-88a7-a122c4ed71ca HTTP/1.1" status: 200  len: 1098 time: 0.1602180
May 20 04:36:37.136824 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f8bf17a-0645-4f3c-bcd6-68b2fe9608b5 req-2c326e58-4a9e-4eb4-88fa-6ff75ab5a700 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:36:37.138289 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4f8bf17a-0645-4f3c-bcd6-68b2fe9608b5 req-2c326e58-4a9e-4eb4-88fa-6ff75ab5a700 service neutron] 10.222.0.82 "GET /v2.0/networks?id=11c994a8-6ede-4290-84f0-71af466860db HTTP/1.1" status: 200  len: 912 time: 0.1391554
May 20 04:36:37.152851 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a1585de-a7e5-416d-a5d0-b66a33451d3c req-362e7dd2-69e1-455a-b6dc-6a4d63658c52 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:36:37.153708 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [req-8a1585de-a7e5-416d-a5d0-b66a33451d3c req-362e7dd2-69e1-455a-b6dc-6a4d63658c52 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Synchronizing usage tracker for tenant:9b6fb271a7a546a38b0c6df5beaf22fc on resource:port {{(pid=91686) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:36:37.169840 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [req-8a1585de-a7e5-416d-a5d0-b66a33451d3c req-362e7dd2-69e1-455a-b6dc-6a4d63658c52 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Unset dirty status for tenant:9b6fb271a7a546a38b0c6df5beaf22fc on resource:port {{(pid=91686) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:36:37.176735 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-8a1585de-a7e5-416d-a5d0-b66a33451d3c req-362e7dd2-69e1-455a-b6dc-6a4d63658c52 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/ports?device_id=45272356-d63b-4804-88a7-a122c4ed71ca HTTP/1.1" status: 200  len: 945 time: 0.1081183
May 20 04:36:37.209343 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4f8bf17a-0645-4f3c-bcd6-68b2fe9608b5 req-57a14b74-6ec2-4e33-a711-39b8a6386657 service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=1549cd2e-e51f-42cf-9024-803e9fae98be HTTP/1.1" status: 200  len: 217 time: 0.0621293
May 20 04:36:37.226950 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-8a1585de-a7e5-416d-a5d0-b66a33451d3c req-ccce22e0-8f62-48e3-9c6b-05d440dd02b4 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/security-groups?id=ef28d688-789b-4282-a30c-d7d731615fbf&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0489931
May 20 04:36:37.241392 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-6670459c-8e4e-4433-ad6f-842e8541e13f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced17df040>, [{'id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'name': 'tempest-TestVolumeBootPattern-857163320-router', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.91'}], 'enable_snat': True}, 'gw_port_id': '866cc6c0-5986-4eb4-8827-b255811a13de', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:28:09Z', 'updated_at': '2021-05-20T04:28:12Z', 'revision_number': 4, 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'gw_port': {'id': '866cc6c0-5986-4eb4-8827-b255811a13de', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:f5:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'device_owner': 'network:router_gateway', 'standard_attr_id': 511, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:28:09Z', 'updated_at': '2021-05-20T04:28:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_floatingips': [{'id': '3e823655-ee96-49c4-9d83-df544348d4cf', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'floating_ip_address': '172.27.1.86', 'floating_network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'router_id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'port_id': 'b1bae5dc-7bbe-4c23-b60b-26cf817da0ee', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 597, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '11c994a8-6ede-4290-84f0-71af466860db', 'mac_address': 'fa:16:3e:43:d1:db', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'de26e049-9f19-44e7-93d5-64ccd77cb9de', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T04:32:07Z', 'updated_at': '2021-05-20T04:32:10Z', 'revision_number': 1, 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0bcb5c14-319d-4871-bef1-50d60ad3f5b8', 'name': '', 'network_id': '11c994a8-6ede-4290-84f0-71af466860db', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'mac_address': 'fa:16:3e:2c:84:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'device_owner': 'network:router_interface', 'standard_attr_id': 512, 'fixed_ips': [{'subnet_id': '51af45f1-449a-400c-8714-8d713d4a7993', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:28:12Z', 'updated_at': '2021-05-20T04:28:19Z', 'revision_number': 5, 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'subnets': [{'id': '51af45f1-449a-400c-8714-8d713d4a7993', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:36:37.247840 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6670459c-8e4e-4433-ad6f-842e8541e13f None None] Checking router: a7f66c4d-6b4f-4053-bd69-e1bea7db4c61 for host: dv-cinder-790910-4-iscsi {{(pid=91689) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 04:36:37.256334 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6670459c-8e4e-4433-ad6f-842e8541e13f None None] Routers {'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91689) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:36:37.256944 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-6670459c-8e4e-4433-ad6f-842e8541e13f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced17df040>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:36:33Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['a7f66c4d-6b4f-4053-bd69-e1bea7db4c61'], 'active': True} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:36:37.285703 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f8bf17a-0645-4f3c-bcd6-68b2fe9608b5 req-2733a12f-e358-42ef-9760-4fdfeacf2944 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:36:37.287151 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4f8bf17a-0645-4f3c-bcd6-68b2fe9608b5 req-2733a12f-e358-42ef-9760-4fdfeacf2944 service neutron] 10.222.0.82 "GET /v2.0/subnets?id=51af45f1-449a-400c-8714-8d713d4a7993 HTTP/1.1" status: 200  len: 850 time: 0.0694361
May 20 04:36:37.366919 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f8bf17a-0645-4f3c-bcd6-68b2fe9608b5 req-a60909ee-bf78-48cc-93dc-a20160bdc2f7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:36:37.368387 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4f8bf17a-0645-4f3c-bcd6-68b2fe9608b5 req-a60909ee-bf78-48cc-93dc-a20160bdc2f7 service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=11c994a8-6ede-4290-84f0-71af466860db&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0743740
May 20 04:36:37.466629 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvr_db [None req-6670459c-8e4e-4433-ad6f-842e8541e13f None None] Set router a7f66c4d-6b4f-4053-bd69-e1bea7db4c61 gateway port host: dv-cinder-790910-4-iscsi {{(pid=91689) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:36:37.508323 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4f8bf17a-0645-4f3c-bcd6-68b2fe9608b5 req-b7623fa8-19a5-4335-828e-7f8b0ed61eac service neutron] 10.222.0.82 "GET /v2.0/networks/11c994a8-6ede-4290-84f0-71af466860db?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1273005
May 20 04:36:37.646992 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4f8bf17a-0645-4f3c-bcd6-68b2fe9608b5 req-0ec282a0-3938-4237-aa0b-cbc34d990348 service neutron] 10.222.0.82 "GET /v2.0/networks/11c994a8-6ede-4290-84f0-71af466860db?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1303985
May 20 04:36:37.829433 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-6670459c-8e4e-4433-ad6f-842e8541e13f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced17df040>, [{'id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'name': 'tempest-TestVolumeBootPattern-857163320-router', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.91'}], 'enable_snat': True}, 'gw_port_id': '866cc6c0-5986-4eb4-8827-b255811a13de', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:28:09Z', 'updated_at': '2021-05-20T04:28:12Z', 'revision_number': 4, 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'gw_port': {'id': '866cc6c0-5986-4eb4-8827-b255811a13de', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:f5:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'device_owner': 'network:router_gateway', 'standard_attr_id': 511, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:28:09Z', 'updated_at': '2021-05-20T04:28:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_floatingips': [{'id': '3e823655-ee96-49c4-9d83-df544348d4cf', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'floating_ip_address': '172.27.1.86', 'floating_network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'router_id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'port_id': 'b1bae5dc-7bbe-4c23-b60b-26cf817da0ee', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 597, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '11c994a8-6ede-4290-84f0-71af466860db', 'mac_address': 'fa:16:3e:43:d1:db', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'de26e049-9f19-44e7-93d5-64ccd77cb9de', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T04:32:07Z', 'updated_at': '2021-05-20T04:32:10Z', 'revision_number': 1, 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0bcb5c14-319d-4871-bef1-50d60ad3f5b8', 'name': '', 'network_id': '11c994a8-6ede-4290-84f0-71af466860db', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'mac_address': 'fa:16:3e:2c:84:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'device_owner': 'network:router_interface', 'standard_attr_id': 512, 'fixed_ips': [{'subnet_id': '51af45f1-449a-400c-8714-8d713d4a7993', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:28:12Z', 'updated_at': '2021-05-20T04:28:19Z', 'revision_number': 5, 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'subnets': [{'id': '51af45f1-449a-400c-8714-8d713d4a7993', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:36:37.833984 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6670459c-8e4e-4433-ad6f-842e8541e13f None None] The sync data for ids ['a7f66c4d-6b4f-4053-bd69-e1bea7db4c61'] in dv-cinder-790910-4-iscsi is: [{'id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'name': 'tempest-TestVolumeBootPattern-857163320-router', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.91'}], 'enable_snat': True}, 'gw_port_id': '866cc6c0-5986-4eb4-8827-b255811a13de', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:28:09Z', 'updated_at': '2021-05-20T04:28:12Z', 'revision_number': 4, 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'gw_port': {'id': '866cc6c0-5986-4eb4-8827-b255811a13de', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:f5:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'device_owner': 'network:router_gateway', 'standard_attr_id': 511, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:28:09Z', 'updated_at': '2021-05-20T04:28:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_floatingips': [{'id': '3e823655-ee96-49c4-9d83-df544348d4cf', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'floating_ip_address': '172.27.1.86', 'floating_network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'router_id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'port_id': 'b1bae5dc-7bbe-4c23-b60b-26cf817da0ee', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 597, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '11c994a8-6ede-4290-84f0-71af466860db', 'mac_address': 'fa:16:3e:43:d1:db', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'de26e049-9f19-44e7-93d5-64ccd77cb9de', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T04:32:07Z', 'updated_at': '2021-05-20T04:32:10Z', 'revision_number': 1, 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0bcb5c14-319d-4871-bef1-50d60ad3f5b8', 'name': '', 'network_id': '11c994a8-6ede-4290-84f0-71af466860db', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'mac_address': 'fa:16:3e:2c:84:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'device_owner': 'network:router_interface', 'standard_attr_id': 512, 'fixed_ips': [{'subnet_id': '51af45f1-449a-400c-8714-8d713d4a7993', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:28:12Z', 'updated_at': '2021-05-20T04:28:19Z', 'revision_number': 5, 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'subnets': [{'id': '51af45f1-449a-400c-8714-8d713d4a7993', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91689) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 04:36:38.078520 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b0093cb3-0e42-4292-8233-ab1a34353fea None None] New status for floating IP 4a030eff-52d4-4f0d-b4c3-a18100b68cc4: DOWN {{(pid=91688) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 20 04:36:38.430915 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-333ea67a-3e67-4e14-b077-5bfc4f8d5d5f req-746ad801-6db0-4817-a63e-79390a6add85 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:36:38.432372 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-333ea67a-3e67-4e14-b077-5bfc4f8d5d5f req-746ad801-6db0-4817-a63e-79390a6add85 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/ports?device_id=45272356-d63b-4804-88a7-a122c4ed71ca HTTP/1.1" status: 200  len: 945 time: 0.0902534
May 20 04:36:38.480547 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-333ea67a-3e67-4e14-b077-5bfc4f8d5d5f req-fc96f559-9d5c-4334-9488-bbb98872c378 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/security-groups?id=ef28d688-789b-4282-a30c-d7d731615fbf&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0420280
May 20 04:36:38.781300 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04a2181c-63ff-4d20-8b3f-c96321c3c159 req-2e25317e-1855-4c80-a5ed-438e18753cf2 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:36:38.782758 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-04a2181c-63ff-4d20-8b3f-c96321c3c159 req-2e25317e-1855-4c80-a5ed-438e18753cf2 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.82 "GET /v2.0/ports?device_id=45272356-d63b-4804-88a7-a122c4ed71ca HTTP/1.1" status: 200  len: 945 time: 0.0857909
May 20 04:36:38.927943 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [req-04a2181c-63ff-4d20-8b3f-c96321c3c159 req-75db2a80-6ab3-47d6-96a0-80f240e9f630 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Deleting port 1549cd2e-e51f-42cf-9024-803e9fae98be {{(pid=91687) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 04:36:38.928279 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-04a2181c-63ff-4d20-8b3f-c96321c3c159 req-75db2a80-6ab3-47d6-96a0-80f240e9f630 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8782892520551'] for port, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:39.163270 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [req-04a2181c-63ff-4d20-8b3f-c96321c3c159 req-75db2a80-6ab3-47d6-96a0-80f240e9f630 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] For port 1549cd2e-e51f-42cf-9024-803e9fae98be, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=1549cd2e-e51f-42cf-9024-803e9fae98be,segment=NetworkSegment(e9f32492-7a41-4dc9-bc94-b8bce4a8e65d),segment_id=e9f32492-7a41-4dc9-bc94-b8bce4a8e65d)] {{(pid=91687) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:36:39.163556 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-04a2181c-63ff-4d20-8b3f-c96321c3c159 req-75db2a80-6ab3-47d6-96a0-80f240e9f630 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1718922'] for port, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:39.284366 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [req-04a2181c-63ff-4d20-8b3f-c96321c3c159 req-75db2a80-6ab3-47d6-96a0-80f240e9f630 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Calling delete_port for 1549cd2e-e51f-42cf-9024-803e9fae98be owned by compute:nova {{(pid=91687) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 04:36:39.401221 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-04a2181c-63ff-4d20-8b3f-c96321c3c159 req-75db2a80-6ab3-47d6-96a0-80f240e9f630 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8782892522936', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8782892108804', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4162192'] for port, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:39.407351 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-c98e48a5-10bf-4c18-b4ed-62242a953862 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:36:39.450985 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75db2a80-6ab3-47d6-96a0-80f240e9f630 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Pushing event deleted for resources: {'Port': ['ID=1549cd2e-e51f-42cf-9024-803e9fae98be,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:36:39.488827 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75db2a80-6ab3-47d6-96a0-80f240e9f630 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:36:39.489222 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75db2a80-6ab3-47d6-96a0-80f240e9f630 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:36:39.489592 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75db2a80-6ab3-47d6-96a0-80f240e9f630 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:36:39.489954 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75db2a80-6ab3-47d6-96a0-80f240e9f630 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:36:39.490313 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75db2a80-6ab3-47d6-96a0-80f240e9f630 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:36:39.490669 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75db2a80-6ab3-47d6-96a0-80f240e9f630 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:36:39.491024 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75db2a80-6ab3-47d6-96a0-80f240e9f630 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:36:39.491376 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75db2a80-6ab3-47d6-96a0-80f240e9f630 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:36:39.491748 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75db2a80-6ab3-47d6-96a0-80f240e9f630 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:36:39.492086 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75db2a80-6ab3-47d6-96a0-80f240e9f630 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:36:39.492505 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75db2a80-6ab3-47d6-96a0-80f240e9f630 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:36:39.492854 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75db2a80-6ab3-47d6-96a0-80f240e9f630 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:36:39.500187 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-75db2a80-6ab3-47d6-96a0-80f240e9f630 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:36:39.539322 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.l3_dvrscheduler_db [req-04a2181c-63ff-4d20-8b3f-c96321c3c159 req-75db2a80-6ab3-47d6-96a0-80f240e9f630 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] No DVR routers for this DVR port 1549cd2e-e51f-42cf-9024-803e9fae98be on host hv-cinder-79091 {{(pid=91687) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 04:36:39.541905 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-04a2181c-63ff-4d20-8b3f-c96321c3c159 req-75db2a80-6ab3-47d6-96a0-80f240e9f630 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for port, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:39.544483 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '45272356-d63b-4804-88a7-a122c4ed71ca', 'name': 'network-vif-deleted', 'tag': '1549cd2e-e51f-42cf-9024-803e9fae98be'}] {{(pid=91687) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:36:39.561742 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-04a2181c-63ff-4d20-8b3f-c96321c3c159 req-75db2a80-6ab3-47d6-96a0-80f240e9f630 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.82 "DELETE /v2.0/ports/1549cd2e-e51f-42cf-9024-803e9fae98be HTTP/1.1" status: 204  len: 173 time: 0.7729945
May 20 04:36:39.590995 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '45272356-d63b-4804-88a7-a122c4ed71ca', 'name': 'network-vif-deleted', 'tag': '1549cd2e-e51f-42cf-9024-803e9fae98be', 'status': 'completed', 'code': 200}
May 20 04:36:39.642478 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-1b54aaa0-d0c0-41fc-a17b-f6835ffc4694 req-2a41c111-64d9-496c-9bce-acd1f9eea820 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/ports?device_id=45272356-d63b-4804-88a7-a122c4ed71ca HTTP/1.1" status: 200  len: 210 time: 0.0427446
May 20 04:36:43.188616 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 46810) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:36:43.439729 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 1549cd2e-e51f-42cf-9024-803e9fae98be no longer exists at agent hyperv_hv-cinder-79091 {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 04:36:43.457473 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.plugin [None req-8ece3c1b-ee3b-4d08-abc8-c70690001bab tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Deleting port ca121a9d-b4a4-4641-9c83-971ee0156e48 {{(pid=91686) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 04:36:43.457819 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-8ece3c1b-ee3b-4d08-abc8-c70690001bab tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8782892520551'] for port, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:43.473885 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] No Port match for: 1549cd2e-e51f-42cf-9024-803e9fae98be {{(pid=91688) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 04:36:43.474237 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 1549cd2e-e51f-42cf-9024-803e9fae98be not bound to the agent host hv-cinder-79091 {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 04:36:43.585383 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-8ece3c1b-ee3b-4d08-abc8-c70690001bab tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1718922'] for port, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:43.585666 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-8ece3c1b-ee3b-4d08-abc8-c70690001bab tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:43.828755 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.plugin [None req-8ece3c1b-ee3b-4d08-abc8-c70690001bab tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Calling delete_port for ca121a9d-b4a4-4641-9c83-971ee0156e48 owned by network:floatingip {{(pid=91686) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 04:36:43.962723 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-8ece3c1b-ee3b-4d08-abc8-c70690001bab tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8782892522936', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8782892108804', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2145052'] for port, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:43.967387 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-7d046e63-974f-402d-80e9-609f3a8651fc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:36:44.009786 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ece3c1b-ee3b-4d08-abc8-c70690001bab tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Pushing event deleted for resources: {'Port': ['ID=ca121a9d-b4a4-4641-9c83-971ee0156e48,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:36:44.039910 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-8ece3c1b-ee3b-4d08-abc8-c70690001bab tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:36:44.101817 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-8ece3c1b-ee3b-4d08-abc8-c70690001bab tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks [] for floatingip, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:44.102054 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.db.l3_db [None req-8ece3c1b-ee3b-4d08-abc8-c70690001bab tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Floating IP 3e823655-ee96-49c4-9d83-df544348d4cf disassociated (deleted). External IP: 172.27.1.86, port: b1bae5dc-7bbe-4c23-b60b-26cf817da0ee.
May 20 04:36:44.460450 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8ece3c1b-ee3b-4d08-abc8-c70690001bab tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Router a7f66c4d-6b4f-4053-bd69-e1bea7db4c61 has already been hosted by L3 agent 02733fc0-fc9c-4e29-bc03-c27a792d539d {{(pid=91686) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 04:36:44.642317 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8ece3c1b-ee3b-4d08-abc8-c70690001bab tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify agent at l3_agent.dv-cinder-790910-4-iscsi the message routers_updated {{(pid=91686) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 04:36:44.652123 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ac0ecfe-0bcc-440a-9bcb-b2f585197bde None None] Sync routers for ids ['a7f66c4d-6b4f-4053-bd69-e1bea7db4c61'] in dv-cinder-790910-4-iscsi {{(pid=91689) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 04:36:44.659160 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-8ece3c1b-ee3b-4d08-abc8-c70690001bab tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for floatingip, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:44.662028 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6ac0ecfe-0bcc-440a-9bcb-b2f585197bde None None] Routers {'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91689) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:36:44.662668 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-6ac0ecfe-0bcc-440a-9bcb-b2f585197bde None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced17c6640>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:36:33Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['a7f66c4d-6b4f-4053-bd69-e1bea7db4c61'], 'active': True} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:36:44.715147 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-8ece3c1b-ee3b-4d08-abc8-c70690001bab tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "DELETE /v2.0/floatingips/3e823655-ee96-49c4-9d83-df544348d4cf HTTP/1.1" status: 204  len: 168 time: 1.5227857
May 20 04:36:44.715147 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'de26e049-9f19-44e7-93d5-64ccd77cb9de', 'tag': 'b1bae5dc-7bbe-4c23-b60b-26cf817da0ee'}] {{(pid=91686) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:36:44.759554 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'de26e049-9f19-44e7-93d5-64ccd77cb9de', 'tag': 'b1bae5dc-7bbe-4c23-b60b-26cf817da0ee', 'status': 'completed', 'code': 200}
May 20 04:36:44.842461 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvr_db [None req-6ac0ecfe-0bcc-440a-9bcb-b2f585197bde None None] Set router a7f66c4d-6b4f-4053-bd69-e1bea7db4c61 gateway port host: dv-cinder-790910-4-iscsi {{(pid=91689) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:36:44.851867 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1aa6244-e903-4b5b-8af3-061649708995 req-8e50461a-35e6-4877-a2ef-b760e856b85c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:36:44.853551 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-b1aa6244-e903-4b5b-8af3-061649708995 req-8e50461a-35e6-4877-a2ef-b760e856b85c service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=9b6fb271a7a546a38b0c6df5beaf22fc&device_id=de26e049-9f19-44e7-93d5-64ccd77cb9de HTTP/1.1" status: 200  len: 1099 time: 0.0716739
May 20 04:36:44.997015 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1aa6244-e903-4b5b-8af3-061649708995 req-4c2fb6ad-3a62-4252-8dc8-cedd82be99ee service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:36:44.998496 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-b1aa6244-e903-4b5b-8af3-061649708995 req-4c2fb6ad-3a62-4252-8dc8-cedd82be99ee service neutron] 10.222.0.82 "GET /v2.0/networks?id=11c994a8-6ede-4290-84f0-71af466860db HTTP/1.1" status: 200  len: 912 time: 0.1375158
May 20 04:36:45.104045 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-b1aa6244-e903-4b5b-8af3-061649708995 req-5ec73acd-1564-49ce-ac1f-77154be83fe7 service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=b1bae5dc-7bbe-4c23-b60b-26cf817da0ee HTTP/1.1" status: 200  len: 217 time: 0.0968080
May 20 04:36:45.172041 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-6ac0ecfe-0bcc-440a-9bcb-b2f585197bde None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced17c6640>, [{'id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'name': 'tempest-TestVolumeBootPattern-857163320-router', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.91'}], 'enable_snat': True}, 'gw_port_id': '866cc6c0-5986-4eb4-8827-b255811a13de', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:28:09Z', 'updated_at': '2021-05-20T04:28:12Z', 'revision_number': 4, 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'gw_port': {'id': '866cc6c0-5986-4eb4-8827-b255811a13de', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:f5:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'device_owner': 'network:router_gateway', 'standard_attr_id': 511, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:28:09Z', 'updated_at': '2021-05-20T04:28:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_interfaces': [{'id': '0bcb5c14-319d-4871-bef1-50d60ad3f5b8', 'name': '', 'network_id': '11c994a8-6ede-4290-84f0-71af466860db', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'mac_address': 'fa:16:3e:2c:84:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'device_owner': 'network:router_interface', 'standard_attr_id': 512, 'fixed_ips': [{'subnet_id': '51af45f1-449a-400c-8714-8d713d4a7993', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:28:12Z', 'updated_at': '2021-05-20T04:28:19Z', 'revision_number': 5, 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'subnets': [{'id': '51af45f1-449a-400c-8714-8d713d4a7993', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:36:45.176141 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ac0ecfe-0bcc-440a-9bcb-b2f585197bde None None] Checking router: a7f66c4d-6b4f-4053-bd69-e1bea7db4c61 for host: dv-cinder-790910-4-iscsi {{(pid=91689) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 04:36:45.185475 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1aa6244-e903-4b5b-8af3-061649708995 req-d1282877-3a10-4535-a63b-597fcfcc8d2a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:36:45.185692 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6ac0ecfe-0bcc-440a-9bcb-b2f585197bde None None] Routers {'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91689) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:36:45.186102 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-6ac0ecfe-0bcc-440a-9bcb-b2f585197bde None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced17c6640>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:36:33Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['a7f66c4d-6b4f-4053-bd69-e1bea7db4c61'], 'active': True} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:36:45.186903 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-b1aa6244-e903-4b5b-8af3-061649708995 req-d1282877-3a10-4535-a63b-597fcfcc8d2a service neutron] 10.222.0.82 "GET /v2.0/subnets?id=51af45f1-449a-400c-8714-8d713d4a7993 HTTP/1.1" status: 200  len: 850 time: 0.0746307
May 20 04:36:45.203625 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba1849e9-9139-4f0c-b965-dc424c99d645 req-99267e08-540f-445d-9d11-a4ded282f965 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:36:45.204296 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-ba1849e9-9139-4f0c-b965-dc424c99d645 req-99267e08-540f-445d-9d11-a4ded282f965 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Synchronizing usage tracker for tenant:9b6fb271a7a546a38b0c6df5beaf22fc on resource:port {{(pid=91687) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:36:45.262817 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-ba1849e9-9139-4f0c-b965-dc424c99d645 req-99267e08-540f-445d-9d11-a4ded282f965 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Unset dirty status for tenant:9b6fb271a7a546a38b0c6df5beaf22fc on resource:port {{(pid=91687) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:36:45.263886 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-ba1849e9-9139-4f0c-b965-dc424c99d645 req-99267e08-540f-445d-9d11-a4ded282f965 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/ports?device_id=de26e049-9f19-44e7-93d5-64ccd77cb9de HTTP/1.1" status: 200  len: 946 time: 0.2060833
May 20 04:36:45.316818 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-ba1849e9-9139-4f0c-b965-dc424c99d645 req-051806ea-68d1-4b1d-bd30-53ca753f4925 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/security-groups?id=ef28d688-789b-4282-a30c-d7d731615fbf&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0463488
May 20 04:36:45.318963 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1aa6244-e903-4b5b-8af3-061649708995 req-56048571-4a0d-4a5f-80ed-e88f3b33dd41 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:36:45.320370 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-b1aa6244-e903-4b5b-8af3-061649708995 req-56048571-4a0d-4a5f-80ed-e88f3b33dd41 service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=11c994a8-6ede-4290-84f0-71af466860db&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1247163
May 20 04:36:45.364397 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvr_db [None req-6ac0ecfe-0bcc-440a-9bcb-b2f585197bde None None] Set router a7f66c4d-6b4f-4053-bd69-e1bea7db4c61 gateway port host: dv-cinder-790910-4-iscsi {{(pid=91689) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:36:45.452899 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-b1aa6244-e903-4b5b-8af3-061649708995 req-ff42414c-7f82-4f93-a0e6-6689ea684f46 service neutron] 10.222.0.82 "GET /v2.0/networks/11c994a8-6ede-4290-84f0-71af466860db?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1246831
May 20 04:36:45.587072 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-b1aa6244-e903-4b5b-8af3-061649708995 req-05e56a90-c3a2-4e0c-87e6-d0d5e40ddb8a service neutron] 10.222.0.82 "GET /v2.0/networks/11c994a8-6ede-4290-84f0-71af466860db?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1266847
May 20 04:36:45.703838 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-6ac0ecfe-0bcc-440a-9bcb-b2f585197bde None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced17c6640>, [{'id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'name': 'tempest-TestVolumeBootPattern-857163320-router', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.91'}], 'enable_snat': True}, 'gw_port_id': '866cc6c0-5986-4eb4-8827-b255811a13de', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:28:09Z', 'updated_at': '2021-05-20T04:28:12Z', 'revision_number': 4, 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'gw_port': {'id': '866cc6c0-5986-4eb4-8827-b255811a13de', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:f5:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'device_owner': 'network:router_gateway', 'standard_attr_id': 511, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:28:09Z', 'updated_at': '2021-05-20T04:28:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_interfaces': [{'id': '0bcb5c14-319d-4871-bef1-50d60ad3f5b8', 'name': '', 'network_id': '11c994a8-6ede-4290-84f0-71af466860db', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'mac_address': 'fa:16:3e:2c:84:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'device_owner': 'network:router_interface', 'standard_attr_id': 512, 'fixed_ips': [{'subnet_id': '51af45f1-449a-400c-8714-8d713d4a7993', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:28:12Z', 'updated_at': '2021-05-20T04:28:19Z', 'revision_number': 5, 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'subnets': [{'id': '51af45f1-449a-400c-8714-8d713d4a7993', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:36:45.708420 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ac0ecfe-0bcc-440a-9bcb-b2f585197bde None None] The sync data for ids ['a7f66c4d-6b4f-4053-bd69-e1bea7db4c61'] in dv-cinder-790910-4-iscsi is: [{'id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'name': 'tempest-TestVolumeBootPattern-857163320-router', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.91'}], 'enable_snat': True}, 'gw_port_id': '866cc6c0-5986-4eb4-8827-b255811a13de', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:28:09Z', 'updated_at': '2021-05-20T04:28:12Z', 'revision_number': 4, 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'gw_port': {'id': '866cc6c0-5986-4eb4-8827-b255811a13de', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:f5:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'device_owner': 'network:router_gateway', 'standard_attr_id': 511, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:28:09Z', 'updated_at': '2021-05-20T04:28:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_interfaces': [{'id': '0bcb5c14-319d-4871-bef1-50d60ad3f5b8', 'name': '', 'network_id': '11c994a8-6ede-4290-84f0-71af466860db', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'mac_address': 'fa:16:3e:2c:84:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'device_owner': 'network:router_interface', 'standard_attr_id': 512, 'fixed_ips': [{'subnet_id': '51af45f1-449a-400c-8714-8d713d4a7993', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:28:12Z', 'updated_at': '2021-05-20T04:28:19Z', 'revision_number': 5, 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'subnets': [{'id': '51af45f1-449a-400c-8714-8d713d4a7993', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91689) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 04:36:45.929901 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7f0f273a-2100-4543-a523-d926b0637d5c None None] New status for floating IP 3e823655-ee96-49c4-9d83-df544348d4cf: DOWN {{(pid=91688) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 20 04:36:46.525690 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cea584d2-3c4f-45b6-b127-7ca605d8086e req-13a7bfc3-c1ec-4893-9938-4ae857f0bb62 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:36:46.526342 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [req-cea584d2-3c4f-45b6-b127-7ca605d8086e req-13a7bfc3-c1ec-4893-9938-4ae857f0bb62 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Synchronizing usage tracker for tenant:9b6fb271a7a546a38b0c6df5beaf22fc on resource:port {{(pid=91686) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:36:46.538318 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [req-cea584d2-3c4f-45b6-b127-7ca605d8086e req-13a7bfc3-c1ec-4893-9938-4ae857f0bb62 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Unset dirty status for tenant:9b6fb271a7a546a38b0c6df5beaf22fc on resource:port {{(pid=91686) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:36:46.539446 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-cea584d2-3c4f-45b6-b127-7ca605d8086e req-13a7bfc3-c1ec-4893-9938-4ae857f0bb62 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/ports?device_id=de26e049-9f19-44e7-93d5-64ccd77cb9de HTTP/1.1" status: 200  len: 946 time: 0.1098781
May 20 04:36:46.590880 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-cea584d2-3c4f-45b6-b127-7ca605d8086e req-88a2141e-d9bf-4526-8aca-18034058d66f tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/security-groups?id=ef28d688-789b-4282-a30c-d7d731615fbf&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0455863
May 20 04:36:46.667896 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-204ad3da-d8dd-4048-8856-036d92d16422 req-2c84a79d-ea1e-4ef1-afb4-0dcf4012b190 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:36:46.669336 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-204ad3da-d8dd-4048-8856-036d92d16422 req-2c84a79d-ea1e-4ef1-afb4-0dcf4012b190 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.82 "GET /v2.0/ports?device_id=de26e049-9f19-44e7-93d5-64ccd77cb9de HTTP/1.1" status: 200  len: 946 time: 0.0822515
May 20 04:36:46.812482 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [req-204ad3da-d8dd-4048-8856-036d92d16422 req-c5e37103-6abc-49a5-b667-3c248d36a6dd tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Deleting port b1bae5dc-7bbe-4c23-b60b-26cf817da0ee {{(pid=91687) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 04:36:46.812807 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-204ad3da-d8dd-4048-8856-036d92d16422 req-c5e37103-6abc-49a5-b667-3c248d36a6dd tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8782892520551'] for port, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:46.946717 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [req-204ad3da-d8dd-4048-8856-036d92d16422 req-c5e37103-6abc-49a5-b667-3c248d36a6dd tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] For port b1bae5dc-7bbe-4c23-b60b-26cf817da0ee, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=b1bae5dc-7bbe-4c23-b60b-26cf817da0ee,segment=NetworkSegment(e9f32492-7a41-4dc9-bc94-b8bce4a8e65d),segment_id=e9f32492-7a41-4dc9-bc94-b8bce4a8e65d)] {{(pid=91687) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:36:46.947079 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-204ad3da-d8dd-4048-8856-036d92d16422 req-c5e37103-6abc-49a5-b667-3c248d36a6dd tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1718922'] for port, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:47.172295 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [req-204ad3da-d8dd-4048-8856-036d92d16422 req-c5e37103-6abc-49a5-b667-3c248d36a6dd tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Calling delete_port for b1bae5dc-7bbe-4c23-b60b-26cf817da0ee owned by compute:nova {{(pid=91687) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 04:36:47.292751 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-204ad3da-d8dd-4048-8856-036d92d16422 req-c5e37103-6abc-49a5-b667-3c248d36a6dd tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8782892522936', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8782892108804', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4162192'] for port, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:47.298590 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-715bd72c-17ef-47f0-8718-fa2039087606 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:36:47.345595 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5e37103-6abc-49a5-b667-3c248d36a6dd tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Pushing event deleted for resources: {'Port': ['ID=b1bae5dc-7bbe-4c23-b60b-26cf817da0ee,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:36:47.348906 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-c5e37103-6abc-49a5-b667-3c248d36a6dd tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:36:47.420544 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.l3_dvrscheduler_db [req-204ad3da-d8dd-4048-8856-036d92d16422 req-c5e37103-6abc-49a5-b667-3c248d36a6dd tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] No DVR routers for this DVR port b1bae5dc-7bbe-4c23-b60b-26cf817da0ee on host hv-cinder-79091 {{(pid=91687) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 04:36:47.423524 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-204ad3da-d8dd-4048-8856-036d92d16422 req-c5e37103-6abc-49a5-b667-3c248d36a6dd tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for port, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:47.427454 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'de26e049-9f19-44e7-93d5-64ccd77cb9de', 'name': 'network-vif-deleted', 'tag': 'b1bae5dc-7bbe-4c23-b60b-26cf817da0ee'}] {{(pid=91687) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:36:47.443738 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-204ad3da-d8dd-4048-8856-036d92d16422 req-c5e37103-6abc-49a5-b667-3c248d36a6dd tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.82 "DELETE /v2.0/ports/b1bae5dc-7bbe-4c23-b60b-26cf817da0ee HTTP/1.1" status: 204  len: 173 time: 0.7666950
May 20 04:36:47.477910 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'de26e049-9f19-44e7-93d5-64ccd77cb9de', 'name': 'network-vif-deleted', 'tag': 'b1bae5dc-7bbe-4c23-b60b-26cf817da0ee', 'status': 'completed', 'code': 200}
May 20 04:36:47.746129 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-710eb0a2-2671-4343-afec-475c295cfeac req-120da6d5-3723-459b-9453-165c6438aee4 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "GET /v2.0/ports?device_id=de26e049-9f19-44e7-93d5-64ccd77cb9de HTTP/1.1" status: 200  len: 210 time: 0.0468013
May 20 04:36:48.851666 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 46828) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:36:49.087663 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [None req-4a443272-6b12-42c9-a97e-130032113524 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Deleting port 811ff955-b742-4cfa-95a2-ecf312186b70 {{(pid=91687) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 04:36:49.087917 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-4a443272-6b12-42c9-a97e-130032113524 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8782892520551'] for port, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:49.213913 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-4a443272-6b12-42c9-a97e-130032113524 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1718922'] for port, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:49.214202 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-4a443272-6b12-42c9-a97e-130032113524 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:49.338229 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [None req-4a443272-6b12-42c9-a97e-130032113524 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Calling delete_port for 811ff955-b742-4cfa-95a2-ecf312186b70 owned by network:floatingip {{(pid=91687) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 04:36:49.459679 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-4a443272-6b12-42c9-a97e-130032113524 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8782892522936', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8782892108804', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4162192'] for port, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:49.464173 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-7d91dbea-3e0a-4d97-8ab8-63f028e45104 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:36:49.506379 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a443272-6b12-42c9-a97e-130032113524 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Pushing event deleted for resources: {'Port': ['ID=811ff955-b742-4cfa-95a2-ecf312186b70,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:36:49.534351 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-4a443272-6b12-42c9-a97e-130032113524 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:36:49.596897 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-4a443272-6b12-42c9-a97e-130032113524 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks [] for floatingip, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:49.610912 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-4a443272-6b12-42c9-a97e-130032113524 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for floatingip, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:49.612036 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-4a443272-6b12-42c9-a97e-130032113524 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "DELETE /v2.0/floatingips/b7dc02ef-f6f6-4ccf-a40c-5f698f78e6e5 HTTP/1.1" status: 204  len: 168 time: 0.7593958
May 20 04:36:51.025267 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 46842) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:36:51.107757 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-8a164ec2-a3f4-41dc-93bc-16d8b221a229 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks [] for security_group, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:51.139074 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-8a164ec2-a3f4-41dc-93bc-16d8b221a229 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks [] for security_group, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:51.219892 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-8a164ec2-a3f4-41dc-93bc-16d8b221a229 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:51.223845 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-dbf84c16-491c-4317-815d-6e562f756150 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:36:51.238306 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a164ec2-a3f4-41dc-93bc-16d8b221a229 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=ef28d688-789b-4282-a30c-d7d731615fbf,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:36:51.240918 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-8a164ec2-a3f4-41dc-93bc-16d8b221a229 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:36:51.253548 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-8a164ec2-a3f4-41dc-93bc-16d8b221a229 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Notify callbacks [] for security_group, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:51.254708 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-8a164ec2-a3f4-41dc-93bc-16d8b221a229 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] 10.222.0.71 "DELETE /v2.0/security-groups/ef28d688-789b-4282-a30c-d7d731615fbf HTTP/1.1" status: 204  len: 168 time: 0.2284610
May 20 04:36:51.323269 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 46848) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:36:51.460307 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device b1bae5dc-7bbe-4c23-b60b-26cf817da0ee no longer exists at agent hyperv_hv-cinder-79091 {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 04:36:51.494551 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] No Port match for: b1bae5dc-7bbe-4c23-b60b-26cf817da0ee {{(pid=91688) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 04:36:51.494869 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device b1bae5dc-7bbe-4c23-b60b-26cf817da0ee not bound to the agent host hv-cinder-79091 {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 04:36:52.054788 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-3753049e-d06b-4433-af12-bc6ae6cc5ef2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1716300'] for router_interface, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:52.482218 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [None req-3753049e-d06b-4433-af12-bc6ae6cc5ef2 admin admin] Deleting port 0bcb5c14-319d-4871-bef1-50d60ad3f5b8 {{(pid=91687) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 04:36:52.482565 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-3753049e-d06b-4433-af12-bc6ae6cc5ef2 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8782892520551'] for port, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:52.606925 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [None req-3753049e-d06b-4433-af12-bc6ae6cc5ef2 admin admin] For port 0bcb5c14-319d-4871-bef1-50d60ad3f5b8, host dv-cinder-790910-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=0bcb5c14-319d-4871-bef1-50d60ad3f5b8,segment=NetworkSegment(e9f32492-7a41-4dc9-bc94-b8bce4a8e65d),segment_id=e9f32492-7a41-4dc9-bc94-b8bce4a8e65d)] {{(pid=91687) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:36:52.607246 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-3753049e-d06b-4433-af12-bc6ae6cc5ef2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1718922'] for port, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:52.730012 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [None req-3753049e-d06b-4433-af12-bc6ae6cc5ef2 admin admin] Calling delete_port for 0bcb5c14-319d-4871-bef1-50d60ad3f5b8 owned by network:router_interface {{(pid=91687) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 04:36:52.983126 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-3753049e-d06b-4433-af12-bc6ae6cc5ef2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8782892522936', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8782892108804', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4162192'] for port, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:52.986848 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-246ff940-c941-4029-b89c-00e3e5568c6a service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:36:53.032041 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3753049e-d06b-4433-af12-bc6ae6cc5ef2 admin admin] Pushing event deleted for resources: {'Port': ['ID=0bcb5c14-319d-4871-bef1-50d60ad3f5b8,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:36:53.035119 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-3753049e-d06b-4433-af12-bc6ae6cc5ef2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:36:53.297951 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-3753049e-d06b-4433-af12-bc6ae6cc5ef2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1781439', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1717212'] for router_interface, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:53.766012 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3753049e-d06b-4433-af12-bc6ae6cc5ef2 admin admin] Router a7f66c4d-6b4f-4053-bd69-e1bea7db4c61 has already been hosted by L3 agent 02733fc0-fc9c-4e29-bc03-c27a792d539d {{(pid=91687) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 04:36:53.951761 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3753049e-d06b-4433-af12-bc6ae6cc5ef2 admin admin] Notify agent at l3_agent.dv-cinder-790910-4-iscsi the message routers_updated {{(pid=91687) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 04:36:53.957555 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.agents_db [None req-92d61f12-17bc-4bf9-9eab-8a69b8c6da2f None None] Agent healthcheck: found 6 active agents {{(pid=91689) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 04:36:53.961738 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5e1b0fb1-a70a-4a97-b787-775612bba125 None None] Sync routers for ids ['a7f66c4d-6b4f-4053-bd69-e1bea7db4c61'] in dv-cinder-790910-4-iscsi {{(pid=91689) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 04:36:53.965666 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-3753049e-d06b-4433-af12-bc6ae6cc5ef2 admin admin] 10.222.0.71 "PUT /v2.0/routers/a7f66c4d-6b4f-4053-bd69-e1bea7db4c61/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.6412516
May 20 04:36:53.968268 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 46854) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:36:53.971870 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5e1b0fb1-a70a-4a97-b787-775612bba125 None None] Routers {'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91689) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:36:53.972478 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-5e1b0fb1-a70a-4a97-b787-775612bba125 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced24955b0>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:36:33Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['a7f66c4d-6b4f-4053-bd69-e1bea7db4c61'], 'active': True} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:36:54.143439 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-dcd237e5-0c5c-4b79-8f19-c43e10b94be1 admin admin] Notify callbacks [] for router, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:54.148296 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvr_db [None req-5e1b0fb1-a70a-4a97-b787-775612bba125 None None] Set router a7f66c4d-6b4f-4053-bd69-e1bea7db4c61 gateway port host: dv-cinder-790910-4-iscsi {{(pid=91689) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:36:54.322326 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-dcd237e5-0c5c-4b79-8f19-c43e10b94be1 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:54.395362 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [None req-dcd237e5-0c5c-4b79-8f19-c43e10b94be1 admin admin] Deleting port 866cc6c0-5986-4eb4-8827-b255811a13de {{(pid=91687) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 04:36:54.395665 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-dcd237e5-0c5c-4b79-8f19-c43e10b94be1 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8782892520551'] for port, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:54.433154 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-5e1b0fb1-a70a-4a97-b787-775612bba125 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced24955b0>, [{'id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'name': 'tempest-TestVolumeBootPattern-857163320-router', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.91'}], 'enable_snat': True}, 'gw_port_id': '866cc6c0-5986-4eb4-8827-b255811a13de', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:28:09Z', 'updated_at': '2021-05-20T04:36:52Z', 'revision_number': 5, 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'gw_port': {'id': '866cc6c0-5986-4eb4-8827-b255811a13de', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:f5:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'device_owner': 'network:router_gateway', 'standard_attr_id': 511, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:28:09Z', 'updated_at': '2021-05-20T04:28:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi'}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:36:54.437396 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5e1b0fb1-a70a-4a97-b787-775612bba125 None None] Checking router: a7f66c4d-6b4f-4053-bd69-e1bea7db4c61 for host: dv-cinder-790910-4-iscsi {{(pid=91689) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 04:36:54.446376 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5e1b0fb1-a70a-4a97-b787-775612bba125 None None] Routers {'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91689) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:36:54.446984 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-5e1b0fb1-a70a-4a97-b787-775612bba125 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced24955b0>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:36:33Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['a7f66c4d-6b4f-4053-bd69-e1bea7db4c61'], 'active': True} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:36:54.518363 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [None req-dcd237e5-0c5c-4b79-8f19-c43e10b94be1 admin admin] For port 866cc6c0-5986-4eb4-8827-b255811a13de, host dv-cinder-790910-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=866cc6c0-5986-4eb4-8827-b255811a13de,segment=NetworkSegment(8df49ec5-3fb9-4715-bc9a-f4019a6b55f9),segment_id=8df49ec5-3fb9-4715-bc9a-f4019a6b55f9)] {{(pid=91687) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:36:54.518691 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-dcd237e5-0c5c-4b79-8f19-c43e10b94be1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1718922'] for port, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:54.591584 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvr_db [None req-5e1b0fb1-a70a-4a97-b787-775612bba125 None None] Set router a7f66c4d-6b4f-4053-bd69-e1bea7db4c61 gateway port host: None {{(pid=91689) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:36:54.639950 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [None req-dcd237e5-0c5c-4b79-8f19-c43e10b94be1 admin admin] Calling delete_port for 866cc6c0-5986-4eb4-8827-b255811a13de owned by network:router_gateway {{(pid=91687) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 04:36:54.692784 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-5e1b0fb1-a70a-4a97-b787-775612bba125 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced24955b0>, [{'id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'name': 'tempest-TestVolumeBootPattern-857163320-router', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:28:09Z', 'updated_at': '2021-05-20T04:36:54Z', 'revision_number': 6, 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'gw_port_host': None}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:36:54.697139 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5e1b0fb1-a70a-4a97-b787-775612bba125 None None] The sync data for ids ['a7f66c4d-6b4f-4053-bd69-e1bea7db4c61'] in dv-cinder-790910-4-iscsi is: [{'id': 'a7f66c4d-6b4f-4053-bd69-e1bea7db4c61', 'name': 'tempest-TestVolumeBootPattern-857163320-router', 'tenant_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:28:09Z', 'updated_at': '2021-05-20T04:36:54Z', 'revision_number': 6, 'project_id': '9b6fb271a7a546a38b0c6df5beaf22fc', 'gw_port_host': None}] {{(pid=91689) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 04:36:54.900117 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-dcd237e5-0c5c-4b79-8f19-c43e10b94be1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8782892522936', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8782892108804', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4162192'] for port, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:54.904096 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-c5e37103-6abc-49a5-b667-3c248d36a6dd tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:36:54.945225 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dcd237e5-0c5c-4b79-8f19-c43e10b94be1 admin admin] Pushing event deleted for resources: {'Port': ['ID=866cc6c0-5986-4eb4-8827-b255811a13de,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:36:54.948112 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-dcd237e5-0c5c-4b79-8f19-c43e10b94be1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:36:55.042150 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-dcd237e5-0c5c-4b79-8f19-c43e10b94be1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1714023'] for router_gateway, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:55.214604 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-dcd237e5-0c5c-4b79-8f19-c43e10b94be1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1796572', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-6237'] for router, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:55.216940 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-dcd237e5-0c5c-4b79-8f19-c43e10b94be1 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:55.242763 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-dcd237e5-0c5c-4b79-8f19-c43e10b94be1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-1712688'] for router, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:55.243293 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dcd237e5-0c5c-4b79-8f19-c43e10b94be1 admin admin] Fanout notify agent at l3_agent the message router_deleted on router a7f66c4d-6b4f-4053-bd69-e1bea7db4c61 {{(pid=91687) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 20 04:36:55.255505 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-dcd237e5-0c5c-4b79-8f19-c43e10b94be1 admin admin] Notify callbacks [] for router, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:55.256727 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-dcd237e5-0c5c-4b79-8f19-c43e10b94be1 admin admin] 10.222.0.71 "DELETE /v2.0/routers/a7f66c4d-6b4f-4053-bd69-e1bea7db4c61 HTTP/1.1" status: 204  len: 168 time: 1.2875609
May 20 04:36:55.259554 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 46858) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:36:55.326071 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.db_base_plugin_v2 [None req-69b31132-68c9-47fe-acaa-941a781be1e4 admin admin] Deleting subnet 51af45f1-449a-400c-8714-8d713d4a7993 {{(pid=91686) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 20 04:36:55.329061 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-69b31132-68c9-47fe-acaa-941a781be1e4 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:55.377844 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-69b31132-68c9-47fe-acaa-941a781be1e4 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4081462'] for subnet, precommit_delete_associations {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:55.460027 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 0bcb5c14-319d-4871-bef1-50d60ad3f5b8 no longer exists at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 04:36:55.461522 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-69b31132-68c9-47fe-acaa-941a781be1e4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1504133'] for subnet, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:55.493902 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] No Port match for: 0bcb5c14-319d-4871-bef1-50d60ad3f5b8 {{(pid=91688) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 04:36:55.494281 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 0bcb5c14-319d-4871-bef1-50d60ad3f5b8 not bound to the agent host dv-cinder-790910-4-iscsi {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 04:36:55.494666 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 866cc6c0-5986-4eb4-8827-b255811a13de no longer exists at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 04:36:55.530894 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] No Port match for: 866cc6c0-5986-4eb4-8827-b255811a13de {{(pid=91688) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 04:36:55.531241 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 866cc6c0-5986-4eb4-8827-b255811a13de not bound to the agent host dv-cinder-790910-4-iscsi {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 04:36:55.845386 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-69b31132-68c9-47fe-acaa-941a781be1e4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1504178', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-255887', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2114755', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2442237'] for subnet, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:55.850647 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:36:55.884929 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69b31132-68c9-47fe-acaa-941a781be1e4 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=51af45f1-449a-400c-8714-8d713d4a7993,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:36:55.888893 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-69b31132-68c9-47fe-acaa-941a781be1e4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:36:55.890318 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-69b31132-68c9-47fe-acaa-941a781be1e4 admin admin] Notify callbacks [] for subnet, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:55.895656 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-00d5d34f-7ada-4228-b01c-724c9b4ea420 None None] Network 11c994a8-6ede-4290-84f0-71af466860db requested from dv-cinder-790910-4-iscsi {{(pid=91688) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 04:36:55.897161 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-69b31132-68c9-47fe-acaa-941a781be1e4 admin admin] 10.222.0.71 "DELETE /v2.0/subnets/51af45f1-449a-400c-8714-8d713d4a7993 HTTP/1.1" status: 204  len: 168 time: 0.6360624
May 20 04:36:55.900190 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 46864) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:36:56.005369 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-4106871b-3275-457c-8d5d-1558ca83c6b2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-593149'] for network, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:56.089004 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.plugin [None req-4106871b-3275-457c-8d5d-1558ca83c6b2 admin admin] Deleting port 37b494d0-4880-4690-a8dc-f497042f06fd {{(pid=91686) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 04:36:56.089352 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-4106871b-3275-457c-8d5d-1558ca83c6b2 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8782892520551'] for port, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:56.150501 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-84587d87-23bb-4211-8a70-2e7c2a2522b1 None None] DHCP port deletion for 11c994a8-6ede-4290-84f0-71af466860db request from dv-cinder-790910-4-iscsi {{(pid=91688) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
May 20 04:36:56.192877 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.db [None req-4106871b-3275-457c-8d5d-1558ca83c6b2 admin admin] For port 37b494d0-4880-4690-a8dc-f497042f06fd, host dv-cinder-790910-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=37b494d0-4880-4690-a8dc-f497042f06fd,segment=NetworkSegment(e9f32492-7a41-4dc9-bc94-b8bce4a8e65d),segment_id=e9f32492-7a41-4dc9-bc94-b8bce4a8e65d)] {{(pid=91686) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:36:56.193352 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-4106871b-3275-457c-8d5d-1558ca83c6b2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1718922'] for port, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:56.218029 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-84587d87-23bb-4211-8a70-2e7c2a2522b1 None None] Deleting port 37b494d0-4880-4690-a8dc-f497042f06fd {{(pid=91688) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 04:36:56.218396 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-84587d87-23bb-4211-8a70-2e7c2a2522b1 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8782892520551'] for port, before_delete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:56.315666 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.plugin [None req-4106871b-3275-457c-8d5d-1558ca83c6b2 admin admin] Calling delete_port for 37b494d0-4880-4690-a8dc-f497042f06fd owned by network:dhcp {{(pid=91686) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 04:36:56.350456 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-84587d87-23bb-4211-8a70-2e7c2a2522b1 None None] For port 37b494d0-4880-4690-a8dc-f497042f06fd, host dv-cinder-790910-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=37b494d0-4880-4690-a8dc-f497042f06fd,segment=NetworkSegment(e9f32492-7a41-4dc9-bc94-b8bce4a8e65d),segment_id=e9f32492-7a41-4dc9-bc94-b8bce4a8e65d)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:36:56.350830 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-84587d87-23bb-4211-8a70-2e7c2a2522b1 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1718922'] for port, precommit_delete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:56.362534 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-4106871b-3275-457c-8d5d-1558ca83c6b2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8782892522936', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8782892108804', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2145052'] for port, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:56.366416 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-befb7892-ca65-4faf-a074-c726c92170ba admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:36:56.409222 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4106871b-3275-457c-8d5d-1558ca83c6b2 admin admin] Pushing event deleted for resources: {'Port': ['ID=37b494d0-4880-4690-a8dc-f497042f06fd,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:36:56.412257 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-4106871b-3275-457c-8d5d-1558ca83c6b2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:36:56.413047 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4106871b-3275-457c-8d5d-1558ca83c6b2 admin admin] No DVR routers for this DVR port 37b494d0-4880-4690-a8dc-f497042f06fd on host dv-cinder-790910-4-iscsi {{(pid=91686) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 04:36:56.471818 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-84587d87-23bb-4211-8a70-2e7c2a2522b1 None None] Calling delete_port for 37b494d0-4880-4690-a8dc-f497042f06fd owned by network:dhcp {{(pid=91688) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 04:36:56.518045 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-84587d87-23bb-4211-8a70-2e7c2a2522b1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8782892522936', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8782892108804'] for port, after_delete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:56.521661 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-92a2fbaf-428e-48e5-811e-b468a13b926c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:36:56.524618 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-4106871b-3275-457c-8d5d-1558ca83c6b2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1505550', 'neutron.services.segments.db._delete_segments_for_network-8782892550274'] for network, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:56.541672 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.services.segments.db [None req-4106871b-3275-457c-8d5d-1558ca83c6b2 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fced07a3340>,) {'filters': {'network_id': ['11c994a8-6ede-4290-84f0-71af466860db']}} {{(pid=91686) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:36:56.553845 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.services.segments.db [None req-4106871b-3275-457c-8d5d-1558ca83c6b2 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fced07a3340>, 'e9f32492-7a41-4dc9-bc94-b8bce4a8e65d') {'for_net_delete': True} {{(pid=91686) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:36:56.554145 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.services.segments.db [None req-4106871b-3275-457c-8d5d-1558ca83c6b2 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fced07a3340>, 'e9f32492-7a41-4dc9-bc94-b8bce4a8e65d') {} {{(pid=91686) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:36:56.562154 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84587d87-23bb-4211-8a70-2e7c2a2522b1 None None] Pushing event deleted for resources: {'Port': ['ID=37b494d0-4880-4690-a8dc-f497042f06fd,revision_number=None']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:36:56.565696 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-4106871b-3275-457c-8d5d-1558ca83c6b2 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8782892560523', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4081441'] for segment, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:56.571537 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84587d87-23bb-4211-8a70-2e7c2a2522b1 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:36:56.571876 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84587d87-23bb-4211-8a70-2e7c2a2522b1 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:36:56.572210 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84587d87-23bb-4211-8a70-2e7c2a2522b1 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:36:56.572565 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84587d87-23bb-4211-8a70-2e7c2a2522b1 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:36:56.572886 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84587d87-23bb-4211-8a70-2e7c2a2522b1 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:36:56.573193 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84587d87-23bb-4211-8a70-2e7c2a2522b1 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:36:56.573544 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84587d87-23bb-4211-8a70-2e7c2a2522b1 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:36:56.573859 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84587d87-23bb-4211-8a70-2e7c2a2522b1 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:36:56.574150 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84587d87-23bb-4211-8a70-2e7c2a2522b1 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:36:56.574486 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84587d87-23bb-4211-8a70-2e7c2a2522b1 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:36:56.574799 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84587d87-23bb-4211-8a70-2e7c2a2522b1 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:36:56.575075 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84587d87-23bb-4211-8a70-2e7c2a2522b1 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:36:56.577837 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-84587d87-23bb-4211-8a70-2e7c2a2522b1 None None] No DVR routers for this DVR port 37b494d0-4880-4690-a8dc-f497042f06fd on host dv-cinder-790910-4-iscsi {{(pid=91688) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 04:36:56.579188 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-84587d87-23bb-4211-8a70-2e7c2a2522b1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:36:56.587294 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-4106871b-3275-457c-8d5d-1558ca83c6b2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1501910'] for segment, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:56.592063 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4106871b-3275-457c-8d5d-1558ca83c6b2 admin admin] Releasing vlan 874 on physical network physnet1 to pool {{(pid=91686) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 20 04:36:56.592563 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-4106871b-3275-457c-8d5d-1558ca83c6b2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1501910', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2145121'] for segment, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:56.606126 dv-cinder-790910-4-iscsi neutron-server[91686]: Traceback (most recent call last):
May 20 04:36:56.606126 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 20 04:36:56.606126 dv-cinder-790910-4-iscsi neutron-server[91686]:     timer()
May 20 04:36:56.606126 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 20 04:36:56.606126 dv-cinder-790910-4-iscsi neutron-server[91686]:     cb(*args, **kw)
May 20 04:36:56.606126 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 20 04:36:56.606126 dv-cinder-790910-4-iscsi neutron-server[91686]:     return func(*args, **kwargs)
May 20 04:36:56.606126 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 20 04:36:56.606126 dv-cinder-790910-4-iscsi neutron-server[91686]:     self._notify()
May 20 04:36:56.606126 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 20 04:36:56.606126 dv-cinder-790910-4-iscsi neutron-server[91686]:     self.callback(batched_events)
May 20 04:36:56.606126 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 20 04:36:56.606126 dv-cinder-790910-4-iscsi neutron-server[91686]:     event.method(event)
May 20 04:36:56.606126 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 20 04:36:56.606126 dv-cinder-790910-4-iscsi neutron-server[91686]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 20 04:36:56.606126 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 20 04:36:56.606126 dv-cinder-790910-4-iscsi neutron-server[91686]:     aggregate_uuid = self.p_client.list_aggregates(
May 20 04:36:56.606126 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 20 04:36:56.606126 dv-cinder-790910-4-iscsi neutron-server[91686]:     return f(self, *a, **k)
May 20 04:36:56.606126 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 20 04:36:56.606126 dv-cinder-790910-4-iscsi neutron-server[91686]:     return self._get(url).json()
May 20 04:36:56.606126 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 20 04:36:56.606126 dv-cinder-790910-4-iscsi neutron-server[91686]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 20 04:36:56.606126 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 20 04:36:56.606126 dv-cinder-790910-4-iscsi neutron-server[91686]:     return self.request(url, 'GET', **kwargs)
May 20 04:36:56.606126 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 20 04:36:56.606126 dv-cinder-790910-4-iscsi neutron-server[91686]:     base_url = self.get_endpoint(auth, allow=allow,
May 20 04:36:56.606126 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 20 04:36:56.606126 dv-cinder-790910-4-iscsi neutron-server[91686]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 20 04:36:56.606126 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 20 04:36:56.606126 dv-cinder-790910-4-iscsi neutron-server[91686]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 20 04:36:56.606126 dv-cinder-790910-4-iscsi neutron-server[91686]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 20 04:36:56.682615 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-4106871b-3275-457c-8d5d-1558ca83c6b2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1505543', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1590664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1781430', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1713996'] for network, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:56.686658 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:36:56.703195 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-4106871b-3275-457c-8d5d-1558ca83c6b2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for network, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:56.713510 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4106871b-3275-457c-8d5d-1558ca83c6b2 admin admin] Pushing event deleted for resources: {'Network': ['ID=11c994a8-6ede-4290-84f0-71af466860db,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:36:56.716556 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-4106871b-3275-457c-8d5d-1558ca83c6b2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:36:56.728455 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-4106871b-3275-457c-8d5d-1558ca83c6b2 admin admin] 10.222.0.71 "DELETE /v2.0/networks/11c994a8-6ede-4290-84f0-71af466860db HTTP/1.1" status: 204  len: 168 time: 0.8271203
May 20 04:36:56.732058 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 46868) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:36:57.286183 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 37b494d0-4880-4690-a8dc-f497042f06fd no longer exists at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 04:36:57.322988 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] No Port match for: 37b494d0-4880-4690-a8dc-f497042f06fd {{(pid=91688) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 04:36:57.323339 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 37b494d0-4880-4690-a8dc-f497042f06fd not bound to the agent host dv-cinder-790910-4-iscsi {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 04:36:57.409680 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-11eace76-0b16-4a1c-a340-f6834fb11ecf admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1716300'] for router_interface, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:57.822239 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.plugin [None req-11eace76-0b16-4a1c-a340-f6834fb11ecf admin admin] Deleting port 625c64ac-ab07-4497-be90-0c20245577b2 {{(pid=91686) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 04:36:57.822528 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-11eace76-0b16-4a1c-a340-f6834fb11ecf admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8782892520551'] for port, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:57.948312 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.db [None req-11eace76-0b16-4a1c-a340-f6834fb11ecf admin admin] For port 625c64ac-ab07-4497-be90-0c20245577b2, host dv-cinder-790910-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=625c64ac-ab07-4497-be90-0c20245577b2,segment=NetworkSegment(400d6b98-7e80-413b-b776-1d2e09a33a2f),segment_id=400d6b98-7e80-413b-b776-1d2e09a33a2f)] {{(pid=91686) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:36:57.948603 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-11eace76-0b16-4a1c-a340-f6834fb11ecf admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1718922'] for port, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:58.084258 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.plugin [None req-11eace76-0b16-4a1c-a340-f6834fb11ecf admin admin] Calling delete_port for 625c64ac-ab07-4497-be90-0c20245577b2 owned by network:router_interface {{(pid=91686) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 04:36:58.253390 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-11eace76-0b16-4a1c-a340-f6834fb11ecf admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8782892522936', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8782892108804', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2145052'] for port, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:58.259303 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-a04b00de-b3db-46e0-a180-d76321946619 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:36:58.314020 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11eace76-0b16-4a1c-a340-f6834fb11ecf admin admin] Pushing event deleted for resources: {'Port': ['ID=625c64ac-ab07-4497-be90-0c20245577b2,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:36:58.317077 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-11eace76-0b16-4a1c-a340-f6834fb11ecf admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:36:58.581076 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-11eace76-0b16-4a1c-a340-f6834fb11ecf admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1781439', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1717212'] for router_interface, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:59.054257 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-11eace76-0b16-4a1c-a340-f6834fb11ecf admin admin] Router d81a9efa-906c-4032-994a-82447e195ad4 has already been hosted by L3 agent 02733fc0-fc9c-4e29-bc03-c27a792d539d {{(pid=91686) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 04:36:59.240707 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-11eace76-0b16-4a1c-a340-f6834fb11ecf admin admin] Notify agent at l3_agent.dv-cinder-790910-4-iscsi the message routers_updated {{(pid=91686) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 04:36:59.257417 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bca54bad-688e-4e19-963d-5e1f67815006 None None] Sync routers for ids ['d81a9efa-906c-4032-994a-82447e195ad4'] in dv-cinder-790910-4-iscsi {{(pid=91688) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 04:36:59.259144 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-11eace76-0b16-4a1c-a340-f6834fb11ecf admin admin] 10.222.0.71 "PUT /v2.0/routers/d81a9efa-906c-4032-994a-82447e195ad4/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.5259185
May 20 04:36:59.261567 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 46874) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:36:59.269924 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bca54bad-688e-4e19-963d-5e1f67815006 None None] Routers {'d81a9efa-906c-4032-994a-82447e195ad4'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91688) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:36:59.270882 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-bca54bad-688e-4e19-963d-5e1f67815006 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced4322f40>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:36:33Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['d81a9efa-906c-4032-994a-82447e195ad4'], 'active': True} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:36:59.435393 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-46ac02ba-27fb-44f0-bae2-b94446cc53e9 admin admin] Notify callbacks [] for router, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:59.449918 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvr_db [None req-bca54bad-688e-4e19-963d-5e1f67815006 None None] Set router d81a9efa-906c-4032-994a-82447e195ad4 gateway port host: dv-cinder-790910-4-iscsi {{(pid=91688) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:36:59.610253 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-46ac02ba-27fb-44f0-bae2-b94446cc53e9 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:59.682615 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.plugin [None req-46ac02ba-27fb-44f0-bae2-b94446cc53e9 admin admin] Deleting port f752de37-e83f-4b51-b1d4-6eceabcfd969 {{(pid=91686) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 04:36:59.682956 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-46ac02ba-27fb-44f0-bae2-b94446cc53e9 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8782892520551'] for port, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:59.730909 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-bca54bad-688e-4e19-963d-5e1f67815006 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced4322f40>, [{'id': 'd81a9efa-906c-4032-994a-82447e195ad4', 'name': 'tempest-TestVolumeBootPattern-1348979754-router', 'tenant_id': '9cdc6335963a47e384b2530ced2a9b80', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.85'}], 'enable_snat': True}, 'gw_port_id': 'f752de37-e83f-4b51-b1d4-6eceabcfd969', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:28:15Z', 'updated_at': '2021-05-20T04:36:58Z', 'revision_number': 5, 'project_id': '9cdc6335963a47e384b2530ced2a9b80', 'gw_port': {'id': 'f752de37-e83f-4b51-b1d4-6eceabcfd969', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:ce:8c:eb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd81a9efa-906c-4032-994a-82447e195ad4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 523, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.85', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:28:16Z', 'updated_at': '2021-05-20T04:28:23Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi'}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:36:59.735058 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bca54bad-688e-4e19-963d-5e1f67815006 None None] Checking router: d81a9efa-906c-4032-994a-82447e195ad4 for host: dv-cinder-790910-4-iscsi {{(pid=91688) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 04:36:59.743400 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bca54bad-688e-4e19-963d-5e1f67815006 None None] Routers {'d81a9efa-906c-4032-994a-82447e195ad4'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91688) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:36:59.743991 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-bca54bad-688e-4e19-963d-5e1f67815006 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced4322f40>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:36:33Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['d81a9efa-906c-4032-994a-82447e195ad4'], 'active': True} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:36:59.803474 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.db [None req-46ac02ba-27fb-44f0-bae2-b94446cc53e9 admin admin] For port f752de37-e83f-4b51-b1d4-6eceabcfd969, host dv-cinder-790910-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=f752de37-e83f-4b51-b1d4-6eceabcfd969,segment=NetworkSegment(8df49ec5-3fb9-4715-bc9a-f4019a6b55f9),segment_id=8df49ec5-3fb9-4715-bc9a-f4019a6b55f9)] {{(pid=91686) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:36:59.803825 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-46ac02ba-27fb-44f0-bae2-b94446cc53e9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1718922'] for port, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:59.901436 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-009f1eed-4a8b-4de5-96c7-89bc696a853f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:36:59.914394 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvr_db [None req-bca54bad-688e-4e19-963d-5e1f67815006 None None] Set router d81a9efa-906c-4032-994a-82447e195ad4 gateway port host: None {{(pid=91688) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:36:59.928846 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.plugin [None req-46ac02ba-27fb-44f0-bae2-b94446cc53e9 admin admin] Calling delete_port for f752de37-e83f-4b51-b1d4-6eceabcfd969 owned by network:router_gateway {{(pid=91686) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 04:37:00.017586 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_hamode_db [None req-bca54bad-688e-4e19-963d-5e1f67815006 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced4322f40>, [{'id': 'd81a9efa-906c-4032-994a-82447e195ad4', 'name': 'tempest-TestVolumeBootPattern-1348979754-router', 'tenant_id': '9cdc6335963a47e384b2530ced2a9b80', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:28:15Z', 'updated_at': '2021-05-20T04:36:59Z', 'revision_number': 6, 'project_id': '9cdc6335963a47e384b2530ced2a9b80', 'gw_port_host': None}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:37:00.021701 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bca54bad-688e-4e19-963d-5e1f67815006 None None] The sync data for ids ['d81a9efa-906c-4032-994a-82447e195ad4'] in dv-cinder-790910-4-iscsi is: [{'id': 'd81a9efa-906c-4032-994a-82447e195ad4', 'name': 'tempest-TestVolumeBootPattern-1348979754-router', 'tenant_id': '9cdc6335963a47e384b2530ced2a9b80', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:28:15Z', 'updated_at': '2021-05-20T04:36:59Z', 'revision_number': 6, 'project_id': '9cdc6335963a47e384b2530ced2a9b80', 'gw_port_host': None}] {{(pid=91688) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 04:37:00.071126 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-46ac02ba-27fb-44f0-bae2-b94446cc53e9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8782892522936', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8782892108804', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2145052'] for port, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:00.074757 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-4d3acaf5-dad8-492b-9930-5f5922aa88db tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:37:00.119474 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46ac02ba-27fb-44f0-bae2-b94446cc53e9 admin admin] Pushing event deleted for resources: {'Port': ['ID=f752de37-e83f-4b51-b1d4-6eceabcfd969,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:37:00.122528 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-46ac02ba-27fb-44f0-bae2-b94446cc53e9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:37:00.209965 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-46ac02ba-27fb-44f0-bae2-b94446cc53e9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1714023'] for router_gateway, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:00.501728 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-46ac02ba-27fb-44f0-bae2-b94446cc53e9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1796572', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-6237'] for router, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:00.505738 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-46ac02ba-27fb-44f0-bae2-b94446cc53e9 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:00.534126 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-46ac02ba-27fb-44f0-bae2-b94446cc53e9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-1712688'] for router, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:00.534628 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-46ac02ba-27fb-44f0-bae2-b94446cc53e9 admin admin] Fanout notify agent at l3_agent the message router_deleted on router d81a9efa-906c-4032-994a-82447e195ad4 {{(pid=91686) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 20 04:37:00.546902 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-46ac02ba-27fb-44f0-bae2-b94446cc53e9 admin admin] Notify callbacks [] for router, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:00.548024 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-46ac02ba-27fb-44f0-bae2-b94446cc53e9 admin admin] 10.222.0.71 "DELETE /v2.0/routers/d81a9efa-906c-4032-994a-82447e195ad4 HTTP/1.1" status: 204  len: 168 time: 1.2855127
May 20 04:37:00.550565 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 46878) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:37:00.611089 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.db_base_plugin_v2 [None req-f84e46e6-0516-464d-90ce-71c561a10d28 admin admin] Deleting subnet b84834e7-a1f8-44f0-aa94-dda7f575d2e7 {{(pid=91686) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 20 04:37:00.614217 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-f84e46e6-0516-464d-90ce-71c561a10d28 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:00.663727 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-f84e46e6-0516-464d-90ce-71c561a10d28 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4081462'] for subnet, precommit_delete_associations {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:00.742526 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-f84e46e6-0516-464d-90ce-71c561a10d28 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1504133'] for subnet, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:00.997049 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-f84e46e6-0516-464d-90ce-71c561a10d28 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1504178', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-255887', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2114755', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2442237'] for subnet, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:01.001209 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:37:01.041026 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f84e46e6-0516-464d-90ce-71c561a10d28 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=b84834e7-a1f8-44f0-aa94-dda7f575d2e7,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:37:01.044031 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-f84e46e6-0516-464d-90ce-71c561a10d28 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:37:01.045095 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-f84e46e6-0516-464d-90ce-71c561a10d28 admin admin] Notify callbacks [] for subnet, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:01.049805 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f9dec4ea-2e11-4fa3-a398-0ee3812cac4a None None] Network 797bc43b-d3f0-4cce-ab72-4d9b7d99a5cc requested from dv-cinder-790910-4-iscsi {{(pid=91688) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 04:37:01.050795 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-f84e46e6-0516-464d-90ce-71c561a10d28 admin admin] 10.222.0.71 "DELETE /v2.0/subnets/b84834e7-a1f8-44f0-aa94-dda7f575d2e7 HTTP/1.1" status: 204  len: 168 time: 0.4993153
May 20 04:37:01.053295 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 46882) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:37:01.157861 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-a5571126-96e7-46c4-828d-11ebf69f2da4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-593149'] for network, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:01.235319 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.plugin [None req-a5571126-96e7-46c4-828d-11ebf69f2da4 admin admin] Deleting port 969bcd0d-d995-4cb6-b639-71f740b78b63 {{(pid=91686) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 04:37:01.235728 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-a5571126-96e7-46c4-828d-11ebf69f2da4 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8782892520551'] for port, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:01.296118 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device f752de37-e83f-4b51-b1d4-6eceabcfd969 no longer exists at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 04:37:01.331620 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] No Port match for: f752de37-e83f-4b51-b1d4-6eceabcfd969 {{(pid=91688) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 04:37:01.331962 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device f752de37-e83f-4b51-b1d4-6eceabcfd969 not bound to the agent host dv-cinder-790910-4-iscsi {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 04:37:01.332382 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 625c64ac-ab07-4497-be90-0c20245577b2 no longer exists at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 04:37:01.342220 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.db [None req-a5571126-96e7-46c4-828d-11ebf69f2da4 admin admin] For port 969bcd0d-d995-4cb6-b639-71f740b78b63, host dv-cinder-790910-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=969bcd0d-d995-4cb6-b639-71f740b78b63,segment=NetworkSegment(400d6b98-7e80-413b-b776-1d2e09a33a2f),segment_id=400d6b98-7e80-413b-b776-1d2e09a33a2f)] {{(pid=91686) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:37:01.342579 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-a5571126-96e7-46c4-828d-11ebf69f2da4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1718922'] for port, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:01.360520 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-605d84bd-b48d-43fd-bd0a-1933bf3ffdf8 None None] DHCP port deletion for 797bc43b-d3f0-4cce-ab72-4d9b7d99a5cc request from dv-cinder-790910-4-iscsi {{(pid=91688) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
May 20 04:37:01.367923 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] No Port match for: 625c64ac-ab07-4497-be90-0c20245577b2 {{(pid=91688) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 04:37:01.368267 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 625c64ac-ab07-4497-be90-0c20245577b2 not bound to the agent host dv-cinder-790910-4-iscsi {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 04:37:01.428689 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-605d84bd-b48d-43fd-bd0a-1933bf3ffdf8 None None] Deleting port 969bcd0d-d995-4cb6-b639-71f740b78b63 {{(pid=91688) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 04:37:01.429091 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-605d84bd-b48d-43fd-bd0a-1933bf3ffdf8 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8782892520551'] for port, before_delete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:01.464566 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.plugin [None req-a5571126-96e7-46c4-828d-11ebf69f2da4 admin admin] Calling delete_port for 969bcd0d-d995-4cb6-b639-71f740b78b63 owned by network:dhcp {{(pid=91686) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 04:37:01.511967 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-a5571126-96e7-46c4-828d-11ebf69f2da4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8782892522936', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8782892108804', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2145052'] for port, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:01.516791 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-c03d6a14-43d4-4576-834a-3ba191ef8e73 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:37:01.525612 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-605d84bd-b48d-43fd-bd0a-1933bf3ffdf8 None None] For port 969bcd0d-d995-4cb6-b639-71f740b78b63, host dv-cinder-790910-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=969bcd0d-d995-4cb6-b639-71f740b78b63,segment=NetworkSegment(400d6b98-7e80-413b-b776-1d2e09a33a2f),segment_id=400d6b98-7e80-413b-b776-1d2e09a33a2f)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:37:01.525999 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-605d84bd-b48d-43fd-bd0a-1933bf3ffdf8 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1718922'] for port, precommit_delete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:01.563413 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5571126-96e7-46c4-828d-11ebf69f2da4 admin admin] Pushing event deleted for resources: {'Port': ['ID=969bcd0d-d995-4cb6-b639-71f740b78b63,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:37:01.565145 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a5571126-96e7-46c4-828d-11ebf69f2da4 admin admin] No DVR routers for this DVR port 969bcd0d-d995-4cb6-b639-71f740b78b63 on host dv-cinder-790910-4-iscsi {{(pid=91686) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 04:37:01.566616 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-a5571126-96e7-46c4-828d-11ebf69f2da4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:37:01.648014 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-605d84bd-b48d-43fd-bd0a-1933bf3ffdf8 None None] Calling delete_port for 969bcd0d-d995-4cb6-b639-71f740b78b63 owned by network:dhcp {{(pid=91688) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 04:37:01.678392 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-a5571126-96e7-46c4-828d-11ebf69f2da4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1505550', 'neutron.services.segments.db._delete_segments_for_network-8782892550274'] for network, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:01.691325 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.services.segments.db [None req-a5571126-96e7-46c4-828d-11ebf69f2da4 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fced096db20>,) {'filters': {'network_id': ['797bc43b-d3f0-4cce-ab72-4d9b7d99a5cc']}} {{(pid=91686) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:37:01.693445 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-605d84bd-b48d-43fd-bd0a-1933bf3ffdf8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8782892522936', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8782892108804'] for port, after_delete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:01.698203 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:37:01.704091 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.services.segments.db [None req-a5571126-96e7-46c4-828d-11ebf69f2da4 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fced096db20>, '400d6b98-7e80-413b-b776-1d2e09a33a2f') {'for_net_delete': True} {{(pid=91686) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:37:01.704387 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.services.segments.db [None req-a5571126-96e7-46c4-828d-11ebf69f2da4 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fced096db20>, '400d6b98-7e80-413b-b776-1d2e09a33a2f') {} {{(pid=91686) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:37:01.715655 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-a5571126-96e7-46c4-828d-11ebf69f2da4 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8782892560523', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4081441'] for segment, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:01.732125 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-a5571126-96e7-46c4-828d-11ebf69f2da4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1501910'] for segment, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:01.738574 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a5571126-96e7-46c4-828d-11ebf69f2da4 admin admin] Releasing vlan 876 on physical network physnet1 to pool {{(pid=91686) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 20 04:37:01.738953 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-a5571126-96e7-46c4-828d-11ebf69f2da4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1501910', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2145121'] for segment, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:01.741622 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-605d84bd-b48d-43fd-bd0a-1933bf3ffdf8 None None] Pushing event deleted for resources: {'Port': ['ID=969bcd0d-d995-4cb6-b639-71f740b78b63,revision_number=None']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:37:01.744595 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-605d84bd-b48d-43fd-bd0a-1933bf3ffdf8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:37:01.747221 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-605d84bd-b48d-43fd-bd0a-1933bf3ffdf8 None None] No DVR routers for this DVR port 969bcd0d-d995-4cb6-b639-71f740b78b63 on host dv-cinder-790910-4-iscsi {{(pid=91688) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 04:37:01.753977 dv-cinder-790910-4-iscsi neutron-server[91686]: Traceback (most recent call last):
May 20 04:37:01.753977 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 20 04:37:01.753977 dv-cinder-790910-4-iscsi neutron-server[91686]:     timer()
May 20 04:37:01.753977 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 20 04:37:01.753977 dv-cinder-790910-4-iscsi neutron-server[91686]:     cb(*args, **kw)
May 20 04:37:01.753977 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 20 04:37:01.753977 dv-cinder-790910-4-iscsi neutron-server[91686]:     return func(*args, **kwargs)
May 20 04:37:01.753977 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 20 04:37:01.753977 dv-cinder-790910-4-iscsi neutron-server[91686]:     self._notify()
May 20 04:37:01.753977 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 20 04:37:01.753977 dv-cinder-790910-4-iscsi neutron-server[91686]:     self.callback(batched_events)
May 20 04:37:01.753977 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 20 04:37:01.753977 dv-cinder-790910-4-iscsi neutron-server[91686]:     event.method(event)
May 20 04:37:01.753977 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 20 04:37:01.753977 dv-cinder-790910-4-iscsi neutron-server[91686]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 20 04:37:01.753977 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 20 04:37:01.753977 dv-cinder-790910-4-iscsi neutron-server[91686]:     aggregate_uuid = self.p_client.list_aggregates(
May 20 04:37:01.753977 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 20 04:37:01.753977 dv-cinder-790910-4-iscsi neutron-server[91686]:     return f(self, *a, **k)
May 20 04:37:01.753977 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 20 04:37:01.753977 dv-cinder-790910-4-iscsi neutron-server[91686]:     return self._get(url).json()
May 20 04:37:01.753977 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 20 04:37:01.753977 dv-cinder-790910-4-iscsi neutron-server[91686]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 20 04:37:01.753977 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 20 04:37:01.753977 dv-cinder-790910-4-iscsi neutron-server[91686]:     return self.request(url, 'GET', **kwargs)
May 20 04:37:01.753977 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 20 04:37:01.753977 dv-cinder-790910-4-iscsi neutron-server[91686]:     base_url = self.get_endpoint(auth, allow=allow,
May 20 04:37:01.753977 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 20 04:37:01.753977 dv-cinder-790910-4-iscsi neutron-server[91686]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 20 04:37:01.753977 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 20 04:37:01.753977 dv-cinder-790910-4-iscsi neutron-server[91686]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 20 04:37:01.753977 dv-cinder-790910-4-iscsi neutron-server[91686]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 20 04:37:01.944910 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-a5571126-96e7-46c4-828d-11ebf69f2da4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1505543', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1590664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1781430', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1713996'] for network, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:01.950275 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-a5571126-96e7-46c4-828d-11ebf69f2da4 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for network, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:01.953208 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-2a6aab82-6c10-46cd-b87d-ee6eb290e5c4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:37:01.975457 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5571126-96e7-46c4-828d-11ebf69f2da4 admin admin] Pushing event deleted for resources: {'Network': ['ID=797bc43b-d3f0-4cce-ab72-4d9b7d99a5cc,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:37:01.981497 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-a5571126-96e7-46c4-828d-11ebf69f2da4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:37:01.985080 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-a5571126-96e7-46c4-828d-11ebf69f2da4 admin admin] 10.222.0.71 "DELETE /v2.0/networks/797bc43b-d3f0-4cce-ab72-4d9b7d99a5cc HTTP/1.1" status: 204  len: 168 time: 0.9308243
May 20 04:37:02.116432 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 46888) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:37:02.177956 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-fb803196-3e28-4153-8a6e-764ea7e1c8ad admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=9b6fb271a7a546a38b0c6df5beaf22fc&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0598826
May 20 04:37:02.181601 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 46892) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:37:02.245975 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-018d7ff0-1e06-412b-a565-82eec4d82a95 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:02.271707 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-018d7ff0-1e06-412b-a565-82eec4d82a95 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:02.331214 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-018d7ff0-1e06-412b-a565-82eec4d82a95 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:02.336260 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-a846cc65-8062-4569-817c-45ea968db02b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:37:02.348554 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-018d7ff0-1e06-412b-a565-82eec4d82a95 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0ffaeca9-4147-460f-8d53-d50ce54eb13f,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:37:02.351948 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-018d7ff0-1e06-412b-a565-82eec4d82a95 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:37:02.357597 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-018d7ff0-1e06-412b-a565-82eec4d82a95 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:02.358755 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-018d7ff0-1e06-412b-a565-82eec4d82a95 admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/0ffaeca9-4147-460f-8d53-d50ce54eb13f HTTP/1.1" status: 204  len: 168 time: 0.1762481
May 20 04:37:02.579091 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:02.724788 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 46900) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:37:02.744286 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-fb482246-621a-4310-9d8c-7577d0c2c6b2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:02.775459 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-b5d18020-e09c-4413-8417-579cdbad8017 admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=9cdc6335963a47e384b2530ced2a9b80&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0491037
May 20 04:37:02.777870 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 46904) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:37:02.838896 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-7a26edf3-1a66-44d0-8255-6cd53d545830 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:02.872496 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-7a26edf3-1a66-44d0-8255-6cd53d545830 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:02.929968 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-7a26edf3-1a66-44d0-8255-6cd53d545830 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:02.934721 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-b9699f0a-fb67-4e2f-b135-0604944a57cf tempest-TestMinimumBasicScenario-2114949186 tempest-TestMinimumBasicScenario-2114949186-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:37:02.946556 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a26edf3-1a66-44d0-8255-6cd53d545830 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d3c17903-4b75-4277-aa89-339506502cc6,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:37:02.949408 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-7a26edf3-1a66-44d0-8255-6cd53d545830 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:37:02.951317 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-7a26edf3-1a66-44d0-8255-6cd53d545830 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:02.952414 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-7a26edf3-1a66-44d0-8255-6cd53d545830 admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/d3c17903-4b75-4277-aa89-339506502cc6 HTTP/1.1" status: 204  len: 168 time: 0.1736460
May 20 04:37:03.285721 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 969bcd0d-d995-4cb6-b639-71f740b78b63 no longer exists at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 04:37:03.324022 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] No Port match for: 969bcd0d-d995-4cb6-b639-71f740b78b63 {{(pid=91688) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 04:37:03.324323 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 969bcd0d-d995-4cb6-b639-71f740b78b63 not bound to the agent host dv-cinder-790910-4-iscsi {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 04:37:03.398081 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ea4803bd-878f-47d5-9084-1ec41953c9db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:05.248913 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f21320cc-6a25-4ec1-8a32-8b119b35fd55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:05.613789 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [req-abcf9048-ca3f-4af4-9584-4c8a9c929b32 req-8196297f-be19-4bcf-a6b1-f5bd5624fcfa service neutron] (91686) timed out ('10.222.0.82', 55101) {{(pid=91686) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}}
May 20 04:37:06.643771 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:06.741323 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [req-0b697ac5-2d67-4bb4-b49f-4f112fbf3b4b req-f04aa4e7-4814-4f0e-addb-41d170890fe6 service neutron] (91686) timed out ('10.222.0.82', 55115) {{(pid=91686) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}}
May 20 04:37:10.603558 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78441f7d-dbe8-4771-b4c8-efd7832dc0e3 req-d5f6d761-c989-4062-b502-f85979574142 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:37:10.605238 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-78441f7d-dbe8-4771-b4c8-efd7832dc0e3 req-d5f6d761-c989-4062-b502-f85979574142 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/ports?device_id=e9041636-d49b-4bde-b686-3fb6ecbf907a HTTP/1.1" status: 200  len: 945 time: 0.0997145
May 20 04:37:10.652232 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-78441f7d-dbe8-4771-b4c8-efd7832dc0e3 req-e667cf53-f275-4cad-a044-22c2d3c6a458 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/security-groups?id=a91e9b1a-ef38-4317-bbea-c290d296dc7b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0407970
May 20 04:37:11.866060 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48ba161d-4f38-4952-8412-a0c858283759 req-776c7ce5-7431-4d5c-ac9d-c510f473c560 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:37:11.867583 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-48ba161d-4f38-4952-8412-a0c858283759 req-776c7ce5-7431-4d5c-ac9d-c510f473c560 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/ports?device_id=e9041636-d49b-4bde-b686-3fb6ecbf907a HTTP/1.1" status: 200  len: 945 time: 0.0984526
May 20 04:37:11.916564 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-48ba161d-4f38-4952-8412-a0c858283759 req-33843285-bc0d-4a52-85ee-d01f4f908df3 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/security-groups?id=a91e9b1a-ef38-4317-bbea-c290d296dc7b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0414124
May 20 04:37:12.644268 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-023348fc-aaf0-42c9-a5ad-43ff42d56154 req-3b2d61bb-9549-40c4-8e2c-ec79467bcd0d tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:37:12.645722 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-023348fc-aaf0-42c9-a5ad-43ff42d56154 req-3b2d61bb-9549-40c4-8e2c-ec79467bcd0d tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.82 "GET /v2.0/ports?device_id=e9041636-d49b-4bde-b686-3fb6ecbf907a HTTP/1.1" status: 200  len: 945 time: 0.0877337
May 20 04:37:12.789822 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [req-023348fc-aaf0-42c9-a5ad-43ff42d56154 req-5076bd42-0ccc-4be1-934b-0b45bcfe7801 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Deleting port cda24ac9-3c25-4710-85ff-bcd2091b8d14 {{(pid=91687) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 04:37:12.790137 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-023348fc-aaf0-42c9-a5ad-43ff42d56154 req-5076bd42-0ccc-4be1-934b-0b45bcfe7801 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8782892520551'] for port, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:12.935796 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [req-023348fc-aaf0-42c9-a5ad-43ff42d56154 req-5076bd42-0ccc-4be1-934b-0b45bcfe7801 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] For port cda24ac9-3c25-4710-85ff-bcd2091b8d14, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=cda24ac9-3c25-4710-85ff-bcd2091b8d14,segment=NetworkSegment(12af0450-da1a-4552-85ca-9149ff5b7f01),segment_id=12af0450-da1a-4552-85ca-9149ff5b7f01)] {{(pid=91687) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:37:12.936526 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-023348fc-aaf0-42c9-a5ad-43ff42d56154 req-5076bd42-0ccc-4be1-934b-0b45bcfe7801 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1718922'] for port, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:13.111916 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b6e5f4a-8309-4626-830c-c12267fd5ed3 req-95ed947b-22b1-434c-97cd-a0f16cd05960 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:37:13.113456 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-7b6e5f4a-8309-4626-830c-c12267fd5ed3 req-95ed947b-22b1-434c-97cd-a0f16cd05960 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/ports?device_id=e9041636-d49b-4bde-b686-3fb6ecbf907a HTTP/1.1" status: 200  len: 945 time: 0.0863171
May 20 04:37:13.160873 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-7b6e5f4a-8309-4626-830c-c12267fd5ed3 req-ac64b4de-d926-4984-b81f-cc2537a0a277 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/security-groups?id=a91e9b1a-ef38-4317-bbea-c290d296dc7b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0416079
May 20 04:37:13.228669 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-023348fc-aaf0-42c9-a5ad-43ff42d56154 req-5076bd42-0ccc-4be1-934b-0b45bcfe7801 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks [] for floatingip, precommit_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:13.228914 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-023348fc-aaf0-42c9-a5ad-43ff42d56154 req-5076bd42-0ccc-4be1-934b-0b45bcfe7801 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1716406'] for floatingip, after_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:13.229241 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.db.l3_db [req-023348fc-aaf0-42c9-a5ad-43ff42d56154 req-5076bd42-0ccc-4be1-934b-0b45bcfe7801 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Floating IP 11e49eaa-8133-4dc8-926d-cc77d7c124a1 disassociated. External IP: 172.27.1.225, port: cda24ac9-3c25-4710-85ff-bcd2091b8d14.
May 20 04:37:13.229583 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [req-023348fc-aaf0-42c9-a5ad-43ff42d56154 req-5076bd42-0ccc-4be1-934b-0b45bcfe7801 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Calling delete_port for cda24ac9-3c25-4710-85ff-bcd2091b8d14 owned by compute:nova {{(pid=91687) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 04:37:13.355761 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-023348fc-aaf0-42c9-a5ad-43ff42d56154 req-5076bd42-0ccc-4be1-934b-0b45bcfe7801 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8782892522936', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8782892108804', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4162192'] for port, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:13.361453 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-02629ec5-a470-43bb-9233-79f0d711a4fa tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:37:13.407705 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5076bd42-0ccc-4be1-934b-0b45bcfe7801 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Pushing event deleted for resources: {'Port': ['ID=cda24ac9-3c25-4710-85ff-bcd2091b8d14,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:37:13.410702 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-5076bd42-0ccc-4be1-934b-0b45bcfe7801 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:37:13.696163 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.l3_agent_scheduler [req-023348fc-aaf0-42c9-a5ad-43ff42d56154 req-5076bd42-0ccc-4be1-934b-0b45bcfe7801 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Router d4b509ec-ef18-4627-a6cf-1d7baff4e160 has already been hosted by L3 agent 02733fc0-fc9c-4e29-bc03-c27a792d539d {{(pid=91687) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 04:37:13.882810 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-023348fc-aaf0-42c9-a5ad-43ff42d56154 req-5076bd42-0ccc-4be1-934b-0b45bcfe7801 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify agent at l3_agent.dv-cinder-790910-4-iscsi the message routers_updated {{(pid=91687) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 04:37:13.894156 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8a148095-b61f-4b11-9226-c9615692c6e8 None None] Sync routers for ids ['d4b509ec-ef18-4627-a6cf-1d7baff4e160'] in dv-cinder-790910-4-iscsi {{(pid=91689) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 04:37:13.904541 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8a148095-b61f-4b11-9226-c9615692c6e8 None None] Routers {'d4b509ec-ef18-4627-a6cf-1d7baff4e160'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91689) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:37:13.905176 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-8a148095-b61f-4b11-9226-c9615692c6e8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced2495bb0>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:37:03Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['d4b509ec-ef18-4627-a6cf-1d7baff4e160'], 'active': True} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:37:13.959067 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.l3_dvrscheduler_db [req-023348fc-aaf0-42c9-a5ad-43ff42d56154 req-5076bd42-0ccc-4be1-934b-0b45bcfe7801 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] No DVR routers for this DVR port cda24ac9-3c25-4710-85ff-bcd2091b8d14 on host hv-cinder-79091 {{(pid=91687) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 04:37:13.961901 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-023348fc-aaf0-42c9-a5ad-43ff42d56154 req-5076bd42-0ccc-4be1-934b-0b45bcfe7801 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for port, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:13.964743 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e9041636-d49b-4bde-b686-3fb6ecbf907a', 'name': 'network-vif-deleted', 'tag': 'cda24ac9-3c25-4710-85ff-bcd2091b8d14'}] {{(pid=91687) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:37:13.982159 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-023348fc-aaf0-42c9-a5ad-43ff42d56154 req-5076bd42-0ccc-4be1-934b-0b45bcfe7801 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.82 "DELETE /v2.0/ports/cda24ac9-3c25-4710-85ff-bcd2091b8d14 HTTP/1.1" status: 204  len: 173 time: 1.3294768
May 20 04:37:14.086690 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvr_db [None req-8a148095-b61f-4b11-9226-c9615692c6e8 None None] Set router d4b509ec-ef18-4627-a6cf-1d7baff4e160 gateway port host: dv-cinder-790910-4-iscsi {{(pid=91689) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:37:14.217745 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e9041636-d49b-4bde-b686-3fb6ecbf907a', 'name': 'network-vif-deleted', 'tag': 'cda24ac9-3c25-4710-85ff-bcd2091b8d14', 'status': 'completed', 'code': 200}
May 20 04:37:14.327739 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-ca9b01d2-da77-4a50-9f50-340f1d85a6bd req-a92d1aa2-7ac1-4014-b422-4878e3f84dbc tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/ports?device_id=e9041636-d49b-4bde-b686-3fb6ecbf907a HTTP/1.1" status: 200  len: 210 time: 0.0428615
May 20 04:37:14.441788 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-8a148095-b61f-4b11-9226-c9615692c6e8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced2495bb0>, [{'id': 'd4b509ec-ef18-4627-a6cf-1d7baff4e160', 'name': 'tempest-AttachVolumeTestJSON-1012860640-router', 'tenant_id': '2035da004a584b4ea1f637e593596cd7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.206'}], 'enable_snat': True}, 'gw_port_id': '4e511e4a-69db-4a8c-b460-faca77e2e63e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:33:02Z', 'updated_at': '2021-05-20T04:33:06Z', 'revision_number': 4, 'project_id': '2035da004a584b4ea1f637e593596cd7', 'gw_port': {'id': '4e511e4a-69db-4a8c-b460-faca77e2e63e', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:59:ad', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd4b509ec-ef18-4627-a6cf-1d7baff4e160', 'device_owner': 'network:router_gateway', 'standard_attr_id': 608, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.206', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:33:03Z', 'updated_at': '2021-05-20T04:33:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_interfaces': [{'id': '6bbd99c0-ca71-4a0a-8b11-1bb2be75a9c9', 'name': '', 'network_id': '4c58b50e-1091-40dd-b4fa-ff2da87b1475', 'tenant_id': '2035da004a584b4ea1f637e593596cd7', 'mac_address': 'fa:16:3e:70:97:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd4b509ec-ef18-4627-a6cf-1d7baff4e160', 'device_owner': 'network:router_interface', 'standard_attr_id': 609, 'fixed_ips': [{'subnet_id': '24a65302-95b2-4d66-9d40-a9959babbe40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:33:05Z', 'updated_at': '2021-05-20T04:33:11Z', 'revision_number': 5, 'project_id': '2035da004a584b4ea1f637e593596cd7', 'subnets': [{'id': '24a65302-95b2-4d66-9d40-a9959babbe40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:37:14.445722 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8a148095-b61f-4b11-9226-c9615692c6e8 None None] Checking router: d4b509ec-ef18-4627-a6cf-1d7baff4e160 for host: dv-cinder-790910-4-iscsi {{(pid=91689) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 04:37:14.454378 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8a148095-b61f-4b11-9226-c9615692c6e8 None None] Routers {'d4b509ec-ef18-4627-a6cf-1d7baff4e160'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91689) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:37:14.455014 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-8a148095-b61f-4b11-9226-c9615692c6e8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced2495bb0>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:37:03Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['d4b509ec-ef18-4627-a6cf-1d7baff4e160'], 'active': True} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:37:14.634225 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvr_db [None req-8a148095-b61f-4b11-9226-c9615692c6e8 None None] Set router d4b509ec-ef18-4627-a6cf-1d7baff4e160 gateway port host: dv-cinder-790910-4-iscsi {{(pid=91689) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:37:14.951029 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-8a148095-b61f-4b11-9226-c9615692c6e8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced2495bb0>, [{'id': 'd4b509ec-ef18-4627-a6cf-1d7baff4e160', 'name': 'tempest-AttachVolumeTestJSON-1012860640-router', 'tenant_id': '2035da004a584b4ea1f637e593596cd7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.206'}], 'enable_snat': True}, 'gw_port_id': '4e511e4a-69db-4a8c-b460-faca77e2e63e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:33:02Z', 'updated_at': '2021-05-20T04:33:06Z', 'revision_number': 4, 'project_id': '2035da004a584b4ea1f637e593596cd7', 'gw_port': {'id': '4e511e4a-69db-4a8c-b460-faca77e2e63e', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:59:ad', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd4b509ec-ef18-4627-a6cf-1d7baff4e160', 'device_owner': 'network:router_gateway', 'standard_attr_id': 608, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.206', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:33:03Z', 'updated_at': '2021-05-20T04:33:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_interfaces': [{'id': '6bbd99c0-ca71-4a0a-8b11-1bb2be75a9c9', 'name': '', 'network_id': '4c58b50e-1091-40dd-b4fa-ff2da87b1475', 'tenant_id': '2035da004a584b4ea1f637e593596cd7', 'mac_address': 'fa:16:3e:70:97:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd4b509ec-ef18-4627-a6cf-1d7baff4e160', 'device_owner': 'network:router_interface', 'standard_attr_id': 609, 'fixed_ips': [{'subnet_id': '24a65302-95b2-4d66-9d40-a9959babbe40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:33:05Z', 'updated_at': '2021-05-20T04:33:11Z', 'revision_number': 5, 'project_id': '2035da004a584b4ea1f637e593596cd7', 'subnets': [{'id': '24a65302-95b2-4d66-9d40-a9959babbe40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:37:14.955196 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8a148095-b61f-4b11-9226-c9615692c6e8 None None] The sync data for ids ['d4b509ec-ef18-4627-a6cf-1d7baff4e160'] in dv-cinder-790910-4-iscsi is: [{'id': 'd4b509ec-ef18-4627-a6cf-1d7baff4e160', 'name': 'tempest-AttachVolumeTestJSON-1012860640-router', 'tenant_id': '2035da004a584b4ea1f637e593596cd7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.206'}], 'enable_snat': True}, 'gw_port_id': '4e511e4a-69db-4a8c-b460-faca77e2e63e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:33:02Z', 'updated_at': '2021-05-20T04:33:06Z', 'revision_number': 4, 'project_id': '2035da004a584b4ea1f637e593596cd7', 'gw_port': {'id': '4e511e4a-69db-4a8c-b460-faca77e2e63e', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:59:ad', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd4b509ec-ef18-4627-a6cf-1d7baff4e160', 'device_owner': 'network:router_gateway', 'standard_attr_id': 608, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.206', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:33:03Z', 'updated_at': '2021-05-20T04:33:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_interfaces': [{'id': '6bbd99c0-ca71-4a0a-8b11-1bb2be75a9c9', 'name': '', 'network_id': '4c58b50e-1091-40dd-b4fa-ff2da87b1475', 'tenant_id': '2035da004a584b4ea1f637e593596cd7', 'mac_address': 'fa:16:3e:70:97:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd4b509ec-ef18-4627-a6cf-1d7baff4e160', 'device_owner': 'network:router_interface', 'standard_attr_id': 609, 'fixed_ips': [{'subnet_id': '24a65302-95b2-4d66-9d40-a9959babbe40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:33:05Z', 'updated_at': '2021-05-20T04:33:11Z', 'revision_number': 5, 'project_id': '2035da004a584b4ea1f637e593596cd7', 'subnets': [{'id': '24a65302-95b2-4d66-9d40-a9959babbe40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91689) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 04:37:15.173892 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-45393bd6-133e-416e-a06d-9932c6540e20 None None] New status for floating IP 11e49eaa-8133-4dc8-926d-cc77d7c124a1: DOWN {{(pid=91688) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 20 04:37:15.456126 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 46936) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:37:15.521620 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-0a4e023c-ec44-4dc1-9181-533562100085 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks [] for security_group, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:15.549751 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-0a4e023c-ec44-4dc1-9181-533562100085 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks [] for security_group, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:15.603397 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-0a4e023c-ec44-4dc1-9181-533562100085 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:15.607203 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-5b86bee3-2ff0-4f25-8da6-7a7235cf9289 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:37:15.621139 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a4e023c-ec44-4dc1-9181-533562100085 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=a91e9b1a-ef38-4317-bbea-c290d296dc7b,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:37:15.625318 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-0a4e023c-ec44-4dc1-9181-533562100085 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:37:15.636438 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-0a4e023c-ec44-4dc1-9181-533562100085 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks [] for security_group, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:15.637687 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-0a4e023c-ec44-4dc1-9181-533562100085 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "DELETE /v2.0/security-groups/a91e9b1a-ef38-4317-bbea-c290d296dc7b HTTP/1.1" status: 204  len: 168 time: 0.1805427
May 20 04:37:15.640599 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 46940) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:37:15.660563 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.api.v2.resource [None req-51b284bc-9817-4c88-8a8f-4e5cfad38931 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] show failed (client error): The resource could not be found.
May 20 04:37:15.661582 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-51b284bc-9817-4c88-8a8f-4e5cfad38931 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/security-groups/a91e9b1a-ef38-4317-bbea-c290d296dc7b HTTP/1.1" status: 404  len: 347 time: 0.0199895
May 20 04:37:15.664612 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 46944) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:37:15.877415 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [None req-0dc520e1-68c6-4fe8-80dd-3e2ca9c23840 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Deleting port f7120f16-e33b-427a-9fed-c364fe9ee65c {{(pid=91687) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 04:37:15.877657 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-0dc520e1-68c6-4fe8-80dd-3e2ca9c23840 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8782892520551'] for port, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:15.997350 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-0dc520e1-68c6-4fe8-80dd-3e2ca9c23840 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1718922'] for port, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:15.997647 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-0dc520e1-68c6-4fe8-80dd-3e2ca9c23840 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:16.122352 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [None req-0dc520e1-68c6-4fe8-80dd-3e2ca9c23840 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Calling delete_port for f7120f16-e33b-427a-9fed-c364fe9ee65c owned by network:floatingip {{(pid=91687) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 04:37:16.239334 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-0dc520e1-68c6-4fe8-80dd-3e2ca9c23840 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8782892522936', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8782892108804', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4162192'] for port, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:16.244931 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-e885970a-bd07-490e-acbf-45a3a8301eed admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:37:16.286945 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0dc520e1-68c6-4fe8-80dd-3e2ca9c23840 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Pushing event deleted for resources: {'Port': ['ID=f7120f16-e33b-427a-9fed-c364fe9ee65c,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:37:16.290434 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-0dc520e1-68c6-4fe8-80dd-3e2ca9c23840 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:37:16.390534 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-0dc520e1-68c6-4fe8-80dd-3e2ca9c23840 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks [] for floatingip, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:16.410465 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-0dc520e1-68c6-4fe8-80dd-3e2ca9c23840 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for floatingip, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:16.411559 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-0dc520e1-68c6-4fe8-80dd-3e2ca9c23840 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "DELETE /v2.0/floatingips/11e49eaa-8133-4dc8-926d-cc77d7c124a1 HTTP/1.1" status: 204  len: 168 time: 0.7460148
May 20 04:37:16.791120 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 46950) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:37:16.796641 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.v2.base [None req-8208cf9f-0797-44db-8441-6b30f77d1ccd tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Request body: {'security_group': {'name': 'tempest-securitygroup--181582263', 'description': 'tempest-description--1636421660'}} {{(pid=91686) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:37:16.803280 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-8208cf9f-0797-44db-8441-6b30f77d1ccd tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:37:16.808011 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-8208cf9f-0797-44db-8441-6b30f77d1ccd tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Usage tracker for resource:security_group and tenant:2035da004a584b4ea1f637e593596cd7 is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:37:16.811508 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-8208cf9f-0797-44db-8441-6b30f77d1ccd tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:37:16.818688 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-8208cf9f-0797-44db-8441-6b30f77d1ccd tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:37:16.830197 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-8208cf9f-0797-44db-8441-6b30f77d1ccd tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks [] for security_group, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:16.849854 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-8208cf9f-0797-44db-8441-6b30f77d1ccd tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:37:16.853671 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-8208cf9f-0797-44db-8441-6b30f77d1ccd tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Usage tracker for resource:security_group_rule and tenant:2035da004a584b4ea1f637e593596cd7 is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:37:16.856420 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-8208cf9f-0797-44db-8441-6b30f77d1ccd tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:37:16.862394 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-8208cf9f-0797-44db-8441-6b30f77d1ccd tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:37:16.937831 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-8208cf9f-0797-44db-8441-6b30f77d1ccd tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks [] for security_group, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:16.943532 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-8208cf9f-0797-44db-8441-6b30f77d1ccd tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:16.947280 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-0241dd54-6807-41f3-be55-f71084245a28 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:37:16.994340 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8208cf9f-0797-44db-8441-6b30f77d1ccd tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Pushing event updated for resources: {'SecurityGroup': ['ID=e768b0f4-c941-4d5f-8537-5a1cf9061de6,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:37:16.997184 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-8208cf9f-0797-44db-8441-6b30f77d1ccd tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks [] for security_group, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:16.998454 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-8208cf9f-0797-44db-8441-6b30f77d1ccd tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1779 time: 0.2062657
May 20 04:37:16.999434 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-8208cf9f-0797-44db-8441-6b30f77d1ccd tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:37:17.001537 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 46954) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:37:17.006599 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.v2.base [None req-899b8e40-650d-48d4-baaf-c52fb0ccf4cc tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Request body: {'security_group_rule': {'security_group_id': 'e768b0f4-c941-4d5f-8537-5a1cf9061de6', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=91686) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:37:17.012794 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-899b8e40-650d-48d4-baaf-c52fb0ccf4cc tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:37:17.017206 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-899b8e40-650d-48d4-baaf-c52fb0ccf4cc tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Usage tracker for resource:security_group_rule and tenant:2035da004a584b4ea1f637e593596cd7 is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:37:17.020311 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-899b8e40-650d-48d4-baaf-c52fb0ccf4cc tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:37:17.027246 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-899b8e40-650d-48d4-baaf-c52fb0ccf4cc tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:37:17.044799 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-899b8e40-650d-48d4-baaf-c52fb0ccf4cc tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:17.106751 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-899b8e40-650d-48d4-baaf-c52fb0ccf4cc tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:17.111961 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-899b8e40-650d-48d4-baaf-c52fb0ccf4cc tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1597377'] for security_group_rule, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:17.114399 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:37:17.136138 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-899b8e40-650d-48d4-baaf-c52fb0ccf4cc tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5e918c26-63a7-40f9-a31f-50a7957ef06a,revision_number=0']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:37:17.138539 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-899b8e40-650d-48d4-baaf-c52fb0ccf4cc tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:37:17.146545 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-899b8e40-650d-48d4-baaf-c52fb0ccf4cc tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:17.148094 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-899b8e40-650d-48d4-baaf-c52fb0ccf4cc tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.1457560
May 20 04:37:17.151171 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 46958) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:37:17.156662 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [None req-9d498c04-dd59-4918-9878-ad13ad668a3d tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Request body: {'security_group_rule': {'security_group_id': 'e768b0f4-c941-4d5f-8537-5a1cf9061de6', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:37:17.162721 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-9d498c04-dd59-4918-9878-ad13ad668a3d tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:37:17.166791 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-9d498c04-dd59-4918-9878-ad13ad668a3d tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Usage tracker for resource:security_group_rule and tenant:2035da004a584b4ea1f637e593596cd7 is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:37:17.169861 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-9d498c04-dd59-4918-9878-ad13ad668a3d tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:37:17.175796 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-9d498c04-dd59-4918-9878-ad13ad668a3d tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:37:17.197366 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-9d498c04-dd59-4918-9878-ad13ad668a3d tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:17.261783 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-9d498c04-dd59-4918-9878-ad13ad668a3d tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:17.266374 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-9d498c04-dd59-4918-9878-ad13ad668a3d tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1597377'] for security_group_rule, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:17.268405 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:37:17.290259 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d498c04-dd59-4918-9878-ad13ad668a3d tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f9de327a-dea5-44b3-8cce-0e47e811894b,revision_number=0']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:37:17.292612 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-9d498c04-dd59-4918-9878-ad13ad668a3d tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:37:17.300306 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-9d498c04-dd59-4918-9878-ad13ad668a3d tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:17.301503 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-9d498c04-dd59-4918-9878-ad13ad668a3d tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.1493428
May 20 04:37:17.304722 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 46962) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:37:17.309971 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [None req-8b250284-4f36-4ea6-a205-08a908caa952 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Request body: {'floatingip': {'floating_network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90'}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:37:17.316127 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-8b250284-4f36-4ea6-a205-08a908caa952 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:37:17.320325 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-8b250284-4f36-4ea6-a205-08a908caa952 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Usage tracker for resource:floatingip and tenant:2035da004a584b4ea1f637e593596cd7 is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:37:17.323437 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-8b250284-4f36-4ea6-a205-08a908caa952 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:37:17.329514 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-8b250284-4f36-4ea6-a205-08a908caa952 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:37:17.344014 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-8b250284-4f36-4ea6-a205-08a908caa952 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks [] for floatingip, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:17.480097 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-8b250284-4f36-4ea6-a205-08a908caa952 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:17.610233 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device cda24ac9-3c25-4710-85ff-bcd2091b8d14 no longer exists at agent hyperv_hv-cinder-79091 {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 04:37:17.643906 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] No Port match for: cda24ac9-3c25-4710-85ff-bcd2091b8d14 {{(pid=91688) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 04:37:17.644264 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device cda24ac9-3c25-4710-85ff-bcd2091b8d14 not bound to the agent host hv-cinder-79091 {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 04:37:17.708444 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.db_base_plugin_common [None req-8b250284-4f36-4ea6-a205-08a908caa952 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Allocated IP 172.27.1.87 (aec557db-0c02-4008-8c9f-2efcd7462f90/217f4b55-4415-4d57-8b43-2ff4c8ac8e81/1f77af04-f9af-47c2-a874-fc26ffa55e2e) {{(pid=91687) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 04:37:17.855234 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-8b250284-4f36-4ea6-a205-08a908caa952 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks [] for port, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:17.889321 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-8b250284-4f36-4ea6-a205-08a908caa952 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8782892106231', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4162192'] for port, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:17.893756 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-dcd237e5-0c5c-4b79-8f19-c43e10b94be1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:37:17.958206 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8b250284-4f36-4ea6-a205-08a908caa952 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Network aec557db-0c02-4008-8c9f-2efcd7462f90 is already hosted by enough agents. {{(pid=91687) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:37:17.960924 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.base_scheduler [None req-8b250284-4f36-4ea6-a205-08a908caa952 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Resources bound (agent type, host, resource id):  {{(pid=91687) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:37:17.964530 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8b250284-4f36-4ea6-a205-08a908caa952 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Received port after_create {{(pid=91687) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 04:37:17.993238 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b250284-4f36-4ea6-a205-08a908caa952 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Pushing event updated for resources: {'Port': ['ID=1f77af04-f9af-47c2-a874-fc26ffa55e2e,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:37:17.999185 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-8b250284-4f36-4ea6-a205-08a908caa952 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.106s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:37:18.051959 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-8b250284-4f36-4ea6-a205-08a908caa952 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks [] for floatingip, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:18.119263 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-8b250284-4f36-4ea6-a205-08a908caa952 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:18.327559 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-8b250284-4f36-4ea6-a205-08a908caa952 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks [] for port, precommit_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:18.333957 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-8b250284-4f36-4ea6-a205-08a908caa952 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4162185'] for port, after_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:18.337483 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-8648ccb0-fd9c-42ca-ad7b-bec435a7135a tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:37:18.440710 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b250284-4f36-4ea6-a205-08a908caa952 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Pushing event updated for resources: {'Port': ['ID=1f77af04-f9af-47c2-a874-fc26ffa55e2e,revision_number=2']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:37:18.444801 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-8b250284-4f36-4ea6-a205-08a908caa952 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:37:18.453578 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-8b250284-4f36-4ea6-a205-08a908caa952 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1716406'] for floatingip, after_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:18.478447 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-8b250284-4f36-4ea6-a205-08a908caa952 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for floatingip, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:18.479643 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-8b250284-4f36-4ea6-a205-08a908caa952 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 692 time: 1.1738391
May 20 04:37:18.705328 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [req-c307d47a-98f8-4503-b7a4-a8128362a75c req-28f8d492-03ba-4913-be7b-ff6087f35dad tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Synchronizing usage tracker for tenant:2035da004a584b4ea1f637e593596cd7 on resource:security_group {{(pid=91686) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:37:18.722802 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [req-c307d47a-98f8-4503-b7a4-a8128362a75c req-28f8d492-03ba-4913-be7b-ff6087f35dad tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Unset dirty status for tenant:2035da004a584b4ea1f637e593596cd7 on resource:security_group {{(pid=91686) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:37:18.724131 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-c307d47a-98f8-4503-b7a4-a8128362a75c req-28f8d492-03ba-4913-be7b-ff6087f35dad tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/security-groups?name=tempest-securitygroup--181582263&fields=id&tenant_id=2035da004a584b4ea1f637e593596cd7 HTTP/1.1" status: 200  len: 267 time: 0.0579729
May 20 04:37:18.877025 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c307d47a-98f8-4503-b7a4-a8128362a75c req-b5b28438-df5a-4dc5-a1d4-a06a684c5fea tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:37:18.877585 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [req-c307d47a-98f8-4503-b7a4-a8128362a75c req-b5b28438-df5a-4dc5-a1d4-a06a684c5fea tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Synchronizing usage tracker for tenant:2035da004a584b4ea1f637e593596cd7 on resource:network {{(pid=91686) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:37:18.896236 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [req-c307d47a-98f8-4503-b7a4-a8128362a75c req-b5b28438-df5a-4dc5-a1d4-a06a684c5fea tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Unset dirty status for tenant:2035da004a584b4ea1f637e593596cd7 on resource:network {{(pid=91686) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:37:18.897838 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-c307d47a-98f8-4503-b7a4-a8128362a75c req-b5b28438-df5a-4dc5-a1d4-a06a684c5fea tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/networks?id=4c58b50e-1091-40dd-b4fa-ff2da87b1475 HTTP/1.1" status: 200  len: 811 time: 0.1666574
May 20 04:37:18.914060 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-c307d47a-98f8-4503-b7a4-a8128362a75c req-43ba73cd-c539-4232-9c07-c992d9564fac tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/quotas/2035da004a584b4ea1f637e593596cd7 HTTP/1.1" status: 200  len: 375 time: 0.0100636
May 20 04:37:19.006488 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-c307d47a-98f8-4503-b7a4-a8128362a75c req-32b243f4-8597-467b-a8e4-a2835716f0f7 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/ports?tenant_id=2035da004a584b4ea1f637e593596cd7&fields=id HTTP/1.1" status: 200  len: 348 time: 0.0850751
May 20 04:37:19.156506 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-c307d47a-98f8-4503-b7a4-a8128362a75c req-a2752239-dc17-4916-bdef-023f94765024 service neutron] 10.222.0.71 "GET /v2.0/networks/4c58b50e-1091-40dd-b4fa-ff2da87b1475?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1371593
May 20 04:37:19.297649 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-c307d47a-98f8-4503-b7a4-a8128362a75c req-b4233733-b49d-4349-8ef7-fbc0aba65d16 service neutron] 10.222.0.71 "GET /v2.0/networks/4c58b50e-1091-40dd-b4fa-ff2da87b1475?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1325209
May 20 04:37:19.477631 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-7e42bcf3-588d-41c9-87ef-3ae0c407998e req-36eb3796-c761-4f1b-a7d6-c780f32a508d tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Synchronizing usage tracker for tenant:2035da004a584b4ea1f637e593596cd7 on resource:port {{(pid=91687) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:37:19.495235 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-7e42bcf3-588d-41c9-87ef-3ae0c407998e req-36eb3796-c761-4f1b-a7d6-c780f32a508d tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Unset dirty status for tenant:2035da004a584b4ea1f637e593596cd7 on resource:port {{(pid=91687) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:37:19.496495 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-7e42bcf3-588d-41c9-87ef-3ae0c407998e req-36eb3796-c761-4f1b-a7d6-c780f32a508d tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/ports?device_id=07f99f96-db26-415e-8236-fd725875cfa9 HTTP/1.1" status: 200  len: 210 time: 0.0622993
May 20 04:37:20.535877 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c307d47a-98f8-4503-b7a4-a8128362a75c req-5df8fd4b-01be-402e-b808-6f98573aa10f tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:37:20.537315 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-c307d47a-98f8-4503-b7a4-a8128362a75c req-5df8fd4b-01be-402e-b808-6f98573aa10f tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.82 "GET /v2.0/networks?id=4c58b50e-1091-40dd-b4fa-ff2da87b1475 HTTP/1.1" status: 200  len: 811 time: 0.1464176
May 20 04:37:20.591573 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-c307d47a-98f8-4503-b7a4-a8128362a75c req-05f6f92c-a9c9-4d7e-99a5-c60d29fc5d87 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Synchronizing usage tracker for tenant:2035da004a584b4ea1f637e593596cd7 on resource:security_group {{(pid=91687) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:37:20.604352 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-c307d47a-98f8-4503-b7a4-a8128362a75c req-05f6f92c-a9c9-4d7e-99a5-c60d29fc5d87 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Unset dirty status for tenant:2035da004a584b4ea1f637e593596cd7 on resource:security_group {{(pid=91687) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:37:20.605713 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-c307d47a-98f8-4503-b7a4-a8128362a75c req-05f6f92c-a9c9-4d7e-99a5-c60d29fc5d87 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.82 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=2035da004a584b4ea1f637e593596cd7 HTTP/1.1" status: 200  len: 379 time: 0.0593116
May 20 04:37:20.615158 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [req-c307d47a-98f8-4503-b7a4-a8128362a75c req-22b33920-f54b-4197-b9cd-b8704c544c56 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Request body: {'port': {'device_id': '07f99f96-db26-415e-8236-fd725875cfa9', 'network_id': '4c58b50e-1091-40dd-b4fa-ff2da87b1475', 'admin_state_up': True, 'tenant_id': '2035da004a584b4ea1f637e593596cd7', 'security_groups': ['e768b0f4-c941-4d5f-8537-5a1cf9061de6']}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:37:20.654893 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-36451371-4b64-4876-b661-d1818354e26d req-1298f95a-5dd6-4058-afb0-2036e552ad35 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/ports?device_id=07f99f96-db26-415e-8236-fd725875cfa9 HTTP/1.1" status: 200  len: 210 time: 0.0453846
May 20 04:37:20.759538 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [req-c307d47a-98f8-4503-b7a4-a8128362a75c req-22b33920-f54b-4197-b9cd-b8704c544c56 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:37:20.769833 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [req-c307d47a-98f8-4503-b7a4-a8128362a75c req-22b33920-f54b-4197-b9cd-b8704c544c56 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:37:20.782800 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c307d47a-98f8-4503-b7a4-a8128362a75c req-22b33920-f54b-4197-b9cd-b8704c544c56 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Made reservation on behalf of 2035da004a584b4ea1f637e593596cd7 for: {'port': 1} {{(pid=91687) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 04:37:20.786359 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-c307d47a-98f8-4503-b7a4-a8128362a75c req-22b33920-f54b-4197-b9cd-b8704c544c56 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:20.958576 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.db_base_plugin_common [req-c307d47a-98f8-4503-b7a4-a8128362a75c req-22b33920-f54b-4197-b9cd-b8704c544c56 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Allocated IP 172.20.0.6 (4c58b50e-1091-40dd-b4fa-ff2da87b1475/24a65302-95b2-4d66-9d40-a9959babbe40/bf6cb901-c636-412a-a039-07c3de645700) {{(pid=91687) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 04:37:21.157916 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-c307d47a-98f8-4503-b7a4-a8128362a75c req-22b33920-f54b-4197-b9cd-b8704c544c56 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks [] for port, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:21.174417 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.provisioning_blocks [req-c307d47a-98f8-4503-b7a4-a8128362a75c req-22b33920-f54b-4197-b9cd-b8704c544c56 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Transition to ACTIVE for port object bf6cb901-c636-412a-a039-07c3de645700 will not be triggered until provisioned by entity DHCP. {{(pid=91687) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:37:21.202523 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-c307d47a-98f8-4503-b7a4-a8128362a75c req-22b33920-f54b-4197-b9cd-b8704c544c56 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8782892106231', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4162192'] for port, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:21.208975 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-f29a8234-cedd-4b10-8dc8-16111b616d5d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:37:21.274051 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c307d47a-98f8-4503-b7a4-a8128362a75c req-22b33920-f54b-4197-b9cd-b8704c544c56 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Network 4c58b50e-1091-40dd-b4fa-ff2da87b1475 is already hosted by enough agents. {{(pid=91687) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:37:21.277158 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.base_scheduler [req-c307d47a-98f8-4503-b7a4-a8128362a75c req-22b33920-f54b-4197-b9cd-b8704c544c56 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Resources bound (agent type, host, resource id):  {{(pid=91687) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:37:21.279689 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.l3_dvrscheduler_db [req-c307d47a-98f8-4503-b7a4-a8128362a75c req-22b33920-f54b-4197-b9cd-b8704c544c56 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Received port after_create {{(pid=91687) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 04:37:21.324592 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22b33920-f54b-4197-b9cd-b8704c544c56 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Pushing event updated for resources: {'Port': ['ID=bf6cb901-c636-412a-a039-07c3de645700,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:37:21.327670 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-22b33920-f54b-4197-b9cd-b8704c544c56 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:37:21.355550 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c307d47a-98f8-4503-b7a4-a8128362a75c req-22b33920-f54b-4197-b9cd-b8704c544c56 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:37:21.356182 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-c307d47a-98f8-4503-b7a4-a8128362a75c req-22b33920-f54b-4197-b9cd-b8704c544c56 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for port, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:21.383432 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-c307d47a-98f8-4503-b7a4-a8128362a75c req-22b33920-f54b-4197-b9cd-b8704c544c56 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 0.7728109
May 20 04:37:21.395543 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [req-c307d47a-98f8-4503-b7a4-a8128362a75c req-da6d132e-ab40-4060-9652-05803b708f43 service neutron] Request body: {'port': {'device_id': '07f99f96-db26-415e-8236-fd725875cfa9', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79091'}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:37:21.453896 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-5896b5fe-b2a2-4639-b882-3b2c2eb30214 None None] Provisioning for port bf6cb901-c636-412a-a039-07c3de645700 completed by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:37:21.459661 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-5896b5fe-b2a2-4639-b882-3b2c2eb30214 None None] Provisioning complete for port bf6cb901-c636-412a-a039-07c3de645700 triggered by entity DHCP. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:37:21.460036 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-5896b5fe-b2a2-4639-b882-3b2c2eb30214 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:21.517727 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-5896b5fe-b2a2-4639-b882-3b2c2eb30214 None None] Port bf6cb901-c636-412a-a039-07c3de645700 cannot update to ACTIVE because it is not bound. {{(pid=91688) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 20 04:37:21.602622 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-c307d47a-98f8-4503-b7a4-a8128362a75c req-da6d132e-ab40-4060-9652-05803b708f43 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:21.939989 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e687b3c0-cb49-4106-b96c-a7aae7e251b6 req-f7b8ee7a-fdc8-4ccc-9162-ecee354d21a1 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:37:21.940585 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-e687b3c0-cb49-4106-b96c-a7aae7e251b6 req-f7b8ee7a-fdc8-4ccc-9162-ecee354d21a1 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Synchronizing usage tracker for tenant:2035da004a584b4ea1f637e593596cd7 on resource:port {{(pid=91687) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:37:22.010545 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-e687b3c0-cb49-4106-b96c-a7aae7e251b6 req-f7b8ee7a-fdc8-4ccc-9162-ecee354d21a1 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Unset dirty status for tenant:2035da004a584b4ea1f637e593596cd7 on resource:port {{(pid=91687) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:37:22.011759 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-e687b3c0-cb49-4106-b96c-a7aae7e251b6 req-f7b8ee7a-fdc8-4ccc-9162-ecee354d21a1 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/ports?device_id=07f99f96-db26-415e-8236-fd725875cfa9 HTTP/1.1" status: 200  len: 931 time: 0.2456074
May 20 04:37:22.038793 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.notifiers.nova [req-c307d47a-98f8-4503-b7a4-a8128362a75c req-da6d132e-ab40-4060-9652-05803b708f43 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id bf6cb901-c636-412a-a039-07c3de645700 {{(pid=91687) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 04:37:22.049909 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-c307d47a-98f8-4503-b7a4-a8128362a75c req-da6d132e-ab40-4060-9652-05803b708f43 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:22.080229 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-e687b3c0-cb49-4106-b96c-a7aae7e251b6 req-04fb82cd-bd64-4852-89c2-6e84cf2e63ea tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/security-groups?id=e768b0f4-c941-4d5f-8537-5a1cf9061de6&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0610466
May 20 04:37:22.081174 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.provisioning_blocks [req-c307d47a-98f8-4503-b7a4-a8128362a75c req-da6d132e-ab40-4060-9652-05803b708f43 service neutron] Transition to ACTIVE for port object bf6cb901-c636-412a-a039-07c3de645700 will not be triggered until provisioned by entity L2. {{(pid=91687) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:37:22.085493 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-c307d47a-98f8-4503-b7a4-a8128362a75c req-da6d132e-ab40-4060-9652-05803b708f43 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4162185'] for port, after_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:22.090120 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-dba7276f-7f3a-4bd8-94c7-337d873d3f8d tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:37:22.246038 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da6d132e-ab40-4060-9652-05803b708f43 service neutron] Pushing event updated for resources: {'Port': ['ID=bf6cb901-c636-412a-a039-07c3de645700,revision_number=2']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:37:22.253838 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-da6d132e-ab40-4060-9652-05803b708f43 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.163s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:37:22.322516 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.managers [req-c307d47a-98f8-4503-b7a4-a8128362a75c req-da6d132e-ab40-4060-9652-05803b708f43 service neutron] Attempting to bind port bf6cb901-c636-412a-a039-07c3de645700 on host hv-cinder-79091 for vnic_type normal with profile  {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 04:37:22.322819 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.managers [req-c307d47a-98f8-4503-b7a4-a8128362a75c req-da6d132e-ab40-4060-9652-05803b708f43 service neutron] Attempting to bind port bf6cb901-c636-412a-a039-07c3de645700 by drivers openvswitch,hyperv on host hv-cinder-79091 at level 0 using segments [{'id': '12af0450-da1a-4552-85ca-9149ff5b7f01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 871, 'network_id': '4c58b50e-1091-40dd-b4fa-ff2da87b1475'}] {{(pid=91687) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 04:37:22.323164 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c307d47a-98f8-4503-b7a4-a8128362a75c req-da6d132e-ab40-4060-9652-05803b708f43 service neutron] Attempting to bind port bf6cb901-c636-412a-a039-07c3de645700 on network 4c58b50e-1091-40dd-b4fa-ff2da87b1475 {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:37:22.328072 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c307d47a-98f8-4503-b7a4-a8128362a75c req-da6d132e-ab40-4060-9652-05803b708f43 service neutron] Port bf6cb901-c636-412a-a039-07c3de645700 on network 4c58b50e-1091-40dd-b4fa-ff2da87b1475 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79091 {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 20 04:37:22.328999 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c307d47a-98f8-4503-b7a4-a8128362a75c req-da6d132e-ab40-4060-9652-05803b708f43 service neutron] Attempting to bind port bf6cb901-c636-412a-a039-07c3de645700 on network 4c58b50e-1091-40dd-b4fa-ff2da87b1475 {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:37:22.334003 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c307d47a-98f8-4503-b7a4-a8128362a75c req-da6d132e-ab40-4060-9652-05803b708f43 service neutron] Checking agent: {'id': '7cc947fd-92eb-4d43-ad6b-ea002afff217', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79091', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 4, 19, 34), 'started_at': datetime.datetime(2021, 5, 20, 4, 19, 34), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 4, 37, 7), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 04:37:22.334341 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c307d47a-98f8-4503-b7a4-a8128362a75c req-da6d132e-ab40-4060-9652-05803b708f43 service neutron] Checking segment: {'id': '12af0450-da1a-4552-85ca-9149ff5b7f01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 871, 'network_id': '4c58b50e-1091-40dd-b4fa-ff2da87b1475'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91687) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:37:22.334721 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c307d47a-98f8-4503-b7a4-a8128362a75c req-da6d132e-ab40-4060-9652-05803b708f43 service neutron] Bound using segment: {'id': '12af0450-da1a-4552-85ca-9149ff5b7f01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 871, 'network_id': '4c58b50e-1091-40dd-b4fa-ff2da87b1475'} {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 04:37:22.335147 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.managers [req-c307d47a-98f8-4503-b7a4-a8128362a75c req-da6d132e-ab40-4060-9652-05803b708f43 service neutron] Bound port: bf6cb901-c636-412a-a039-07c3de645700, host: hv-cinder-79091, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '12af0450-da1a-4552-85ca-9149ff5b7f01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 871, 'network_id': '4c58b50e-1091-40dd-b4fa-ff2da87b1475'}}] {{(pid=91687) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 04:37:22.335503 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-c307d47a-98f8-4503-b7a4-a8128362a75c req-da6d132e-ab40-4060-9652-05803b708f43 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:22.425011 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [req-c307d47a-98f8-4503-b7a4-a8128362a75c req-da6d132e-ab40-4060-9652-05803b708f43 service neutron] For port bf6cb901-c636-412a-a039-07c3de645700, host hv-cinder-79091, cleared binding levels {{(pid=91687) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 04:37:22.428478 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [req-c307d47a-98f8-4503-b7a4-a8128362a75c req-da6d132e-ab40-4060-9652-05803b708f43 service neutron] For port bf6cb901-c636-412a-a039-07c3de645700, host hv-cinder-79091, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=bf6cb901-c636-412a-a039-07c3de645700,segment=NetworkSegment(12af0450-da1a-4552-85ca-9149ff5b7f01),segment_id=12af0450-da1a-4552-85ca-9149ff5b7f01)] {{(pid=91687) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 04:37:22.436772 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-c307d47a-98f8-4503-b7a4-a8128362a75c req-da6d132e-ab40-4060-9652-05803b708f43 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4162185'] for port, after_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:22.442744 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-5076bd42-0ccc-4be1-934b-0b45bcfe7801 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:37:22.512249 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c307d47a-98f8-4503-b7a4-a8128362a75c req-da6d132e-ab40-4060-9652-05803b708f43 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:37:22.512860 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-c307d47a-98f8-4503-b7a4-a8128362a75c req-da6d132e-ab40-4060-9652-05803b708f43 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for port, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:22.514274 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-c307d47a-98f8-4503-b7a4-a8128362a75c req-da6d132e-ab40-4060-9652-05803b708f43 service neutron] 10.222.0.82 "PUT /v2.0/ports/bf6cb901-c636-412a-a039-07c3de645700 HTTP/1.1" status: 200  len: 1093 time: 1.1230719
May 20 04:37:22.514793 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '07f99f96-db26-415e-8236-fd725875cfa9', 'tag': 'bf6cb901-c636-412a-a039-07c3de645700'}] {{(pid=91687) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:37:22.544209 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da6d132e-ab40-4060-9652-05803b708f43 service neutron] Pushing event updated for resources: {'Port': ['ID=bf6cb901-c636-412a-a039-07c3de645700,revision_number=3']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:37:22.549282 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-da6d132e-ab40-4060-9652-05803b708f43 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:37:22.584615 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '07f99f96-db26-415e-8236-fd725875cfa9', 'tag': 'bf6cb901-c636-412a-a039-07c3de645700', 'status': 'completed', 'code': 200}
May 20 04:37:22.628563 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c307d47a-98f8-4503-b7a4-a8128362a75c req-db548fc8-6e5b-400a-a381-777334750320 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:37:22.630504 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-c307d47a-98f8-4503-b7a4-a8128362a75c req-db548fc8-6e5b-400a-a381-777334750320 service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=2035da004a584b4ea1f637e593596cd7&device_id=07f99f96-db26-415e-8236-fd725875cfa9 HTTP/1.1" status: 200  len: 1096 time: 0.0771604
May 20 04:37:22.702218 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-c307d47a-98f8-4503-b7a4-a8128362a75c req-5c3052b5-8b14-4691-a225-adb244f733b0 service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=bf6cb901-c636-412a-a039-07c3de645700 HTTP/1.1" status: 200  len: 217 time: 0.0636759
May 20 04:37:22.778029 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c307d47a-98f8-4503-b7a4-a8128362a75c req-7cf1310e-17a2-42d1-8b22-0c7e836ad99a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:37:22.779573 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-c307d47a-98f8-4503-b7a4-a8128362a75c req-7cf1310e-17a2-42d1-8b22-0c7e836ad99a service neutron] 10.222.0.82 "GET /v2.0/subnets?id=24a65302-95b2-4d66-9d40-a9959babbe40 HTTP/1.1" status: 200  len: 850 time: 0.0713196
May 20 04:37:22.855778 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c307d47a-98f8-4503-b7a4-a8128362a75c req-98dd7f11-0bc0-41bb-9ed1-c4accc143d14 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:37:22.857282 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-c307d47a-98f8-4503-b7a4-a8128362a75c req-98dd7f11-0bc0-41bb-9ed1-c4accc143d14 service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=4c58b50e-1091-40dd-b4fa-ff2da87b1475&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0708714
May 20 04:37:22.992995 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-c307d47a-98f8-4503-b7a4-a8128362a75c req-f095f7d6-f5ef-42bd-a278-e962a0f4c64d service neutron] 10.222.0.82 "GET /v2.0/networks/4c58b50e-1091-40dd-b4fa-ff2da87b1475?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1292822
May 20 04:37:23.127585 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-c307d47a-98f8-4503-b7a4-a8128362a75c req-4562f4ca-cd04-4dc5-bf2b-cc72c077ce19 service neutron] 10.222.0.82 "GET /v2.0/networks/4c58b50e-1091-40dd-b4fa-ff2da87b1475?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1281850
May 20 04:37:23.403486 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1be1499f-4264-47be-afc3-bad8205d9483 req-3f0fcca5-28de-4a78-868b-aa9f330cee53 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:37:23.404849 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-1be1499f-4264-47be-afc3-bad8205d9483 req-3f0fcca5-28de-4a78-868b-aa9f330cee53 service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=2035da004a584b4ea1f637e593596cd7&device_id=07f99f96-db26-415e-8236-fd725875cfa9 HTTP/1.1" status: 200  len: 1096 time: 0.2295139
May 20 04:37:23.412809 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cf72669-1232-4dc9-9cfe-5ae949e42673 req-e371bd73-8224-42c3-acce-5b5162b2b63f tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:37:23.414144 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4cf72669-1232-4dc9-9cfe-5ae949e42673 req-e371bd73-8224-42c3-acce-5b5162b2b63f tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/ports?device_id=07f99f96-db26-415e-8236-fd725875cfa9 HTTP/1.1" status: 200  len: 943 time: 0.1083686
May 20 04:37:23.544218 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4cf72669-1232-4dc9-9cfe-5ae949e42673 req-004d09f7-06b6-4043-9a3d-09e53baa7fe3 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/security-groups?id=e768b0f4-c941-4d5f-8537-5a1cf9061de6&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1115987
May 20 04:37:23.572428 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1be1499f-4264-47be-afc3-bad8205d9483 req-81c91771-b8f8-4c52-885f-36406312dc00 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:37:23.573935 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-1be1499f-4264-47be-afc3-bad8205d9483 req-81c91771-b8f8-4c52-885f-36406312dc00 service neutron] 10.222.0.82 "GET /v2.0/networks?id=4c58b50e-1091-40dd-b4fa-ff2da87b1475 HTTP/1.1" status: 200  len: 912 time: 0.1589272
May 20 04:37:23.644009 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-1be1499f-4264-47be-afc3-bad8205d9483 req-6a26578d-7a27-49bf-8039-97bbbb82e628 service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=bf6cb901-c636-412a-a039-07c3de645700 HTTP/1.1" status: 200  len: 217 time: 0.0632956
May 20 04:37:23.711390 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1be1499f-4264-47be-afc3-bad8205d9483 req-ec6ee58f-2481-4fc7-8db0-b645616f49b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:37:23.712700 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-1be1499f-4264-47be-afc3-bad8205d9483 req-ec6ee58f-2481-4fc7-8db0-b645616f49b2 service neutron] 10.222.0.82 "GET /v2.0/subnets?id=24a65302-95b2-4d66-9d40-a9959babbe40 HTTP/1.1" status: 200  len: 850 time: 0.0620055
May 20 04:37:23.789922 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1be1499f-4264-47be-afc3-bad8205d9483 req-6bf81fd2-412f-4966-86be-e83e00d313f7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:37:23.791364 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-1be1499f-4264-47be-afc3-bad8205d9483 req-6bf81fd2-412f-4966-86be-e83e00d313f7 service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=4c58b50e-1091-40dd-b4fa-ff2da87b1475&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0712883
May 20 04:37:23.934866 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-1be1499f-4264-47be-afc3-bad8205d9483 req-abbefa99-4a5b-45c5-bdcb-21abf80fb5ea service neutron] 10.222.0.82 "GET /v2.0/networks/4c58b50e-1091-40dd-b4fa-ff2da87b1475?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1360936
May 20 04:37:24.068232 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-1be1499f-4264-47be-afc3-bad8205d9483 req-17385126-b500-40de-8bca-6dbd2ab63428 service neutron] 10.222.0.82 "GET /v2.0/networks/4c58b50e-1091-40dd-b4fa-ff2da87b1475?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1264436
May 20 04:37:24.744390 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2356d051-b29b-47f0-af26-4e31c6432dae req-fea20e1e-9d8f-4a99-bd7e-62601742b8e7 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:37:24.745879 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-2356d051-b29b-47f0-af26-4e31c6432dae req-fea20e1e-9d8f-4a99-bd7e-62601742b8e7 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/ports?device_id=07f99f96-db26-415e-8236-fd725875cfa9 HTTP/1.1" status: 200  len: 943 time: 0.0898683
May 20 04:37:24.794087 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-2356d051-b29b-47f0-af26-4e31c6432dae req-574c8ee5-5ce3-4c4c-becd-a1115f04a044 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/security-groups?id=e768b0f4-c941-4d5f-8537-5a1cf9061de6&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0422287
May 20 04:37:25.995388 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4f927f0-3a05-4073-9a92-315118198916 req-fac7807d-0de6-4974-a301-7240ddc6e31e tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:37:25.996839 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-c4f927f0-3a05-4073-9a92-315118198916 req-fac7807d-0de6-4974-a301-7240ddc6e31e tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/ports?device_id=07f99f96-db26-415e-8236-fd725875cfa9 HTTP/1.1" status: 200  len: 943 time: 0.0878158
May 20 04:37:26.044318 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-c4f927f0-3a05-4073-9a92-315118198916 req-2169952c-c101-44f2-8dd9-79419e9c7858 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/security-groups?id=e768b0f4-c941-4d5f-8537-5a1cf9061de6&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0412874
May 20 04:37:27.266854 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47cf5c16-6b86-4f6a-943c-b5fd2d558066 req-f8bcb53c-3dc7-4a92-9bf1-7befb1c476ef tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:37:27.268340 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-47cf5c16-6b86-4f6a-943c-b5fd2d558066 req-f8bcb53c-3dc7-4a92-9bf1-7befb1c476ef tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/ports?device_id=07f99f96-db26-415e-8236-fd725875cfa9 HTTP/1.1" status: 200  len: 943 time: 0.0953448
May 20 04:37:27.315784 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-47cf5c16-6b86-4f6a-943c-b5fd2d558066 req-2949190f-2cfa-4166-b4ad-aa719ee5e004 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/security-groups?id=e768b0f4-c941-4d5f-8537-5a1cf9061de6&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0393178
May 20 04:37:27.672905 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device bf6cb901-c636-412a-a039-07c3de645700 details requested by agent hyperv_hv-cinder-79091 with host hv-cinder-79091 {{(pid=91688) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 20 04:37:27.831273 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port bf6cb901-c636-412a-a039-07c3de645700, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=bf6cb901-c636-412a-a039-07c3de645700,segment=NetworkSegment(12af0450-da1a-4552-85ca-9149ff5b7f01),segment_id=12af0450-da1a-4552-85ca-9149ff5b7f01)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:37:27.854337 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Returning: {'device': 'bf6cb901-c636-412a-a039-07c3de645700', 'network_id': '4c58b50e-1091-40dd-b4fa-ff2da87b1475', 'port_id': 'bf6cb901-c636-412a-a039-07c3de645700', 'mac_address': 'fa:16:3e:0a:73:12', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 871, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '24a65302-95b2-4d66-9d40-a9959babbe40', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91688) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 20 04:37:27.953085 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:27.982549 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.notifiers.nova [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id bf6cb901-c636-412a-a039-07c3de645700 {{(pid=91688) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 04:37:28.009341 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port bf6cb901-c636-412a-a039-07c3de645700, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=bf6cb901-c636-412a-a039-07c3de645700,segment=NetworkSegment(12af0450-da1a-4552-85ca-9149ff5b7f01),segment_id=12af0450-da1a-4552-85ca-9149ff5b7f01)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:37:28.015623 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:28.018381 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-288dd821-fa65-4738-b29d-c7b2d97d372a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:37:28.086882 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Pushing event updated for resources: {'Port': ['ID=bf6cb901-c636-412a-a039-07c3de645700,revision_number=4']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:37:28.090041 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:37:28.347086 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] get_ports_and_sgs() called for port_ids ['bf6cb901-c636-412a-a039-07c3de645700'] {{(pid=91688) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 04:37:28.509234 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc8cd737-cd15-4461-bd8b-c80a8f711261 req-e3ccc43e-16b7-4fa9-bf45-23016f02396c tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:37:28.510672 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-fc8cd737-cd15-4461-bd8b-c80a8f711261 req-e3ccc43e-16b7-4fa9-bf45-23016f02396c tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/ports?device_id=07f99f96-db26-415e-8236-fd725875cfa9 HTTP/1.1" status: 200  len: 944 time: 0.0830188
May 20 04:37:28.557411 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-fc8cd737-cd15-4461-bd8b-c80a8f711261 req-9a3831b9-d576-4aa6-b1f6-d15213f07775 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/security-groups?id=e768b0f4-c941-4d5f-8537-5a1cf9061de6&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0405123
May 20 04:37:29.687763 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device bf6cb901-c636-412a-a039-07c3de645700 up at agent hyperv_hv-cinder-79091 {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:37:29.762917 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-950f6c0c-5d8f-45aa-b212-e0e82c5ff331 req-75b9a833-4acb-4320-903d-8b73b30a7f61 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:37:29.764415 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-950f6c0c-5d8f-45aa-b212-e0e82c5ff331 req-75b9a833-4acb-4320-903d-8b73b30a7f61 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/ports?device_id=07f99f96-db26-415e-8236-fd725875cfa9 HTTP/1.1" status: 200  len: 944 time: 0.0918605
May 20 04:37:29.787901 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Provisioning for port bf6cb901-c636-412a-a039-07c3de645700 completed by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:37:29.792590 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Provisioning complete for port bf6cb901-c636-412a-a039-07c3de645700 triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:37:29.792995 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:29.811770 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-950f6c0c-5d8f-45aa-b212-e0e82c5ff331 req-abbd2e6e-8a90-40d6-9091-d880d2e215ce tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/security-groups?id=e768b0f4-c941-4d5f-8537-5a1cf9061de6&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0414054
May 20 04:37:29.908809 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-bf18043e-215d-4de0-bbbd-2f20c1497292 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:29.921758 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:29.948298 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '07f99f96-db26-415e-8236-fd725875cfa9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bf6cb901-c636-412a-a039-07c3de645700'}] {{(pid=91688) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:37:29.960616 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port bf6cb901-c636-412a-a039-07c3de645700, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=bf6cb901-c636-412a-a039-07c3de645700,segment=NetworkSegment(12af0450-da1a-4552-85ca-9149ff5b7f01),segment_id=12af0450-da1a-4552-85ca-9149ff5b7f01)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:37:29.966558 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:29.970894 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-46ba1de9-de0c-472d-bb51-bd40ff197921 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:37:30.012633 dv-cinder-790910-4-iscsi neutron-server[91688]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '07f99f96-db26-415e-8236-fd725875cfa9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bf6cb901-c636-412a-a039-07c3de645700', 'code': 200}
May 20 04:37:30.054663 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Pushing event updated for resources: {'Port': ['ID=bf6cb901-c636-412a-a039-07c3de645700,revision_number=5']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:37:30.057623 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:37:30.258037 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4afbad5b-97e2-42f5-ad9e-7ea3eadded9d req-79dd62e0-5813-40bf-8d33-a7cb51852f75 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:37:30.259506 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4afbad5b-97e2-42f5-ad9e-7ea3eadded9d req-79dd62e0-5813-40bf-8d33-a7cb51852f75 service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=07f99f96-db26-415e-8236-fd725875cfa9 HTTP/1.1" status: 200  len: 1098 time: 0.0730910
May 20 04:37:30.301997 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4afbad5b-97e2-42f5-ad9e-7ea3eadded9d req-9dcbd852-734e-4c2d-bf30-f470ee80f6d7 service neutron] 10.222.0.82 "GET /v2.0/security-groups?id=e768b0f4-c941-4d5f-8537-5a1cf9061de6&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0355723
May 20 04:37:30.956723 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.agents_db [None req-92d61f12-17bc-4bf9-9eab-8a69b8c6da2f None None] Agent healthcheck: found 6 active agents {{(pid=91689) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 04:37:31.017804 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14a0a962-d9f7-40ca-adb4-4f5af6a4b19f req-25fe7b4f-9f04-4fc4-9710-e5e646747503 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:37:31.019321 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-14a0a962-d9f7-40ca-adb4-4f5af6a4b19f req-25fe7b4f-9f04-4fc4-9710-e5e646747503 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/ports?device_id=07f99f96-db26-415e-8236-fd725875cfa9 HTTP/1.1" status: 200  len: 945 time: 0.0891967
May 20 04:37:31.065963 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-14a0a962-d9f7-40ca-adb4-4f5af6a4b19f req-98200890-f110-4bb2-94a6-13ff1fd0f5f3 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/security-groups?id=e768b0f4-c941-4d5f-8537-5a1cf9061de6&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0403252
May 20 04:37:32.283466 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb3a8e17-68ca-41e3-9451-c08022d97f97 req-dd3a7170-edd6-4aeb-8bdb-11384e58b521 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:37:32.284873 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-cb3a8e17-68ca-41e3-9451-c08022d97f97 req-dd3a7170-edd6-4aeb-8bdb-11384e58b521 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/ports?device_id=07f99f96-db26-415e-8236-fd725875cfa9 HTTP/1.1" status: 200  len: 945 time: 0.0925968
May 20 04:37:32.329476 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-cb3a8e17-68ca-41e3-9451-c08022d97f97 req-81398cfe-fd53-4b94-b91c-c93f768e7867 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/security-groups?id=e768b0f4-c941-4d5f-8537-5a1cf9061de6&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0387588
May 20 04:37:32.532403 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e02c5b5e-f21c-40be-aac7-640659f8910e req-50e09a59-ae4b-4cc7-9fa3-4b8e94e848f0 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:37:32.533982 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-e02c5b5e-f21c-40be-aac7-640659f8910e req-50e09a59-ae4b-4cc7-9fa3-4b8e94e848f0 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/ports?device_id=07f99f96-db26-415e-8236-fd725875cfa9 HTTP/1.1" status: 200  len: 945 time: 0.1021328
May 20 04:37:32.542922 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 47020) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:37:32.550698 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [None req-79befc46-3002-429c-8999-d268843b71c9 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Request body: {'floatingip': {'port_id': 'bf6cb901-c636-412a-a039-07c3de645700'}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:37:32.584105 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:32.627328 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-79befc46-3002-429c-8999-d268843b71c9 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks [] for floatingip, before_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:32.751268 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-8a4a5653-10a9-4d12-8f7d-741ea0afbef2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:33.351560 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-79befc46-3002-429c-8999-d268843b71c9 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks [] for floatingip, precommit_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:33.358192 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-79befc46-3002-429c-8999-d268843b71c9 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1716406'] for floatingip, after_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:33.398760 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ea4803bd-878f-47d5-9084-1ec41953c9db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:33.536239 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.db.l3_db [None req-79befc46-3002-429c-8999-d268843b71c9 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Floating IP c7ecb693-5f6e-4ba1-8ca3-7b8bb589a5e2 associated. External IP: 172.27.1.87, port: bf6cb901-c636-412a-a039-07c3de645700.
May 20 04:37:33.902880 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-79befc46-3002-429c-8999-d268843b71c9 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Router d4b509ec-ef18-4627-a6cf-1d7baff4e160 has already been hosted by L3 agent 02733fc0-fc9c-4e29-bc03-c27a792d539d {{(pid=91687) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 04:37:34.092575 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-79befc46-3002-429c-8999-d268843b71c9 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify agent at l3_agent.dv-cinder-790910-4-iscsi the message routers_updated {{(pid=91687) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 04:37:34.097099 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-79befc46-3002-429c-8999-d268843b71c9 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for floatingip, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:34.102246 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b09c5fce-0ec0-42db-b23c-0d5c6ce2df23 None None] Sync routers for ids ['d4b509ec-ef18-4627-a6cf-1d7baff4e160'] in dv-cinder-790910-4-iscsi {{(pid=91689) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 04:37:34.113471 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b09c5fce-0ec0-42db-b23c-0d5c6ce2df23 None None] Routers {'d4b509ec-ef18-4627-a6cf-1d7baff4e160'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91689) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:37:34.114099 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-b09c5fce-0ec0-42db-b23c-0d5c6ce2df23 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced17df9a0>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:37:33Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['d4b509ec-ef18-4627-a6cf-1d7baff4e160'], 'active': True} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:37:34.154468 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-79befc46-3002-429c-8999-d268843b71c9 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "PUT /v2.0/floatingips/c7ecb693-5f6e-4ba1-8ca3-7b8bb589a5e2 HTTP/1.1" status: 200  len: 990 time: 1.6100535
May 20 04:37:34.155257 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '07f99f96-db26-415e-8236-fd725875cfa9', 'tag': 'bf6cb901-c636-412a-a039-07c3de645700'}] {{(pid=91687) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:37:34.297403 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvr_db [None req-b09c5fce-0ec0-42db-b23c-0d5c6ce2df23 None None] Set router d4b509ec-ef18-4627-a6cf-1d7baff4e160 gateway port host: dv-cinder-790910-4-iscsi {{(pid=91689) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:37:34.354142 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '07f99f96-db26-415e-8236-fd725875cfa9', 'tag': 'bf6cb901-c636-412a-a039-07c3de645700', 'status': 'completed', 'code': 200}
May 20 04:37:34.446448 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71bc8bc3-cdae-4fcb-ade8-74591c6998a7 req-5dbfbe87-f29b-45ef-9b67-bcaac981f520 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:37:34.447869 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-71bc8bc3-cdae-4fcb-ade8-74591c6998a7 req-5dbfbe87-f29b-45ef-9b67-bcaac981f520 service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=2035da004a584b4ea1f637e593596cd7&device_id=07f99f96-db26-415e-8236-fd725875cfa9 HTTP/1.1" status: 200  len: 1098 time: 0.0715885
May 20 04:37:34.644796 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-b09c5fce-0ec0-42db-b23c-0d5c6ce2df23 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced17df9a0>, [{'id': 'd4b509ec-ef18-4627-a6cf-1d7baff4e160', 'name': 'tempest-AttachVolumeTestJSON-1012860640-router', 'tenant_id': '2035da004a584b4ea1f637e593596cd7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.206'}], 'enable_snat': True}, 'gw_port_id': '4e511e4a-69db-4a8c-b460-faca77e2e63e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:33:02Z', 'updated_at': '2021-05-20T04:33:06Z', 'revision_number': 4, 'project_id': '2035da004a584b4ea1f637e593596cd7', 'gw_port': {'id': '4e511e4a-69db-4a8c-b460-faca77e2e63e', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:59:ad', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd4b509ec-ef18-4627-a6cf-1d7baff4e160', 'device_owner': 'network:router_gateway', 'standard_attr_id': 608, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.206', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:33:03Z', 'updated_at': '2021-05-20T04:33:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_floatingips': [{'id': 'c7ecb693-5f6e-4ba1-8ca3-7b8bb589a5e2', 'tenant_id': '2035da004a584b4ea1f637e593596cd7', 'floating_ip_address': '172.27.1.87', 'floating_network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'router_id': 'd4b509ec-ef18-4627-a6cf-1d7baff4e160', 'port_id': 'bf6cb901-c636-412a-a039-07c3de645700', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 627, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4c58b50e-1091-40dd-b4fa-ff2da87b1475', 'mac_address': 'fa:16:3e:0a:73:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '07f99f96-db26-415e-8236-fd725875cfa9', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T04:37:18Z', 'updated_at': '2021-05-20T04:37:33Z', 'revision_number': 1, 'project_id': '2035da004a584b4ea1f637e593596cd7', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6bbd99c0-ca71-4a0a-8b11-1bb2be75a9c9', 'name': '', 'network_id': '4c58b50e-1091-40dd-b4fa-ff2da87b1475', 'tenant_id': '2035da004a584b4ea1f637e593596cd7', 'mac_address': 'fa:16:3e:70:97:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd4b509ec-ef18-4627-a6cf-1d7baff4e160', 'device_owner': 'network:router_interface', 'standard_attr_id': 609, 'fixed_ips': [{'subnet_id': '24a65302-95b2-4d66-9d40-a9959babbe40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:33:05Z', 'updated_at': '2021-05-20T04:33:11Z', 'revision_number': 5, 'project_id': '2035da004a584b4ea1f637e593596cd7', 'subnets': [{'id': '24a65302-95b2-4d66-9d40-a9959babbe40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:37:34.649247 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b09c5fce-0ec0-42db-b23c-0d5c6ce2df23 None None] Checking router: d4b509ec-ef18-4627-a6cf-1d7baff4e160 for host: dv-cinder-790910-4-iscsi {{(pid=91689) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 04:37:34.657726 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b09c5fce-0ec0-42db-b23c-0d5c6ce2df23 None None] Routers {'d4b509ec-ef18-4627-a6cf-1d7baff4e160'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91689) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:37:34.658322 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-b09c5fce-0ec0-42db-b23c-0d5c6ce2df23 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced17df9a0>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:37:33Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['d4b509ec-ef18-4627-a6cf-1d7baff4e160'], 'active': True} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:37:34.692927 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71bc8bc3-cdae-4fcb-ade8-74591c6998a7 req-51c78ac3-5ba5-445c-9db0-78d3b7367f5a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:37:34.694406 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-71bc8bc3-cdae-4fcb-ade8-74591c6998a7 req-51c78ac3-5ba5-445c-9db0-78d3b7367f5a service neutron] 10.222.0.82 "GET /v2.0/networks?id=4c58b50e-1091-40dd-b4fa-ff2da87b1475 HTTP/1.1" status: 200  len: 912 time: 0.2400074
May 20 04:37:34.797848 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-71bc8bc3-cdae-4fcb-ade8-74591c6998a7 req-4346f2e8-eb06-42b7-8745-43c440455d85 service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=bf6cb901-c636-412a-a039-07c3de645700 HTTP/1.1" status: 200  len: 998 time: 0.0960813
May 20 04:37:34.863217 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvr_db [None req-b09c5fce-0ec0-42db-b23c-0d5c6ce2df23 None None] Set router d4b509ec-ef18-4627-a6cf-1d7baff4e160 gateway port host: dv-cinder-790910-4-iscsi {{(pid=91689) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:37:34.865284 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71bc8bc3-cdae-4fcb-ade8-74591c6998a7 req-cabfa091-19e5-46ed-85a5-5d5f874d0056 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:37:34.866771 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-71bc8bc3-cdae-4fcb-ade8-74591c6998a7 req-cabfa091-19e5-46ed-85a5-5d5f874d0056 service neutron] 10.222.0.82 "GET /v2.0/subnets?id=24a65302-95b2-4d66-9d40-a9959babbe40 HTTP/1.1" status: 200  len: 850 time: 0.0629823
May 20 04:37:34.945658 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71bc8bc3-cdae-4fcb-ade8-74591c6998a7 req-bb937fe5-5d42-4169-b9d6-7e0c188dc1de service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:37:34.947147 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-71bc8bc3-cdae-4fcb-ade8-74591c6998a7 req-bb937fe5-5d42-4169-b9d6-7e0c188dc1de service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=4c58b50e-1091-40dd-b4fa-ff2da87b1475&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0724931
May 20 04:37:35.080088 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-71bc8bc3-cdae-4fcb-ade8-74591c6998a7 req-e9be88c6-dfd4-431e-b5a7-c726b828e53c service neutron] 10.222.0.82 "GET /v2.0/networks/4c58b50e-1091-40dd-b4fa-ff2da87b1475?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1260595
May 20 04:37:35.214267 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-b09c5fce-0ec0-42db-b23c-0d5c6ce2df23 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced17df9a0>, [{'id': 'd4b509ec-ef18-4627-a6cf-1d7baff4e160', 'name': 'tempest-AttachVolumeTestJSON-1012860640-router', 'tenant_id': '2035da004a584b4ea1f637e593596cd7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.206'}], 'enable_snat': True}, 'gw_port_id': '4e511e4a-69db-4a8c-b460-faca77e2e63e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:33:02Z', 'updated_at': '2021-05-20T04:33:06Z', 'revision_number': 4, 'project_id': '2035da004a584b4ea1f637e593596cd7', 'gw_port': {'id': '4e511e4a-69db-4a8c-b460-faca77e2e63e', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:59:ad', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd4b509ec-ef18-4627-a6cf-1d7baff4e160', 'device_owner': 'network:router_gateway', 'standard_attr_id': 608, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.206', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:33:03Z', 'updated_at': '2021-05-20T04:33:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_floatingips': [{'id': 'c7ecb693-5f6e-4ba1-8ca3-7b8bb589a5e2', 'tenant_id': '2035da004a584b4ea1f637e593596cd7', 'floating_ip_address': '172.27.1.87', 'floating_network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'router_id': 'd4b509ec-ef18-4627-a6cf-1d7baff4e160', 'port_id': 'bf6cb901-c636-412a-a039-07c3de645700', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 627, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4c58b50e-1091-40dd-b4fa-ff2da87b1475', 'mac_address': 'fa:16:3e:0a:73:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '07f99f96-db26-415e-8236-fd725875cfa9', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T04:37:18Z', 'updated_at': '2021-05-20T04:37:33Z', 'revision_number': 1, 'project_id': '2035da004a584b4ea1f637e593596cd7', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6bbd99c0-ca71-4a0a-8b11-1bb2be75a9c9', 'name': '', 'network_id': '4c58b50e-1091-40dd-b4fa-ff2da87b1475', 'tenant_id': '2035da004a584b4ea1f637e593596cd7', 'mac_address': 'fa:16:3e:70:97:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd4b509ec-ef18-4627-a6cf-1d7baff4e160', 'device_owner': 'network:router_interface', 'standard_attr_id': 609, 'fixed_ips': [{'subnet_id': '24a65302-95b2-4d66-9d40-a9959babbe40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:33:05Z', 'updated_at': '2021-05-20T04:33:11Z', 'revision_number': 5, 'project_id': '2035da004a584b4ea1f637e593596cd7', 'subnets': [{'id': '24a65302-95b2-4d66-9d40-a9959babbe40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:37:35.217383 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-71bc8bc3-cdae-4fcb-ade8-74591c6998a7 req-6a1aa100-afe8-4e34-b7f6-c9c6522a05d6 service neutron] 10.222.0.82 "GET /v2.0/networks/4c58b50e-1091-40dd-b4fa-ff2da87b1475?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1307425
May 20 04:37:35.219379 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b09c5fce-0ec0-42db-b23c-0d5c6ce2df23 None None] The sync data for ids ['d4b509ec-ef18-4627-a6cf-1d7baff4e160'] in dv-cinder-790910-4-iscsi is: [{'id': 'd4b509ec-ef18-4627-a6cf-1d7baff4e160', 'name': 'tempest-AttachVolumeTestJSON-1012860640-router', 'tenant_id': '2035da004a584b4ea1f637e593596cd7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.206'}], 'enable_snat': True}, 'gw_port_id': '4e511e4a-69db-4a8c-b460-faca77e2e63e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:33:02Z', 'updated_at': '2021-05-20T04:33:06Z', 'revision_number': 4, 'project_id': '2035da004a584b4ea1f637e593596cd7', 'gw_port': {'id': '4e511e4a-69db-4a8c-b460-faca77e2e63e', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:59:ad', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd4b509ec-ef18-4627-a6cf-1d7baff4e160', 'device_owner': 'network:router_gateway', 'standard_attr_id': 608, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.206', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:33:03Z', 'updated_at': '2021-05-20T04:33:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_floatingips': [{'id': 'c7ecb693-5f6e-4ba1-8ca3-7b8bb589a5e2', 'tenant_id': '2035da004a584b4ea1f637e593596cd7', 'floating_ip_address': '172.27.1.87', 'floating_network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'router_id': 'd4b509ec-ef18-4627-a6cf-1d7baff4e160', 'port_id': 'bf6cb901-c636-412a-a039-07c3de645700', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 627, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4c58b50e-1091-40dd-b4fa-ff2da87b1475', 'mac_address': 'fa:16:3e:0a:73:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '07f99f96-db26-415e-8236-fd725875cfa9', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-20T04:37:18Z', 'updated_at': '2021-05-20T04:37:33Z', 'revision_number': 1, 'project_id': '2035da004a584b4ea1f637e593596cd7', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6bbd99c0-ca71-4a0a-8b11-1bb2be75a9c9', 'name': '', 'network_id': '4c58b50e-1091-40dd-b4fa-ff2da87b1475', 'tenant_id': '2035da004a584b4ea1f637e593596cd7', 'mac_address': 'fa:16:3e:70:97:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd4b509ec-ef18-4627-a6cf-1d7baff4e160', 'device_owner': 'network:router_interface', 'standard_attr_id': 609, 'fixed_ips': [{'subnet_id': '24a65302-95b2-4d66-9d40-a9959babbe40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:33:05Z', 'updated_at': '2021-05-20T04:33:11Z', 'revision_number': 5, 'project_id': '2035da004a584b4ea1f637e593596cd7', 'subnets': [{'id': '24a65302-95b2-4d66-9d40-a9959babbe40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91689) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 04:37:35.250909 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f21320cc-6a25-4ec1-8a32-8b119b35fd55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:35.407707 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c664bd5e-4b96-49bd-bc0a-03de5e7c9b04 None None] New status for floating IP c7ecb693-5f6e-4ba1-8ca3-7b8bb589a5e2: ACTIVE {{(pid=91688) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 20 04:37:36.656211 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:37:41.549826 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-d3fbb71f-fb85-45fc-b376-150ca7d4c4b0 req-3d2d0cca-d071-4acc-9e11-f479dc5403c2 service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=07f99f96-db26-415e-8236-fd725875cfa9&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0780702
May 20 04:37:41.695760 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3fbb71f-fb85-45fc-b376-150ca7d4c4b0 req-13b27c57-7e1d-4bca-9213-4301893d2a8e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:37:41.697237 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-d3fbb71f-fb85-45fc-b376-150ca7d4c4b0 req-13b27c57-7e1d-4bca-9213-4301893d2a8e service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=2035da004a584b4ea1f637e593596cd7&device_id=07f99f96-db26-415e-8236-fd725875cfa9 HTTP/1.1" status: 200  len: 1098 time: 0.0776296
May 20 04:37:41.854682 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3fbb71f-fb85-45fc-b376-150ca7d4c4b0 req-39360965-b704-429e-962d-18ce48c598f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:37:41.856018 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-d3fbb71f-fb85-45fc-b376-150ca7d4c4b0 req-39360965-b704-429e-962d-18ce48c598f9 service neutron] 10.222.0.82 "GET /v2.0/networks?id=4c58b50e-1091-40dd-b4fa-ff2da87b1475 HTTP/1.1" status: 200  len: 912 time: 0.1357951
May 20 04:37:41.960087 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-d3fbb71f-fb85-45fc-b376-150ca7d4c4b0 req-2265b194-641f-4a73-a709-f076115adacb service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=bf6cb901-c636-412a-a039-07c3de645700 HTTP/1.1" status: 200  len: 1000 time: 0.0968270
May 20 04:37:42.025771 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3fbb71f-fb85-45fc-b376-150ca7d4c4b0 req-06bc190f-761d-4780-aa3b-13a78c3baff3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:37:42.027272 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-d3fbb71f-fb85-45fc-b376-150ca7d4c4b0 req-06bc190f-761d-4780-aa3b-13a78c3baff3 service neutron] 10.222.0.82 "GET /v2.0/subnets?id=24a65302-95b2-4d66-9d40-a9959babbe40 HTTP/1.1" status: 200  len: 850 time: 0.0601075
May 20 04:37:42.114205 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3fbb71f-fb85-45fc-b376-150ca7d4c4b0 req-cb41a846-0b10-4bf5-990a-074900f8f252 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:37:42.116800 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-d3fbb71f-fb85-45fc-b376-150ca7d4c4b0 req-cb41a846-0b10-4bf5-990a-074900f8f252 service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=4c58b50e-1091-40dd-b4fa-ff2da87b1475&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0807219
May 20 04:37:42.259589 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-d3fbb71f-fb85-45fc-b376-150ca7d4c4b0 req-ecfbe024-0bbf-4e6c-819d-84b067fc2e86 service neutron] 10.222.0.82 "GET /v2.0/networks/4c58b50e-1091-40dd-b4fa-ff2da87b1475?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1314056
May 20 04:37:42.395036 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-d3fbb71f-fb85-45fc-b376-150ca7d4c4b0 req-a3ac433a-bd1f-4821-a818-977949cb72f5 service neutron] 10.222.0.82 "GET /v2.0/networks/4c58b50e-1091-40dd-b4fa-ff2da87b1475?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1277533
May 20 04:37:59.877575 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-e728aa60-0aad-4550-b456-014a037c1621 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:38:02.591755 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:38:02.746132 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-e1c47dde-3871-4a7b-8b00-a84e96adc704 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:38:03.402305 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ea4803bd-878f-47d5-9084-1ec41953c9db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:38:05.256989 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f21320cc-6a25-4ec1-8a32-8b119b35fd55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:38:06.666543 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:38:07.957257 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.agents_db [None req-92d61f12-17bc-4bf9-9eab-8a69b8c6da2f None None] Agent healthcheck: found 6 active agents {{(pid=91689) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 04:38:29.874403 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-497b9ae8-200e-48c6-b467-cbcce2b272bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:38:32.587489 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:38:32.749995 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ba7e1917-ca94-4a75-a70a-5f2e0b0f0d72 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:38:33.405590 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ea4803bd-878f-47d5-9084-1ec41953c9db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:38:35.258958 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f21320cc-6a25-4ec1-8a32-8b119b35fd55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:38:36.675704 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:38:43.510238 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-ab06f5f9-aa13-4cbc-b1f8-7d897b06ebfb req-ea6c7e5d-9657-46c4-b88f-c0e99f487d10 service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=07f99f96-db26-415e-8236-fd725875cfa9&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0747223
May 20 04:38:43.654164 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab06f5f9-aa13-4cbc-b1f8-7d897b06ebfb req-0ab0d405-6d02-4def-bb29-dfc66411a396 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:38:43.655604 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-ab06f5f9-aa13-4cbc-b1f8-7d897b06ebfb req-0ab0d405-6d02-4def-bb29-dfc66411a396 service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=2035da004a584b4ea1f637e593596cd7&device_id=07f99f96-db26-415e-8236-fd725875cfa9 HTTP/1.1" status: 200  len: 1098 time: 0.0726945
May 20 04:38:43.910540 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab06f5f9-aa13-4cbc-b1f8-7d897b06ebfb req-24f653d1-19db-4cc8-87b6-8b6660dffbfa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:38:43.911894 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-ab06f5f9-aa13-4cbc-b1f8-7d897b06ebfb req-24f653d1-19db-4cc8-87b6-8b6660dffbfa service neutron] 10.222.0.82 "GET /v2.0/networks?id=4c58b50e-1091-40dd-b4fa-ff2da87b1475 HTTP/1.1" status: 200  len: 912 time: 0.2358692
May 20 04:38:44.017257 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-ab06f5f9-aa13-4cbc-b1f8-7d897b06ebfb req-43af0744-0715-469f-bf29-48caac69177a service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=bf6cb901-c636-412a-a039-07c3de645700 HTTP/1.1" status: 200  len: 1000 time: 0.0979328
May 20 04:38:44.084979 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab06f5f9-aa13-4cbc-b1f8-7d897b06ebfb req-c011e243-7d39-45a9-9307-2cb80f8fcaf4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:38:44.086401 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-ab06f5f9-aa13-4cbc-b1f8-7d897b06ebfb req-c011e243-7d39-45a9-9307-2cb80f8fcaf4 service neutron] 10.222.0.82 "GET /v2.0/subnets?id=24a65302-95b2-4d66-9d40-a9959babbe40 HTTP/1.1" status: 200  len: 850 time: 0.0622861
May 20 04:38:44.164494 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab06f5f9-aa13-4cbc-b1f8-7d897b06ebfb req-6af41482-7541-48f4-83be-e8dad8199e2f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:38:44.165903 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-ab06f5f9-aa13-4cbc-b1f8-7d897b06ebfb req-6af41482-7541-48f4-83be-e8dad8199e2f service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=4c58b50e-1091-40dd-b4fa-ff2da87b1475&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0729749
May 20 04:38:44.300012 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-ab06f5f9-aa13-4cbc-b1f8-7d897b06ebfb req-5c89f037-0421-4918-9c09-a8afc39a0c16 service neutron] 10.222.0.82 "GET /v2.0/networks/4c58b50e-1091-40dd-b4fa-ff2da87b1475?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1272478
May 20 04:38:44.436043 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-ab06f5f9-aa13-4cbc-b1f8-7d897b06ebfb req-083bd6fe-cd98-4535-9eea-dad9a530ce64 service neutron] 10.222.0.82 "GET /v2.0/networks/4c58b50e-1091-40dd-b4fa-ff2da87b1475?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1284912
May 20 04:38:44.957549 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.agents_db [None req-92d61f12-17bc-4bf9-9eab-8a69b8c6da2f None None] Agent healthcheck: found 6 active agents {{(pid=91689) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 04:38:59.867684 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-e426e3ef-ee3a-4d4e-91c7-da30aea8fe44 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:02.597741 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:02.755869 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-86834fb0-92bc-42b0-abd3-e6c29e195836 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:03.409821 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ea4803bd-878f-47d5-9084-1ec41953c9db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:05.264580 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f21320cc-6a25-4ec1-8a32-8b119b35fd55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:05.826019 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a473d9bd-cf13-49bc-9129-93caedf793e3 req-db6d8d5f-9f19-419a-af5f-a8bd98635c1b tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:39:05.827486 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a473d9bd-cf13-49bc-9129-93caedf793e3 req-db6d8d5f-9f19-419a-af5f-a8bd98635c1b tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/ports?device_id=07f99f96-db26-415e-8236-fd725875cfa9 HTTP/1.1" status: 200  len: 945 time: 0.1011713
May 20 04:39:05.877024 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-a473d9bd-cf13-49bc-9129-93caedf793e3 req-490c777a-9b17-4373-a2b9-a91150d85a1e tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/security-groups?id=e768b0f4-c941-4d5f-8537-5a1cf9061de6&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0411773
May 20 04:39:06.684716 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:07.069679 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6374524f-90e4-47d5-85a1-df895cc75a2b req-9ec85e89-ad46-42af-a503-6f5cbc9f0399 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:39:07.071123 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-6374524f-90e4-47d5-85a1-df895cc75a2b req-9ec85e89-ad46-42af-a503-6f5cbc9f0399 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/ports?device_id=07f99f96-db26-415e-8236-fd725875cfa9 HTTP/1.1" status: 200  len: 945 time: 0.0853379
May 20 04:39:07.123554 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-6374524f-90e4-47d5-85a1-df895cc75a2b req-95fa0b45-0b20-49e4-9346-29f5f58caae7 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/security-groups?id=e768b0f4-c941-4d5f-8537-5a1cf9061de6&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0444224
May 20 04:39:07.761759 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5c9b678-5ba6-4c76-b5cb-49aa374e3de7 req-3d747b70-abf3-41fb-adf7-499569730032 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:39:07.763199 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-c5c9b678-5ba6-4c76-b5cb-49aa374e3de7 req-3d747b70-abf3-41fb-adf7-499569730032 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.82 "GET /v2.0/ports?device_id=07f99f96-db26-415e-8236-fd725875cfa9 HTTP/1.1" status: 200  len: 945 time: 0.0979235
May 20 04:39:07.907954 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [req-c5c9b678-5ba6-4c76-b5cb-49aa374e3de7 req-08630f70-afee-4de2-bd09-166dbaefda32 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Deleting port bf6cb901-c636-412a-a039-07c3de645700 {{(pid=91687) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 04:39:07.908292 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-c5c9b678-5ba6-4c76-b5cb-49aa374e3de7 req-08630f70-afee-4de2-bd09-166dbaefda32 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8782892520551'] for port, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:08.043344 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [req-c5c9b678-5ba6-4c76-b5cb-49aa374e3de7 req-08630f70-afee-4de2-bd09-166dbaefda32 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] For port bf6cb901-c636-412a-a039-07c3de645700, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=bf6cb901-c636-412a-a039-07c3de645700,segment=NetworkSegment(12af0450-da1a-4552-85ca-9149ff5b7f01),segment_id=12af0450-da1a-4552-85ca-9149ff5b7f01)] {{(pid=91687) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:39:08.043603 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-c5c9b678-5ba6-4c76-b5cb-49aa374e3de7 req-08630f70-afee-4de2-bd09-166dbaefda32 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1718922'] for port, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:08.380008 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-c5c9b678-5ba6-4c76-b5cb-49aa374e3de7 req-08630f70-afee-4de2-bd09-166dbaefda32 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks [] for floatingip, precommit_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:08.380241 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-c5c9b678-5ba6-4c76-b5cb-49aa374e3de7 req-08630f70-afee-4de2-bd09-166dbaefda32 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1716406'] for floatingip, after_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:08.380564 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.db.l3_db [req-c5c9b678-5ba6-4c76-b5cb-49aa374e3de7 req-08630f70-afee-4de2-bd09-166dbaefda32 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Floating IP c7ecb693-5f6e-4ba1-8ca3-7b8bb589a5e2 disassociated. External IP: 172.27.1.87, port: bf6cb901-c636-412a-a039-07c3de645700.
May 20 04:39:08.380865 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [req-c5c9b678-5ba6-4c76-b5cb-49aa374e3de7 req-08630f70-afee-4de2-bd09-166dbaefda32 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Calling delete_port for bf6cb901-c636-412a-a039-07c3de645700 owned by compute:nova {{(pid=91687) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 04:39:08.418969 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-936ae0c3-f430-4727-95e0-ce456a271a2a req-d18f7fca-9306-47cf-8c4b-499c45f003fb tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:39:08.420404 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-936ae0c3-f430-4727-95e0-ce456a271a2a req-d18f7fca-9306-47cf-8c4b-499c45f003fb tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/ports?device_id=07f99f96-db26-415e-8236-fd725875cfa9 HTTP/1.1" status: 200  len: 945 time: 0.1868119
May 20 04:39:08.477939 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-936ae0c3-f430-4727-95e0-ce456a271a2a req-0d7e5a19-07a6-457b-bcc7-753861192ca6 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/security-groups?id=e768b0f4-c941-4d5f-8537-5a1cf9061de6&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0509083
May 20 04:39:08.651252 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-c5c9b678-5ba6-4c76-b5cb-49aa374e3de7 req-08630f70-afee-4de2-bd09-166dbaefda32 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8782892522936', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8782892108804', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4162192'] for port, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:08.659817 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-da6d132e-ab40-4060-9652-05803b708f43 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:39:08.704334 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08630f70-afee-4de2-bd09-166dbaefda32 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Pushing event deleted for resources: {'Port': ['ID=bf6cb901-c636-412a-a039-07c3de645700,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:39:08.714739 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08630f70-afee-4de2-bd09-166dbaefda32 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:39:08.715108 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08630f70-afee-4de2-bd09-166dbaefda32 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:39:08.715509 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08630f70-afee-4de2-bd09-166dbaefda32 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:39:08.715871 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08630f70-afee-4de2-bd09-166dbaefda32 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:39:08.716229 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08630f70-afee-4de2-bd09-166dbaefda32 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:39:08.716555 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08630f70-afee-4de2-bd09-166dbaefda32 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:39:08.716910 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08630f70-afee-4de2-bd09-166dbaefda32 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:39:08.717313 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08630f70-afee-4de2-bd09-166dbaefda32 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:39:08.717663 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08630f70-afee-4de2-bd09-166dbaefda32 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:39:08.718011 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08630f70-afee-4de2-bd09-166dbaefda32 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:39:08.718355 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08630f70-afee-4de2-bd09-166dbaefda32 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:39:08.718697 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08630f70-afee-4de2-bd09-166dbaefda32 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:39:08.722428 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-08630f70-afee-4de2-bd09-166dbaefda32 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.063s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:39:08.907517 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.l3_agent_scheduler [req-c5c9b678-5ba6-4c76-b5cb-49aa374e3de7 req-08630f70-afee-4de2-bd09-166dbaefda32 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Router d4b509ec-ef18-4627-a6cf-1d7baff4e160 has already been hosted by L3 agent 02733fc0-fc9c-4e29-bc03-c27a792d539d {{(pid=91687) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 04:39:09.093830 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-c5c9b678-5ba6-4c76-b5cb-49aa374e3de7 req-08630f70-afee-4de2-bd09-166dbaefda32 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify agent at l3_agent.dv-cinder-790910-4-iscsi the message routers_updated {{(pid=91687) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 04:39:09.105480 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5947f042-e971-40b0-810c-d4d75025b516 None None] Sync routers for ids ['d4b509ec-ef18-4627-a6cf-1d7baff4e160'] in dv-cinder-790910-4-iscsi {{(pid=91689) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 04:39:09.115959 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5947f042-e971-40b0-810c-d4d75025b516 None None] Routers {'d4b509ec-ef18-4627-a6cf-1d7baff4e160'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91689) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:39:09.116681 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-5947f042-e971-40b0-810c-d4d75025b516 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced2468a30>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:39:03Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['d4b509ec-ef18-4627-a6cf-1d7baff4e160'], 'active': True} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:39:09.168148 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.l3_dvrscheduler_db [req-c5c9b678-5ba6-4c76-b5cb-49aa374e3de7 req-08630f70-afee-4de2-bd09-166dbaefda32 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] No DVR routers for this DVR port bf6cb901-c636-412a-a039-07c3de645700 on host hv-cinder-79091 {{(pid=91687) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 04:39:09.170921 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-c5c9b678-5ba6-4c76-b5cb-49aa374e3de7 req-08630f70-afee-4de2-bd09-166dbaefda32 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for port, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:09.174059 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '07f99f96-db26-415e-8236-fd725875cfa9', 'name': 'network-vif-deleted', 'tag': 'bf6cb901-c636-412a-a039-07c3de645700'}] {{(pid=91687) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:39:09.191048 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-c5c9b678-5ba6-4c76-b5cb-49aa374e3de7 req-08630f70-afee-4de2-bd09-166dbaefda32 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.82 "DELETE /v2.0/ports/bf6cb901-c636-412a-a039-07c3de645700 HTTP/1.1" status: 204  len: 173 time: 1.4219532
May 20 04:39:09.221131 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '07f99f96-db26-415e-8236-fd725875cfa9', 'name': 'network-vif-deleted', 'tag': 'bf6cb901-c636-412a-a039-07c3de645700', 'status': 'completed', 'code': 200}
May 20 04:39:09.296255 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvr_db [None req-5947f042-e971-40b0-810c-d4d75025b516 None None] Set router d4b509ec-ef18-4627-a6cf-1d7baff4e160 gateway port host: dv-cinder-790910-4-iscsi {{(pid=91689) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:39:09.605293 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-5947f042-e971-40b0-810c-d4d75025b516 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced2468a30>, [{'id': 'd4b509ec-ef18-4627-a6cf-1d7baff4e160', 'name': 'tempest-AttachVolumeTestJSON-1012860640-router', 'tenant_id': '2035da004a584b4ea1f637e593596cd7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.206'}], 'enable_snat': True}, 'gw_port_id': '4e511e4a-69db-4a8c-b460-faca77e2e63e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:33:02Z', 'updated_at': '2021-05-20T04:33:06Z', 'revision_number': 4, 'project_id': '2035da004a584b4ea1f637e593596cd7', 'gw_port': {'id': '4e511e4a-69db-4a8c-b460-faca77e2e63e', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:59:ad', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd4b509ec-ef18-4627-a6cf-1d7baff4e160', 'device_owner': 'network:router_gateway', 'standard_attr_id': 608, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.206', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:33:03Z', 'updated_at': '2021-05-20T04:33:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_interfaces': [{'id': '6bbd99c0-ca71-4a0a-8b11-1bb2be75a9c9', 'name': '', 'network_id': '4c58b50e-1091-40dd-b4fa-ff2da87b1475', 'tenant_id': '2035da004a584b4ea1f637e593596cd7', 'mac_address': 'fa:16:3e:70:97:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd4b509ec-ef18-4627-a6cf-1d7baff4e160', 'device_owner': 'network:router_interface', 'standard_attr_id': 609, 'fixed_ips': [{'subnet_id': '24a65302-95b2-4d66-9d40-a9959babbe40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:33:05Z', 'updated_at': '2021-05-20T04:33:11Z', 'revision_number': 5, 'project_id': '2035da004a584b4ea1f637e593596cd7', 'subnets': [{'id': '24a65302-95b2-4d66-9d40-a9959babbe40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:39:09.609573 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5947f042-e971-40b0-810c-d4d75025b516 None None] Checking router: d4b509ec-ef18-4627-a6cf-1d7baff4e160 for host: dv-cinder-790910-4-iscsi {{(pid=91689) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 04:39:09.618591 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5947f042-e971-40b0-810c-d4d75025b516 None None] Routers {'d4b509ec-ef18-4627-a6cf-1d7baff4e160'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91689) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:39:09.619457 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-5947f042-e971-40b0-810c-d4d75025b516 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced2468a30>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:39:03Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['d4b509ec-ef18-4627-a6cf-1d7baff4e160'], 'active': True} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:39:09.653225 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-2f10b6ad-cc71-4b04-8922-7e1fde3e362c req-b8d448b0-59a9-44bf-bd44-28f4915002c3 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Synchronizing usage tracker for tenant:2035da004a584b4ea1f637e593596cd7 on resource:port {{(pid=91687) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:39:09.670719 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-2f10b6ad-cc71-4b04-8922-7e1fde3e362c req-b8d448b0-59a9-44bf-bd44-28f4915002c3 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Unset dirty status for tenant:2035da004a584b4ea1f637e593596cd7 on resource:port {{(pid=91687) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:39:09.672082 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-2f10b6ad-cc71-4b04-8922-7e1fde3e362c req-b8d448b0-59a9-44bf-bd44-28f4915002c3 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/ports?device_id=07f99f96-db26-415e-8236-fd725875cfa9 HTTP/1.1" status: 200  len: 210 time: 0.0699079
May 20 04:39:09.844112 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvr_db [None req-5947f042-e971-40b0-810c-d4d75025b516 None None] Set router d4b509ec-ef18-4627-a6cf-1d7baff4e160 gateway port host: dv-cinder-790910-4-iscsi {{(pid=91689) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:39:10.171642 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-5947f042-e971-40b0-810c-d4d75025b516 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced2468a30>, [{'id': 'd4b509ec-ef18-4627-a6cf-1d7baff4e160', 'name': 'tempest-AttachVolumeTestJSON-1012860640-router', 'tenant_id': '2035da004a584b4ea1f637e593596cd7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.206'}], 'enable_snat': True}, 'gw_port_id': '4e511e4a-69db-4a8c-b460-faca77e2e63e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:33:02Z', 'updated_at': '2021-05-20T04:33:06Z', 'revision_number': 4, 'project_id': '2035da004a584b4ea1f637e593596cd7', 'gw_port': {'id': '4e511e4a-69db-4a8c-b460-faca77e2e63e', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:59:ad', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd4b509ec-ef18-4627-a6cf-1d7baff4e160', 'device_owner': 'network:router_gateway', 'standard_attr_id': 608, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.206', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:33:03Z', 'updated_at': '2021-05-20T04:33:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_interfaces': [{'id': '6bbd99c0-ca71-4a0a-8b11-1bb2be75a9c9', 'name': '', 'network_id': '4c58b50e-1091-40dd-b4fa-ff2da87b1475', 'tenant_id': '2035da004a584b4ea1f637e593596cd7', 'mac_address': 'fa:16:3e:70:97:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd4b509ec-ef18-4627-a6cf-1d7baff4e160', 'device_owner': 'network:router_interface', 'standard_attr_id': 609, 'fixed_ips': [{'subnet_id': '24a65302-95b2-4d66-9d40-a9959babbe40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:33:05Z', 'updated_at': '2021-05-20T04:33:11Z', 'revision_number': 5, 'project_id': '2035da004a584b4ea1f637e593596cd7', 'subnets': [{'id': '24a65302-95b2-4d66-9d40-a9959babbe40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:39:10.175926 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5947f042-e971-40b0-810c-d4d75025b516 None None] The sync data for ids ['d4b509ec-ef18-4627-a6cf-1d7baff4e160'] in dv-cinder-790910-4-iscsi is: [{'id': 'd4b509ec-ef18-4627-a6cf-1d7baff4e160', 'name': 'tempest-AttachVolumeTestJSON-1012860640-router', 'tenant_id': '2035da004a584b4ea1f637e593596cd7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.206'}], 'enable_snat': True}, 'gw_port_id': '4e511e4a-69db-4a8c-b460-faca77e2e63e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:33:02Z', 'updated_at': '2021-05-20T04:33:06Z', 'revision_number': 4, 'project_id': '2035da004a584b4ea1f637e593596cd7', 'gw_port': {'id': '4e511e4a-69db-4a8c-b460-faca77e2e63e', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:59:ad', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd4b509ec-ef18-4627-a6cf-1d7baff4e160', 'device_owner': 'network:router_gateway', 'standard_attr_id': 608, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.206', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:33:03Z', 'updated_at': '2021-05-20T04:33:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi', '_interfaces': [{'id': '6bbd99c0-ca71-4a0a-8b11-1bb2be75a9c9', 'name': '', 'network_id': '4c58b50e-1091-40dd-b4fa-ff2da87b1475', 'tenant_id': '2035da004a584b4ea1f637e593596cd7', 'mac_address': 'fa:16:3e:70:97:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd4b509ec-ef18-4627-a6cf-1d7baff4e160', 'device_owner': 'network:router_interface', 'standard_attr_id': 609, 'fixed_ips': [{'subnet_id': '24a65302-95b2-4d66-9d40-a9959babbe40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:33:05Z', 'updated_at': '2021-05-20T04:33:11Z', 'revision_number': 5, 'project_id': '2035da004a584b4ea1f637e593596cd7', 'subnets': [{'id': '24a65302-95b2-4d66-9d40-a9959babbe40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91689) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 04:39:10.381467 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8159eba6-204c-4e11-8a3c-d32eea3d526a None None] New status for floating IP c7ecb693-5f6e-4ba1-8ca3-7b8bb589a5e2: DOWN {{(pid=91688) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 20 04:39:10.802719 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 47274) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:39:10.981021 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-b0686635-8131-45df-9b8a-ff79b85ac879 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks [] for security_group, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:11.018680 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-b0686635-8131-45df-9b8a-ff79b85ac879 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks [] for security_group, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:11.077091 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-b0686635-8131-45df-9b8a-ff79b85ac879 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:11.082460 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-d160a3aa-8305-44ef-8931-353b1c33f745 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:39:11.102156 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0686635-8131-45df-9b8a-ff79b85ac879 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=e768b0f4-c941-4d5f-8537-5a1cf9061de6,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:39:11.111103 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0686635-8131-45df-9b8a-ff79b85ac879 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:39:11.111483 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0686635-8131-45df-9b8a-ff79b85ac879 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:39:11.111860 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0686635-8131-45df-9b8a-ff79b85ac879 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:39:11.112215 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0686635-8131-45df-9b8a-ff79b85ac879 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:39:11.112572 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0686635-8131-45df-9b8a-ff79b85ac879 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:39:11.112930 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0686635-8131-45df-9b8a-ff79b85ac879 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:39:11.113333 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0686635-8131-45df-9b8a-ff79b85ac879 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:39:11.113664 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0686635-8131-45df-9b8a-ff79b85ac879 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:39:11.114017 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0686635-8131-45df-9b8a-ff79b85ac879 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:39:11.114382 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0686635-8131-45df-9b8a-ff79b85ac879 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:39:11.114723 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0686635-8131-45df-9b8a-ff79b85ac879 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:39:11.115060 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0686635-8131-45df-9b8a-ff79b85ac879 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:39:11.119842 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-b0686635-8131-45df-9b8a-ff79b85ac879 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:39:11.123384 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-b0686635-8131-45df-9b8a-ff79b85ac879 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks [] for security_group, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:11.124601 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-b0686635-8131-45df-9b8a-ff79b85ac879 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "DELETE /v2.0/security-groups/e768b0f4-c941-4d5f-8537-5a1cf9061de6 HTTP/1.1" status: 204  len: 168 time: 0.3208437
May 20 04:39:11.127367 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 47278) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:39:11.143572 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.api.v2.resource [None req-2268ec8d-bc29-47a5-a77f-8eb3398a6cc3 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] show failed (client error): The resource could not be found.
May 20 04:39:11.144545 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-2268ec8d-bc29-47a5-a77f-8eb3398a6cc3 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "GET /v2.0/security-groups/e768b0f4-c941-4d5f-8537-5a1cf9061de6 HTTP/1.1" status: 404  len: 347 time: 0.0163105
May 20 04:39:11.147855 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 47282) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:39:11.372634 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.plugin [None req-591b8af0-4a52-47bd-97bc-c8d287901aa1 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Deleting port 1f77af04-f9af-47c2-a874-fc26ffa55e2e {{(pid=91686) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 04:39:11.372976 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-591b8af0-4a52-47bd-97bc-c8d287901aa1 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8782892520551'] for port, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:11.496217 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-591b8af0-4a52-47bd-97bc-c8d287901aa1 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1718922'] for port, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:11.496546 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-591b8af0-4a52-47bd-97bc-c8d287901aa1 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:11.614558 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.plugin [None req-591b8af0-4a52-47bd-97bc-c8d287901aa1 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Calling delete_port for 1f77af04-f9af-47c2-a874-fc26ffa55e2e owned by network:floatingip {{(pid=91686) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 04:39:11.737283 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-591b8af0-4a52-47bd-97bc-c8d287901aa1 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8782892522936', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8782892108804', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2145052'] for port, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:11.740830 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-da9bf0a5-2da9-4ded-94e3-1761874afc0b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:39:11.782888 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-591b8af0-4a52-47bd-97bc-c8d287901aa1 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Pushing event deleted for resources: {'Port': ['ID=1f77af04-f9af-47c2-a874-fc26ffa55e2e,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:39:11.786110 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-591b8af0-4a52-47bd-97bc-c8d287901aa1 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:39:11.878163 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-591b8af0-4a52-47bd-97bc-c8d287901aa1 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks [] for floatingip, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:11.900413 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-591b8af0-4a52-47bd-97bc-c8d287901aa1 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for floatingip, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:11.901747 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-591b8af0-4a52-47bd-97bc-c8d287901aa1 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] 10.222.0.71 "DELETE /v2.0/floatingips/c7ecb693-5f6e-4ba1-8ca3-7b8bb589a5e2 HTTP/1.1" status: 204  len: 168 time: 0.7529328
May 20 04:39:12.263490 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device bf6cb901-c636-412a-a039-07c3de645700 no longer exists at agent hyperv_hv-cinder-79091 {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 04:39:12.297648 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] No Port match for: bf6cb901-c636-412a-a039-07c3de645700 {{(pid=91688) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 04:39:12.297909 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device bf6cb901-c636-412a-a039-07c3de645700 not bound to the agent host hv-cinder-79091 {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 04:39:16.127039 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 47312) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:39:16.855667 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-827a7ab5-7a20-46de-992d-6c4eb3c30e47 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1716300'] for router_interface, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:17.392107 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.plugin [None req-827a7ab5-7a20-46de-992d-6c4eb3c30e47 admin admin] Deleting port 6bbd99c0-ca71-4a0a-8b11-1bb2be75a9c9 {{(pid=91686) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 04:39:17.393276 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-827a7ab5-7a20-46de-992d-6c4eb3c30e47 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8782892520551'] for port, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:17.528538 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.db [None req-827a7ab5-7a20-46de-992d-6c4eb3c30e47 admin admin] For port 6bbd99c0-ca71-4a0a-8b11-1bb2be75a9c9, host dv-cinder-790910-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=6bbd99c0-ca71-4a0a-8b11-1bb2be75a9c9,segment=NetworkSegment(12af0450-da1a-4552-85ca-9149ff5b7f01),segment_id=12af0450-da1a-4552-85ca-9149ff5b7f01)] {{(pid=91686) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:39:17.528846 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-827a7ab5-7a20-46de-992d-6c4eb3c30e47 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1718922'] for port, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:17.649039 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.plugin [None req-827a7ab5-7a20-46de-992d-6c4eb3c30e47 admin admin] Calling delete_port for 6bbd99c0-ca71-4a0a-8b11-1bb2be75a9c9 owned by network:router_interface {{(pid=91686) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 04:39:17.822076 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-827a7ab5-7a20-46de-992d-6c4eb3c30e47 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8782892522936', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8782892108804', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2145052'] for port, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:17.825787 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:39:17.873327 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-827a7ab5-7a20-46de-992d-6c4eb3c30e47 admin admin] Pushing event deleted for resources: {'Port': ['ID=6bbd99c0-ca71-4a0a-8b11-1bb2be75a9c9,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:39:17.876471 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-827a7ab5-7a20-46de-992d-6c4eb3c30e47 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:39:18.140728 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-827a7ab5-7a20-46de-992d-6c4eb3c30e47 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1781439', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1717212'] for router_interface, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:18.625452 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-827a7ab5-7a20-46de-992d-6c4eb3c30e47 admin admin] Router d4b509ec-ef18-4627-a6cf-1d7baff4e160 has already been hosted by L3 agent 02733fc0-fc9c-4e29-bc03-c27a792d539d {{(pid=91686) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 20 04:39:18.803726 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-827a7ab5-7a20-46de-992d-6c4eb3c30e47 admin admin] Notify agent at l3_agent.dv-cinder-790910-4-iscsi the message routers_updated {{(pid=91686) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 20 04:39:18.812905 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-84b2599e-fd82-4c17-8d59-e6bd878a5ac0 None None] Sync routers for ids ['d4b509ec-ef18-4627-a6cf-1d7baff4e160'] in dv-cinder-790910-4-iscsi {{(pid=91689) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 20 04:39:18.816583 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-827a7ab5-7a20-46de-992d-6c4eb3c30e47 admin admin] 10.222.0.71 "PUT /v2.0/routers/d4b509ec-ef18-4627-a6cf-1d7baff4e160/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.6885555
May 20 04:39:18.819168 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 47318) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:39:18.823551 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-84b2599e-fd82-4c17-8d59-e6bd878a5ac0 None None] Routers {'d4b509ec-ef18-4627-a6cf-1d7baff4e160'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91689) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:39:18.824167 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-84b2599e-fd82-4c17-8d59-e6bd878a5ac0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced19a0430>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:39:03Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['d4b509ec-ef18-4627-a6cf-1d7baff4e160'], 'active': True} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:39:18.998654 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-d2cfbb30-59af-438d-9b1a-7ad1ef4a11ad admin admin] Notify callbacks [] for router, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:19.002540 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvr_db [None req-84b2599e-fd82-4c17-8d59-e6bd878a5ac0 None None] Set router d4b509ec-ef18-4627-a6cf-1d7baff4e160 gateway port host: dv-cinder-790910-4-iscsi {{(pid=91689) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:39:19.186116 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-d2cfbb30-59af-438d-9b1a-7ad1ef4a11ad admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:19.263778 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.plugin [None req-d2cfbb30-59af-438d-9b1a-7ad1ef4a11ad admin admin] Deleting port 4e511e4a-69db-4a8c-b460-faca77e2e63e {{(pid=91686) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 04:39:19.264133 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-d2cfbb30-59af-438d-9b1a-7ad1ef4a11ad admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8782892520551'] for port, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:19.298990 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-84b2599e-fd82-4c17-8d59-e6bd878a5ac0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced19a0430>, [{'id': 'd4b509ec-ef18-4627-a6cf-1d7baff4e160', 'name': 'tempest-AttachVolumeTestJSON-1012860640-router', 'tenant_id': '2035da004a584b4ea1f637e593596cd7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'external_fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.206'}], 'enable_snat': True}, 'gw_port_id': '4e511e4a-69db-4a8c-b460-faca77e2e63e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:33:02Z', 'updated_at': '2021-05-20T04:39:17Z', 'revision_number': 5, 'project_id': '2035da004a584b4ea1f637e593596cd7', 'gw_port': {'id': '4e511e4a-69db-4a8c-b460-faca77e2e63e', 'name': '', 'network_id': 'aec557db-0c02-4008-8c9f-2efcd7462f90', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:59:ad', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd4b509ec-ef18-4627-a6cf-1d7baff4e160', 'device_owner': 'network:router_gateway', 'standard_attr_id': 608, 'fixed_ips': [{'subnet_id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'ip_address': '172.27.1.206', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790910-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-20T04:33:03Z', 'updated_at': '2021-05-20T04:33:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '217f4b55-4415-4d57-8b43-2ff4c8ac8e81', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790910-4-iscsi'}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:39:19.303650 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-84b2599e-fd82-4c17-8d59-e6bd878a5ac0 None None] Checking router: d4b509ec-ef18-4627-a6cf-1d7baff4e160 for host: dv-cinder-790910-4-iscsi {{(pid=91689) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 20 04:39:19.316276 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-84b2599e-fd82-4c17-8d59-e6bd878a5ac0 None None] Routers {'d4b509ec-ef18-4627-a6cf-1d7baff4e160'} bound to L3 agent in host dv-cinder-790910-4-iscsi {{(pid=91689) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 20 04:39:19.317232 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-84b2599e-fd82-4c17-8d59-e6bd878a5ac0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fced19a0430>, 'dv-cinder-790910-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-05-20T04:13:33Z,description=<?>,heartbeat_timestamp=2021-05-20T04:39:03Z,host='dv-cinder-790910-4-iscsi',id=02733fc0-fc9c-4e29-bc03-c27a792d539d,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-20T04:13:33Z,topic='l3_agent')) {'router_ids': ['d4b509ec-ef18-4627-a6cf-1d7baff4e160'], 'active': True} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:39:19.403623 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.db [None req-d2cfbb30-59af-438d-9b1a-7ad1ef4a11ad admin admin] For port 4e511e4a-69db-4a8c-b460-faca77e2e63e, host dv-cinder-790910-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=4e511e4a-69db-4a8c-b460-faca77e2e63e,segment=NetworkSegment(8df49ec5-3fb9-4715-bc9a-f4019a6b55f9),segment_id=8df49ec5-3fb9-4715-bc9a-f4019a6b55f9)] {{(pid=91686) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:39:19.403980 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-d2cfbb30-59af-438d-9b1a-7ad1ef4a11ad admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1718922'] for port, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:19.469518 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_dvr_db [None req-84b2599e-fd82-4c17-8d59-e6bd878a5ac0 None None] Set router d4b509ec-ef18-4627-a6cf-1d7baff4e160 gateway port host: None {{(pid=91689) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 20 04:39:19.525706 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.plugin [None req-d2cfbb30-59af-438d-9b1a-7ad1ef4a11ad admin admin] Calling delete_port for 4e511e4a-69db-4a8c-b460-faca77e2e63e owned by network:router_gateway {{(pid=91686) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 04:39:19.572920 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.l3_hamode_db [None req-84b2599e-fd82-4c17-8d59-e6bd878a5ac0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fced19a0430>, [{'id': 'd4b509ec-ef18-4627-a6cf-1d7baff4e160', 'name': 'tempest-AttachVolumeTestJSON-1012860640-router', 'tenant_id': '2035da004a584b4ea1f637e593596cd7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:33:02Z', 'updated_at': '2021-05-20T04:39:19Z', 'revision_number': 6, 'project_id': '2035da004a584b4ea1f637e593596cd7', 'gw_port_host': None}], 'dv-cinder-790910-4-iscsi', False) {} {{(pid=91689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:39:19.581010 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-84b2599e-fd82-4c17-8d59-e6bd878a5ac0 None None] The sync data for ids ['d4b509ec-ef18-4627-a6cf-1d7baff4e160'] in dv-cinder-790910-4-iscsi is: [{'id': 'd4b509ec-ef18-4627-a6cf-1d7baff4e160', 'name': 'tempest-AttachVolumeTestJSON-1012860640-router', 'tenant_id': '2035da004a584b4ea1f637e593596cd7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-20T04:33:02Z', 'updated_at': '2021-05-20T04:39:19Z', 'revision_number': 6, 'project_id': '2035da004a584b4ea1f637e593596cd7', 'gw_port_host': None}] {{(pid=91689) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 20 04:39:19.668889 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-d2cfbb30-59af-438d-9b1a-7ad1ef4a11ad admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8782892522936', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8782892108804', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2145052'] for port, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:19.672778 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-4106871b-3275-457c-8d5d-1558ca83c6b2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:39:19.715642 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2cfbb30-59af-438d-9b1a-7ad1ef4a11ad admin admin] Pushing event deleted for resources: {'Port': ['ID=4e511e4a-69db-4a8c-b460-faca77e2e63e,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:39:19.718781 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-d2cfbb30-59af-438d-9b1a-7ad1ef4a11ad admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:39:19.813909 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-d2cfbb30-59af-438d-9b1a-7ad1ef4a11ad admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1714023'] for router_gateway, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:20.110473 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-d2cfbb30-59af-438d-9b1a-7ad1ef4a11ad admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1796572', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-6237'] for router, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:20.112894 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-d2cfbb30-59af-438d-9b1a-7ad1ef4a11ad admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:20.139202 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-d2cfbb30-59af-438d-9b1a-7ad1ef4a11ad admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-1712688'] for router, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:20.139718 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d2cfbb30-59af-438d-9b1a-7ad1ef4a11ad admin admin] Fanout notify agent at l3_agent the message router_deleted on router d4b509ec-ef18-4627-a6cf-1d7baff4e160 {{(pid=91686) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 20 04:39:20.153564 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-d2cfbb30-59af-438d-9b1a-7ad1ef4a11ad admin admin] Notify callbacks [] for router, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:20.154682 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-d2cfbb30-59af-438d-9b1a-7ad1ef4a11ad admin admin] 10.222.0.71 "DELETE /v2.0/routers/d4b509ec-ef18-4627-a6cf-1d7baff4e160 HTTP/1.1" status: 204  len: 168 time: 1.3346140
May 20 04:39:20.157299 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 47324) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:39:20.228219 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.db_base_plugin_v2 [None req-b063ca28-2d90-4688-8250-1cd25a72b639 admin admin] Deleting subnet 24a65302-95b2-4d66-9d40-a9959babbe40 {{(pid=91686) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 20 04:39:20.231400 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-b063ca28-2d90-4688-8250-1cd25a72b639 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:20.282737 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-b063ca28-2d90-4688-8250-1cd25a72b639 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4081462'] for subnet, precommit_delete_associations {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:20.370520 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-b063ca28-2d90-4688-8250-1cd25a72b639 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1504133'] for subnet, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:20.626042 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-b063ca28-2d90-4688-8250-1cd25a72b639 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1504178', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-255887', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2114755', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2442237'] for subnet, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:20.629793 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-b6fd1a16-26ae-4eb4-ad56-4b37f13e55ce admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:39:20.663188 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b063ca28-2d90-4688-8250-1cd25a72b639 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=24a65302-95b2-4d66-9d40-a9959babbe40,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:39:20.666176 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-b063ca28-2d90-4688-8250-1cd25a72b639 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:39:20.667130 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-b063ca28-2d90-4688-8250-1cd25a72b639 admin admin] Notify callbacks [] for subnet, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:20.673096 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-b063ca28-2d90-4688-8250-1cd25a72b639 admin admin] 10.222.0.71 "DELETE /v2.0/subnets/24a65302-95b2-4d66-9d40-a9959babbe40 HTTP/1.1" status: 204  len: 168 time: 0.5147820
May 20 04:39:20.673691 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-03873ec8-cbac-4439-b42b-53f6ba30222f None None] Network 4c58b50e-1091-40dd-b4fa-ff2da87b1475 requested from dv-cinder-790910-4-iscsi {{(pid=91688) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 04:39:20.675727 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 47328) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:39:20.780925 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-e4e069a5-14e3-4dce-a6e2-f2c390816c2a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-593149'] for network, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:20.856946 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.plugin [None req-e4e069a5-14e3-4dce-a6e2-f2c390816c2a admin admin] Deleting port afceb3be-dac0-4a64-8295-7d082bff4ea3 {{(pid=91686) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 04:39:20.857316 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-e4e069a5-14e3-4dce-a6e2-f2c390816c2a admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8782892520551'] for port, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:20.954804 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.db [None req-e4e069a5-14e3-4dce-a6e2-f2c390816c2a admin admin] For port afceb3be-dac0-4a64-8295-7d082bff4ea3, host dv-cinder-790910-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=afceb3be-dac0-4a64-8295-7d082bff4ea3,segment=NetworkSegment(12af0450-da1a-4552-85ca-9149ff5b7f01),segment_id=12af0450-da1a-4552-85ca-9149ff5b7f01)] {{(pid=91686) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:39:20.954804 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-e4e069a5-14e3-4dce-a6e2-f2c390816c2a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1718922'] for port, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:20.960107 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0f7f5af6-83c9-4c78-8aed-642850836ac9 None None] DHCP port deletion for 4c58b50e-1091-40dd-b4fa-ff2da87b1475 request from dv-cinder-790910-4-iscsi {{(pid=91688) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
May 20 04:39:21.026587 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-0f7f5af6-83c9-4c78-8aed-642850836ac9 None None] Deleting port afceb3be-dac0-4a64-8295-7d082bff4ea3 {{(pid=91688) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 04:39:21.026962 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-0f7f5af6-83c9-4c78-8aed-642850836ac9 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8782892520551'] for port, before_delete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:21.079159 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.plugin [None req-e4e069a5-14e3-4dce-a6e2-f2c390816c2a admin admin] Calling delete_port for afceb3be-dac0-4a64-8295-7d082bff4ea3 owned by network:dhcp {{(pid=91686) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 04:39:21.124752 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-0f7f5af6-83c9-4c78-8aed-642850836ac9 None None] For port afceb3be-dac0-4a64-8295-7d082bff4ea3, host dv-cinder-790910-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790910-4-iscsi',level=0,port_id=afceb3be-dac0-4a64-8295-7d082bff4ea3,segment=NetworkSegment(12af0450-da1a-4552-85ca-9149ff5b7f01),segment_id=12af0450-da1a-4552-85ca-9149ff5b7f01)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:39:21.125314 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-0f7f5af6-83c9-4c78-8aed-642850836ac9 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1718922'] for port, precommit_delete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:21.128421 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-e4e069a5-14e3-4dce-a6e2-f2c390816c2a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8782892522936', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8782892108804', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2145052'] for port, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:21.132498 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:39:21.174622 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4e069a5-14e3-4dce-a6e2-f2c390816c2a admin admin] Pushing event deleted for resources: {'Port': ['ID=afceb3be-dac0-4a64-8295-7d082bff4ea3,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:39:21.177277 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-e4e069a5-14e3-4dce-a6e2-f2c390816c2a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:39:21.181809 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e4e069a5-14e3-4dce-a6e2-f2c390816c2a admin admin] No DVR routers for this DVR port afceb3be-dac0-4a64-8295-7d082bff4ea3 on host dv-cinder-790910-4-iscsi {{(pid=91686) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 04:39:21.246188 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-0f7f5af6-83c9-4c78-8aed-642850836ac9 None None] Calling delete_port for afceb3be-dac0-4a64-8295-7d082bff4ea3 owned by network:dhcp {{(pid=91688) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 04:39:21.292294 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-0f7f5af6-83c9-4c78-8aed-642850836ac9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8782892522936', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8782892108804'] for port, after_delete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:21.295906 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-aab6e702-59a8-4a15-a61c-e47cf96127f8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:39:21.296507 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-e4e069a5-14e3-4dce-a6e2-f2c390816c2a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1505550', 'neutron.services.segments.db._delete_segments_for_network-8782892550274'] for network, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:21.309515 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.services.segments.db [None req-e4e069a5-14e3-4dce-a6e2-f2c390816c2a admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fced0e8adc0>,) {'filters': {'network_id': ['4c58b50e-1091-40dd-b4fa-ff2da87b1475']}} {{(pid=91686) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:39:21.323051 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.services.segments.db [None req-e4e069a5-14e3-4dce-a6e2-f2c390816c2a admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fced0e8adc0>, '12af0450-da1a-4552-85ca-9149ff5b7f01') {'for_net_delete': True} {{(pid=91686) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:39:21.323051 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.services.segments.db [None req-e4e069a5-14e3-4dce-a6e2-f2c390816c2a admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fced0e8adc0>, '12af0450-da1a-4552-85ca-9149ff5b7f01') {} {{(pid=91686) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:39:21.334338 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-e4e069a5-14e3-4dce-a6e2-f2c390816c2a admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8782892560523', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4081441'] for segment, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:21.340388 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f7f5af6-83c9-4c78-8aed-642850836ac9 None None] Pushing event deleted for resources: {'Port': ['ID=afceb3be-dac0-4a64-8295-7d082bff4ea3,revision_number=None']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:39:21.345306 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0f7f5af6-83c9-4c78-8aed-642850836ac9 None None] No DVR routers for this DVR port afceb3be-dac0-4a64-8295-7d082bff4ea3 on host dv-cinder-790910-4-iscsi {{(pid=91688) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 04:39:21.351280 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0f7f5af6-83c9-4c78-8aed-642850836ac9 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:39:21.351624 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0f7f5af6-83c9-4c78-8aed-642850836ac9 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:39:21.351956 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0f7f5af6-83c9-4c78-8aed-642850836ac9 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:39:21.352290 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0f7f5af6-83c9-4c78-8aed-642850836ac9 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:39:21.352609 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0f7f5af6-83c9-4c78-8aed-642850836ac9 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:39:21.353151 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0f7f5af6-83c9-4c78-8aed-642850836ac9 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:39:21.353479 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0f7f5af6-83c9-4c78-8aed-642850836ac9 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:39:21.354203 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0f7f5af6-83c9-4c78-8aed-642850836ac9 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:39:21.354203 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0f7f5af6-83c9-4c78-8aed-642850836ac9 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:39:21.354446 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0f7f5af6-83c9-4c78-8aed-642850836ac9 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:39:21.354727 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0f7f5af6-83c9-4c78-8aed-642850836ac9 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:39:21.355040 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0f7f5af6-83c9-4c78-8aed-642850836ac9 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:39:21.358627 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-0f7f5af6-83c9-4c78-8aed-642850836ac9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.063s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:39:21.364218 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-e4e069a5-14e3-4dce-a6e2-f2c390816c2a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1501910'] for segment, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:21.370787 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e4e069a5-14e3-4dce-a6e2-f2c390816c2a admin admin] Releasing vlan 871 on physical network physnet1 to pool {{(pid=91686) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 20 04:39:21.371165 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-e4e069a5-14e3-4dce-a6e2-f2c390816c2a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1501910', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2145121'] for segment, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:21.380489 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 4e511e4a-69db-4a8c-b460-faca77e2e63e no longer exists at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 04:39:21.388010 dv-cinder-790910-4-iscsi neutron-server[91686]: Traceback (most recent call last):
May 20 04:39:21.388010 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 20 04:39:21.388010 dv-cinder-790910-4-iscsi neutron-server[91686]:     timer()
May 20 04:39:21.388010 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 20 04:39:21.388010 dv-cinder-790910-4-iscsi neutron-server[91686]:     cb(*args, **kw)
May 20 04:39:21.388010 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 20 04:39:21.388010 dv-cinder-790910-4-iscsi neutron-server[91686]:     return func(*args, **kwargs)
May 20 04:39:21.388010 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 20 04:39:21.388010 dv-cinder-790910-4-iscsi neutron-server[91686]:     self._notify()
May 20 04:39:21.388010 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 20 04:39:21.388010 dv-cinder-790910-4-iscsi neutron-server[91686]:     self.callback(batched_events)
May 20 04:39:21.388010 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 20 04:39:21.388010 dv-cinder-790910-4-iscsi neutron-server[91686]:     event.method(event)
May 20 04:39:21.388010 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 20 04:39:21.388010 dv-cinder-790910-4-iscsi neutron-server[91686]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 20 04:39:21.388010 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 20 04:39:21.388010 dv-cinder-790910-4-iscsi neutron-server[91686]:     aggregate_uuid = self.p_client.list_aggregates(
May 20 04:39:21.388010 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 20 04:39:21.388010 dv-cinder-790910-4-iscsi neutron-server[91686]:     return f(self, *a, **k)
May 20 04:39:21.388010 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 20 04:39:21.388010 dv-cinder-790910-4-iscsi neutron-server[91686]:     return self._get(url).json()
May 20 04:39:21.388010 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 20 04:39:21.388010 dv-cinder-790910-4-iscsi neutron-server[91686]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 20 04:39:21.388010 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 20 04:39:21.388010 dv-cinder-790910-4-iscsi neutron-server[91686]:     return self.request(url, 'GET', **kwargs)
May 20 04:39:21.388010 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 20 04:39:21.388010 dv-cinder-790910-4-iscsi neutron-server[91686]:     base_url = self.get_endpoint(auth, allow=allow,
May 20 04:39:21.388010 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 20 04:39:21.388010 dv-cinder-790910-4-iscsi neutron-server[91686]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 20 04:39:21.388010 dv-cinder-790910-4-iscsi neutron-server[91686]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 20 04:39:21.388010 dv-cinder-790910-4-iscsi neutron-server[91686]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 20 04:39:21.388010 dv-cinder-790910-4-iscsi neutron-server[91686]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 20 04:39:21.414106 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] No Port match for: 4e511e4a-69db-4a8c-b460-faca77e2e63e {{(pid=91688) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 04:39:21.414426 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 4e511e4a-69db-4a8c-b460-faca77e2e63e not bound to the agent host dv-cinder-790910-4-iscsi {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 04:39:21.414854 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 6bbd99c0-ca71-4a0a-8b11-1bb2be75a9c9 no longer exists at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 04:39:21.447432 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] No Port match for: 6bbd99c0-ca71-4a0a-8b11-1bb2be75a9c9 {{(pid=91688) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 04:39:21.447706 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device 6bbd99c0-ca71-4a0a-8b11-1bb2be75a9c9 not bound to the agent host dv-cinder-790910-4-iscsi {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 04:39:21.448154 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device afceb3be-dac0-4a64-8295-7d082bff4ea3 no longer exists at agent ovs-agent-dv-cinder-790910-4-iscsi {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 04:39:21.469170 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-e4e069a5-14e3-4dce-a6e2-f2c390816c2a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1505543', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1590664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1781430', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1713996'] for network, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:21.473175 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:39:21.483356 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] No Port match for: afceb3be-dac0-4a64-8295-7d082bff4ea3 {{(pid=91688) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 04:39:21.483707 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Device afceb3be-dac0-4a64-8295-7d082bff4ea3 not bound to the agent host dv-cinder-790910-4-iscsi {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 04:39:21.488820 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-e4e069a5-14e3-4dce-a6e2-f2c390816c2a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for network, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:21.499422 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4e069a5-14e3-4dce-a6e2-f2c390816c2a admin admin] Pushing event deleted for resources: {'Network': ['ID=4c58b50e-1091-40dd-b4fa-ff2da87b1475,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:39:21.505255 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-e4e069a5-14e3-4dce-a6e2-f2c390816c2a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:39:21.517463 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-e4e069a5-14e3-4dce-a6e2-f2c390816c2a admin admin] 10.222.0.71 "DELETE /v2.0/networks/4c58b50e-1091-40dd-b4fa-ff2da87b1475 HTTP/1.1" status: 204  len: 168 time: 0.8406155
May 20 04:39:21.634891 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 47334) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:39:21.686106 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-e29d1d0b-f322-4ea6-b85b-ac63d22f6582 admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=2035da004a584b4ea1f637e593596cd7&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0498261
May 20 04:39:21.688510 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 47338) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:39:21.754125 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-85fd8805-c7aa-4833-b632-c36abf652fb1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:21.782396 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-85fd8805-c7aa-4833-b632-c36abf652fb1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:21.843623 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-85fd8805-c7aa-4833-b632-c36abf652fb1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:21.847599 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-b0686635-8131-45df-9b8a-ff79b85ac879 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:39:21.862039 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85fd8805-c7aa-4833-b632-c36abf652fb1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8f7712f6-fe75-4f69-80ea-9d9af82cf1a5,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:39:21.867503 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-85fd8805-c7aa-4833-b632-c36abf652fb1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:39:21.872405 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-85fd8805-c7aa-4833-b632-c36abf652fb1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:21.876132 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-85fd8805-c7aa-4833-b632-c36abf652fb1 admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/8f7712f6-fe75-4f69-80ea-9d9af82cf1a5 HTTP/1.1" status: 204  len: 168 time: 0.1840653
May 20 04:39:21.956390 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.agents_db [None req-92d61f12-17bc-4bf9-9eab-8a69b8c6da2f None None] Agent healthcheck: found 6 active agents {{(pid=91689) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 04:39:26.900936 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 47424) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:39:27.028006 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-109993ff-c969-4afa-bbe3-d03a1eaddba8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:27.046215 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-109993ff-c969-4afa-bbe3-d03a1eaddba8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:39:27.050631 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-109993ff-c969-4afa-bbe3-d03a1eaddba8 admin admin] Usage tracker for resource:security_group_rule and tenant:23c7612a2f5248bf8f7e920b0d6758ab is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:39:27.053795 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-109993ff-c969-4afa-bbe3-d03a1eaddba8 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:39:27.059892 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-109993ff-c969-4afa-bbe3-d03a1eaddba8 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:39:27.143568 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-109993ff-c969-4afa-bbe3-d03a1eaddba8 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:27.148134 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-109993ff-c969-4afa-bbe3-d03a1eaddba8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:27.156652 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-5735808b-b0ee-4622-b7c2-e642851d7269 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:39:27.202781 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-109993ff-c969-4afa-bbe3-d03a1eaddba8 admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=23c7612a2f5248bf8f7e920b0d6758ab&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3006151
May 20 04:39:27.204381 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-109993ff-c969-4afa-bbe3-d03a1eaddba8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=db3ff861-6aeb-4002-980e-e8c1a0b5cd6a,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:39:27.206173 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 47430) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:39:27.207828 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-109993ff-c969-4afa-bbe3-d03a1eaddba8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:39:27.269768 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-a3482d84-fdcd-4857-8564-d69bca18c7ec admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:27.298613 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-a3482d84-fdcd-4857-8564-d69bca18c7ec admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:27.350596 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-a3482d84-fdcd-4857-8564-d69bca18c7ec admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:27.354478 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-b2176008-7920-4564-836e-9db413016b6b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:39:27.365504 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3482d84-fdcd-4857-8564-d69bca18c7ec admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=db3ff861-6aeb-4002-980e-e8c1a0b5cd6a,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:39:27.368424 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-a3482d84-fdcd-4857-8564-d69bca18c7ec admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:39:27.374462 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-a3482d84-fdcd-4857-8564-d69bca18c7ec admin admin] Notify callbacks [] for security_group, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:27.375581 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-a3482d84-fdcd-4857-8564-d69bca18c7ec admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/db3ff861-6aeb-4002-980e-e8c1a0b5cd6a HTTP/1.1" status: 204  len: 168 time: 0.1684670
May 20 04:39:27.663379 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 47438) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:39:27.681361 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-5253ffdb-ca84-413a-b062-44621334d6bc admin admin] Notify callbacks [] for security_group, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:27.700088 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-5253ffdb-ca84-413a-b062-44621334d6bc admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:39:27.704226 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-5253ffdb-ca84-413a-b062-44621334d6bc admin admin] Usage tracker for resource:security_group_rule and tenant:1d6d215cdace4f2aaa213e67cefaf15a is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:39:27.707279 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-5253ffdb-ca84-413a-b062-44621334d6bc admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:39:27.713480 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-5253ffdb-ca84-413a-b062-44621334d6bc admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:39:27.808200 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-5253ffdb-ca84-413a-b062-44621334d6bc admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:27.813335 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-5253ffdb-ca84-413a-b062-44621334d6bc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:27.820908 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-07e7327a-c0d8-4d60-8335-73d413b05f47 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:39:27.860896 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5253ffdb-ca84-413a-b062-44621334d6bc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1421edd6-78c3-4c57-92d8-58a2b559f93c,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:39:27.865205 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-5253ffdb-ca84-413a-b062-44621334d6bc admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=1d6d215cdace4f2aaa213e67cefaf15a&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2006426
May 20 04:39:27.866149 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-5253ffdb-ca84-413a-b062-44621334d6bc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:39:27.869174 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 47442) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:39:27.931469 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-a74e2842-9653-4787-9ccd-ec576124648a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:27.957562 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-a74e2842-9653-4787-9ccd-ec576124648a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:28.010313 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-a74e2842-9653-4787-9ccd-ec576124648a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:28.014145 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-a7e3788e-1ab8-4001-9892-2638c5e155dd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:39:28.030890 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a74e2842-9653-4787-9ccd-ec576124648a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1421edd6-78c3-4c57-92d8-58a2b559f93c,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:39:28.033799 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-a74e2842-9653-4787-9ccd-ec576124648a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:39:28.035733 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-a74e2842-9653-4787-9ccd-ec576124648a admin admin] Notify callbacks [] for security_group, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:28.036832 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-a74e2842-9653-4787-9ccd-ec576124648a admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/1421edd6-78c3-4c57-92d8-58a2b559f93c HTTP/1.1" status: 204  len: 168 time: 0.1667542
May 20 04:39:29.874239 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-780eec36-d1b8-41f2-b885-9f1a32d42c1d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:30.854375 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 47516) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:39:30.988164 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-d85b4939-f216-4d81-aa63-c14956c88ca9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:31.006267 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-d85b4939-f216-4d81-aa63-c14956c88ca9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:39:31.013171 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-d85b4939-f216-4d81-aa63-c14956c88ca9 admin admin] Usage tracker for resource:security_group_rule and tenant:03ad474aee41492682061f8a259f5b7a is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:39:31.018012 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-d85b4939-f216-4d81-aa63-c14956c88ca9 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:39:31.027697 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-d85b4939-f216-4d81-aa63-c14956c88ca9 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:39:31.121624 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-d85b4939-f216-4d81-aa63-c14956c88ca9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:31.128282 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-d85b4939-f216-4d81-aa63-c14956c88ca9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:31.135226 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-5253ffdb-ca84-413a-b062-44621334d6bc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:39:31.175084 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-d85b4939-f216-4d81-aa63-c14956c88ca9 admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=03ad474aee41492682061f8a259f5b7a&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3196354
May 20 04:39:31.176078 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d85b4939-f216-4d81-aa63-c14956c88ca9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3a78cc3e-b05a-4a4f-a8b8-72f6965e6555,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:39:31.178125 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 47522) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:39:31.179332 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-d85b4939-f216-4d81-aa63-c14956c88ca9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:39:31.338675 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-a6c2ddd0-560e-4809-b9d6-f8cfce3ceed3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:31.365006 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-a6c2ddd0-560e-4809-b9d6-f8cfce3ceed3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:31.421638 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-a6c2ddd0-560e-4809-b9d6-f8cfce3ceed3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:31.427874 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-9cf80be4-f233-4132-a461-b65ad284e92b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:39:31.440452 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6c2ddd0-560e-4809-b9d6-f8cfce3ceed3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3a78cc3e-b05a-4a4f-a8b8-72f6965e6555,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:39:31.443947 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-a6c2ddd0-560e-4809-b9d6-f8cfce3ceed3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:39:31.449634 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-a6c2ddd0-560e-4809-b9d6-f8cfce3ceed3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:31.450750 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-a6c2ddd0-560e-4809-b9d6-f8cfce3ceed3 admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/3a78cc3e-b05a-4a4f-a8b8-72f6965e6555 HTTP/1.1" status: 204  len: 168 time: 0.2714813
May 20 04:39:31.757959 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 47530) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:39:31.777069 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-7faf3b46-d3e7-40d0-9f2e-b864341c1ced admin admin] Notify callbacks [] for security_group, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:31.791918 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-7faf3b46-d3e7-40d0-9f2e-b864341c1ced admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:39:31.796285 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-7faf3b46-d3e7-40d0-9f2e-b864341c1ced admin admin] Usage tracker for resource:security_group_rule and tenant:74f863e201cb4583b49e80b0624d43c1 is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:39:31.799462 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-7faf3b46-d3e7-40d0-9f2e-b864341c1ced admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:39:31.806045 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-7faf3b46-d3e7-40d0-9f2e-b864341c1ced admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:39:31.891961 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-7faf3b46-d3e7-40d0-9f2e-b864341c1ced admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:31.897081 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-7faf3b46-d3e7-40d0-9f2e-b864341c1ced admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:31.909847 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-abb57e17-d13d-471f-a746-4d52522cef47 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:39:31.948933 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-7faf3b46-d3e7-40d0-9f2e-b864341c1ced admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=74f863e201cb4583b49e80b0624d43c1&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1898694
May 20 04:39:31.949830 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7faf3b46-d3e7-40d0-9f2e-b864341c1ced admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=447eccc9-e77a-447e-9b71-a6d1d9e57dfa,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:39:31.952158 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 47534) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:39:31.953344 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-7faf3b46-d3e7-40d0-9f2e-b864341c1ced admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:39:32.016705 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-76e933c8-9c75-4f29-ad25-3157e33e88b0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:32.043291 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-76e933c8-9c75-4f29-ad25-3157e33e88b0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:32.097625 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-76e933c8-9c75-4f29-ad25-3157e33e88b0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:32.101262 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-a93e2006-7f00-4fa3-8cfc-769a7c836ad8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:39:32.113873 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76e933c8-9c75-4f29-ad25-3157e33e88b0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=447eccc9-e77a-447e-9b71-a6d1d9e57dfa,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:39:32.116762 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-76e933c8-9c75-4f29-ad25-3157e33e88b0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:39:32.118714 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-76e933c8-9c75-4f29-ad25-3157e33e88b0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:32.119806 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-76e933c8-9c75-4f29-ad25-3157e33e88b0 admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/447eccc9-e77a-447e-9b71-a6d1d9e57dfa HTTP/1.1" status: 204  len: 168 time: 0.1664872
May 20 04:39:32.595185 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:32.758772 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-d927448f-6465-4481-98aa-5f815cac0b87 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:33.407540 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ea4803bd-878f-47d5-9084-1ec41953c9db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:34.996615 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 47606) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:39:35.125122 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-324e2bea-995a-4af8-8a39-ef21bdf29735 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:35.141846 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-324e2bea-995a-4af8-8a39-ef21bdf29735 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:39:35.146464 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-324e2bea-995a-4af8-8a39-ef21bdf29735 admin admin] Usage tracker for resource:security_group_rule and tenant:3a028f3234dd40c2aa9872c14962dda7 is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:39:35.149649 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-324e2bea-995a-4af8-8a39-ef21bdf29735 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:39:35.155963 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-324e2bea-995a-4af8-8a39-ef21bdf29735 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:39:35.246280 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-324e2bea-995a-4af8-8a39-ef21bdf29735 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:35.251682 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-324e2bea-995a-4af8-8a39-ef21bdf29735 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:35.257395 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f21320cc-6a25-4ec1-8a32-8b119b35fd55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:35.261344 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-a3482d84-fdcd-4857-8564-d69bca18c7ec admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:39:35.299965 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-324e2bea-995a-4af8-8a39-ef21bdf29735 admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=3a028f3234dd40c2aa9872c14962dda7&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3021886
May 20 04:39:35.301770 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-324e2bea-995a-4af8-8a39-ef21bdf29735 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d0d1b812-aeeb-4c59-8cd8-6b4d05a5d380,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:39:35.303130 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 47616) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:39:35.305292 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-324e2bea-995a-4af8-8a39-ef21bdf29735 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:39:35.366079 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-85158903-ac67-46d0-82ef-40613f88ccae admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:35.391626 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-85158903-ac67-46d0-82ef-40613f88ccae admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:35.446325 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-85158903-ac67-46d0-82ef-40613f88ccae admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:35.450484 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-a6c2ddd0-560e-4809-b9d6-f8cfce3ceed3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:39:35.461583 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85158903-ac67-46d0-82ef-40613f88ccae admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d0d1b812-aeeb-4c59-8cd8-6b4d05a5d380,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:39:35.464277 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-85158903-ac67-46d0-82ef-40613f88ccae admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:39:35.470289 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-85158903-ac67-46d0-82ef-40613f88ccae admin admin] Notify callbacks [] for security_group, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:35.471413 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-85158903-ac67-46d0-82ef-40613f88ccae admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/d0d1b812-aeeb-4c59-8cd8-6b4d05a5d380 HTTP/1.1" status: 204  len: 168 time: 0.1672440
May 20 04:39:35.768528 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 47624) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:39:35.787233 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-f9cc7b7f-6811-498b-a90a-701216edc71d admin admin] Notify callbacks [] for security_group, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:35.802420 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-f9cc7b7f-6811-498b-a90a-701216edc71d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:39:35.806731 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-f9cc7b7f-6811-498b-a90a-701216edc71d admin admin] Usage tracker for resource:security_group_rule and tenant:1f89cc43c7f546feae77ad56617becd8 is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:39:35.810000 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-f9cc7b7f-6811-498b-a90a-701216edc71d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:39:35.816168 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-f9cc7b7f-6811-498b-a90a-701216edc71d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:39:35.906359 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-f9cc7b7f-6811-498b-a90a-701216edc71d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:35.910947 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-f9cc7b7f-6811-498b-a90a-701216edc71d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:35.917722 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-f3a5240b-cf55-42bf-bdb4-e0167114270f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:39:35.958133 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-f9cc7b7f-6811-498b-a90a-701216edc71d admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=1f89cc43c7f546feae77ad56617becd8&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1885359
May 20 04:39:35.959044 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9cc7b7f-6811-498b-a90a-701216edc71d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5c8a6245-bbf5-4e43-be5c-bf2a79f392f2,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:39:35.961190 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 47628) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:39:35.962188 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-f9cc7b7f-6811-498b-a90a-701216edc71d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:39:36.024329 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-b7a4d796-70ca-4d6b-9dc5-744bf3f5af06 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:36.053502 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-b7a4d796-70ca-4d6b-9dc5-744bf3f5af06 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:36.115196 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-b7a4d796-70ca-4d6b-9dc5-744bf3f5af06 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:36.120500 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-bab68ab2-3c6e-449e-a701-e599b80371ac admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:39:36.139172 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7a4d796-70ca-4d6b-9dc5-744bf3f5af06 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5c8a6245-bbf5-4e43-be5c-bf2a79f392f2,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:39:36.143182 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-b7a4d796-70ca-4d6b-9dc5-744bf3f5af06 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:39:36.157511 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-b7a4d796-70ca-4d6b-9dc5-744bf3f5af06 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:36.158639 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-b7a4d796-70ca-4d6b-9dc5-744bf3f5af06 admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/5c8a6245-bbf5-4e43-be5c-bf2a79f392f2 HTTP/1.1" status: 204  len: 168 time: 0.1963897
May 20 04:39:36.677743 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:40.894080 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 47696) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:39:41.014636 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-702a0219-b5d2-4453-ac49-d03083e26ef8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:41.029743 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-702a0219-b5d2-4453-ac49-d03083e26ef8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:39:41.033780 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-702a0219-b5d2-4453-ac49-d03083e26ef8 admin admin] Usage tracker for resource:security_group_rule and tenant:63aecc8949904e56b11ed0587ba57d0a is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:39:41.036685 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-702a0219-b5d2-4453-ac49-d03083e26ef8 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:39:41.042597 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-702a0219-b5d2-4453-ac49-d03083e26ef8 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:39:41.127500 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-702a0219-b5d2-4453-ac49-d03083e26ef8 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:41.132240 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-702a0219-b5d2-4453-ac49-d03083e26ef8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:41.139425 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-a7b238af-9c3c-4e62-b0ca-a75f79f9596c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:39:41.178705 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-702a0219-b5d2-4453-ac49-d03083e26ef8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=de10a7fd-ac86-41ab-93d0-95f9d6c6ff27,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:39:41.184196 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-702a0219-b5d2-4453-ac49-d03083e26ef8 admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=63aecc8949904e56b11ed0587ba57d0a&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2889528
May 20 04:39:41.185162 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-702a0219-b5d2-4453-ac49-d03083e26ef8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:39:41.186780 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 47702) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:39:41.249547 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-310c8c02-8c0e-4048-b7a1-d0f178c83eaf admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:41.276162 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-310c8c02-8c0e-4048-b7a1-d0f178c83eaf admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:41.331126 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-310c8c02-8c0e-4048-b7a1-d0f178c83eaf admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:41.335016 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-85150698-2ff6-4c8c-9aeb-f897482d76be admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:39:41.348784 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-310c8c02-8c0e-4048-b7a1-d0f178c83eaf admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=de10a7fd-ac86-41ab-93d0-95f9d6c6ff27,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:39:41.352724 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-310c8c02-8c0e-4048-b7a1-d0f178c83eaf admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:39:41.358566 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-310c8c02-8c0e-4048-b7a1-d0f178c83eaf admin admin] Notify callbacks [] for security_group, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:41.359586 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-310c8c02-8c0e-4048-b7a1-d0f178c83eaf admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/de10a7fd-ac86-41ab-93d0-95f9d6c6ff27 HTTP/1.1" status: 204  len: 168 time: 0.1719334
May 20 04:39:41.660682 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 47710) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:39:41.678593 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-6ae7007f-c39e-41b3-9aa6-ec46dfc7bb73 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:41.693448 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-6ae7007f-c39e-41b3-9aa6-ec46dfc7bb73 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:39:41.697675 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-6ae7007f-c39e-41b3-9aa6-ec46dfc7bb73 admin admin] Usage tracker for resource:security_group_rule and tenant:0c2dda85365541c5b6c3f738d4cdac26 is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:39:41.700633 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-6ae7007f-c39e-41b3-9aa6-ec46dfc7bb73 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:39:41.706722 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-6ae7007f-c39e-41b3-9aa6-ec46dfc7bb73 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:39:41.801025 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-6ae7007f-c39e-41b3-9aa6-ec46dfc7bb73 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:41.807649 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-6ae7007f-c39e-41b3-9aa6-ec46dfc7bb73 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:41.814947 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-5b09fe5d-596c-4b15-8be8-9b6e068c3125 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:39:41.857892 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-6ae7007f-c39e-41b3-9aa6-ec46dfc7bb73 admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=0c2dda85365541c5b6c3f738d4cdac26&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1960809
May 20 04:39:41.858853 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ae7007f-c39e-41b3-9aa6-ec46dfc7bb73 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=39dc6abe-b0b0-4c30-82d0-e20e15bc36d2,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:39:41.860708 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 47714) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:39:41.862127 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-6ae7007f-c39e-41b3-9aa6-ec46dfc7bb73 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:39:41.927722 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-573fd242-f790-4943-aa0a-fe5b0bd178d2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:41.952898 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-573fd242-f790-4943-aa0a-fe5b0bd178d2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:42.006530 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-573fd242-f790-4943-aa0a-fe5b0bd178d2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:42.011241 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-c0ff87ef-6638-4cf5-b1d8-4a515d3fe761 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:39:42.023060 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-573fd242-f790-4943-aa0a-fe5b0bd178d2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=39dc6abe-b0b0-4c30-82d0-e20e15bc36d2,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:39:42.026514 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-573fd242-f790-4943-aa0a-fe5b0bd178d2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:39:42.029759 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-573fd242-f790-4943-aa0a-fe5b0bd178d2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:42.030896 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-573fd242-f790-4943-aa0a-fe5b0bd178d2 admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/39dc6abe-b0b0-4c30-82d0-e20e15bc36d2 HTTP/1.1" status: 204  len: 168 time: 0.1678162
May 20 04:39:42.871962 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 47738) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:39:42.988029 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [None req-c2f8eb3b-01a5-4ba1-9ca1-aea6d105f7d1 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1652430977-network', 'tenant_id': 'f3a37dbbd12f4a47b4b2af3f8af3b4a8'}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:39:42.993336 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-c2f8eb3b-01a5-4ba1-9ca1-aea6d105f7d1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:39:42.997942 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-c2f8eb3b-01a5-4ba1-9ca1-aea6d105f7d1 admin admin] Usage tracker for resource:network and tenant:f3a37dbbd12f4a47b4b2af3f8af3b4a8 is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:39:43.001160 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-c2f8eb3b-01a5-4ba1-9ca1-aea6d105f7d1 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:39:43.011485 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-c2f8eb3b-01a5-4ba1-9ca1-aea6d105f7d1 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:39:43.025314 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c2f8eb3b-01a5-4ba1-9ca1-aea6d105f7d1 admin admin] Made reservation on behalf of f3a37dbbd12f4a47b4b2af3f8af3b4a8 for: {'network': 1} {{(pid=91687) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 04:39:43.027920 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-c2f8eb3b-01a5-4ba1-9ca1-aea6d105f7d1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-578118'] for network, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:43.040721 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-c2f8eb3b-01a5-4ba1-9ca1-aea6d105f7d1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:43.056459 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-c2f8eb3b-01a5-4ba1-9ca1-aea6d105f7d1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:39:43.061848 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-c2f8eb3b-01a5-4ba1-9ca1-aea6d105f7d1 admin admin] Usage tracker for resource:security_group_rule and tenant:f3a37dbbd12f4a47b4b2af3f8af3b4a8 is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:39:43.064734 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-c2f8eb3b-01a5-4ba1-9ca1-aea6d105f7d1 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:39:43.072775 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-c2f8eb3b-01a5-4ba1-9ca1-aea6d105f7d1 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:39:43.172034 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-c2f8eb3b-01a5-4ba1-9ca1-aea6d105f7d1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:43.178854 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-c2f8eb3b-01a5-4ba1-9ca1-aea6d105f7d1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:43.181960 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-6fdaa003-03c3-4274-9e62-d85fc629bc93 tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:39:43.212614 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c2f8eb3b-01a5-4ba1-9ca1-aea6d105f7d1 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 864}  {{(pid=91687) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 20 04:39:43.218361 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2f8eb3b-01a5-4ba1-9ca1-aea6d105f7d1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5a039d5b-d82a-40db-9670-415e39480580,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:39:43.221824 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-c2f8eb3b-01a5-4ba1-9ca1-aea6d105f7d1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:39:43.227704 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-c2f8eb3b-01a5-4ba1-9ca1-aea6d105f7d1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1501910'] for segment, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:43.228114 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.db.segments_db [None req-c2f8eb3b-01a5-4ba1-9ca1-aea6d105f7d1 admin admin] Added segment 75b33f0b-1fb8-48aa-9ed6-4cd40fd1599c of type vlan for network 439c30e4-64e4-4fad-ba5c-27e2f7cc6f73
May 20 04:39:43.256405 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-c2f8eb3b-01a5-4ba1-9ca1-aea6d105f7d1 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8782892092784'] for network, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:43.287845 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-c2f8eb3b-01a5-4ba1-9ca1-aea6d105f7d1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1590664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1781430'] for network, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:43.289206 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c2f8eb3b-01a5-4ba1-9ca1-aea6d105f7d1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:39:43.289762 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-c2f8eb3b-01a5-4ba1-9ca1-aea6d105f7d1 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for network, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:43.292942 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:39:43.480427 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2f8eb3b-01a5-4ba1-9ca1-aea6d105f7d1 admin admin] Pushing event updated for resources: {'Network': ['ID=439c30e4-64e4-4fad-ba5c-27e2f7cc6f73,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:39:43.484065 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-c2f8eb3b-01a5-4ba1-9ca1-aea6d105f7d1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.191s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:39:43.486068 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-c2f8eb3b-01a5-4ba1-9ca1-aea6d105f7d1 admin admin] 10.222.0.71 "POST /v2.0/networks HTTP/1.1" status: 201  len: 882 time: 0.6128976
May 20 04:39:43.490696 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 47744) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:39:43.495171 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Network 439c30e4-64e4-4fad-ba5c-27e2f7cc6f73 details requested by agent ovs-agent-dv-cinder-790910-4-iscsi with host dv-cinder-790910-4-iscsi {{(pid=91688) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 20 04:39:43.499927 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [None req-7b162d93-730e-4fea-8ab0-5922ed5f521e admin admin] Request body: {'subnet': {'network_id': '439c30e4-64e4-4fad-ba5c-27e2f7cc6f73', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1652430977-subnet', 'tenant_id': 'f3a37dbbd12f4a47b4b2af3f8af3b4a8', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:39:43.508274 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-7b162d93-730e-4fea-8ab0-5922ed5f521e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:39:43.514669 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-7b162d93-730e-4fea-8ab0-5922ed5f521e admin admin] Usage tracker for resource:subnet and tenant:f3a37dbbd12f4a47b4b2af3f8af3b4a8 is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:39:43.517876 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-7b162d93-730e-4fea-8ab0-5922ed5f521e admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:39:43.524010 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-7b162d93-730e-4fea-8ab0-5922ed5f521e admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:39:43.534823 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7b162d93-730e-4fea-8ab0-5922ed5f521e admin admin] Made reservation on behalf of f3a37dbbd12f4a47b4b2af3f8af3b4a8 for: {'subnet': 1} {{(pid=91687) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 04:39:43.537232 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-7b162d93-730e-4fea-8ab0-5922ed5f521e admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-692271'] for subnet, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:43.922648 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-7b162d93-730e-4fea-8ab0-5922ed5f521e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-255887', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-4160768', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-692253'] for subnet, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:43.926324 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:39:43.992585 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b162d93-730e-4fea-8ab0-5922ed5f521e admin admin] Pushing event updated for resources: {'Subnet': ['ID=e1bc1877-ef70-4bcb-81ae-889142326e0a,revision_number=0']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:39:43.996365 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-7b162d93-730e-4fea-8ab0-5922ed5f521e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:39:44.004068 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7b162d93-730e-4fea-8ab0-5922ed5f521e admin admin] Checking segment: {'id': '75b33f0b-1fb8-48aa-9ed6-4cd40fd1599c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 864, 'network_id': '439c30e4-64e4-4fad-ba5c-27e2f7cc6f73'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91687) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:39:44.004408 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7b162d93-730e-4fea-8ab0-5922ed5f521e admin admin] Network hostable DHCP agents. Network: 439c30e4-64e4-4fad-ba5c-27e2f7cc6f73, hostable agents: ['36d27813-c368-4fd7-ae26-0f662e0a96fd'], hosted agents: [] {{(pid=91687) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 20 04:39:44.024419 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7b162d93-730e-4fea-8ab0-5922ed5f521e admin admin] Network 439c30e4-64e4-4fad-ba5c-27e2f7cc6f73 is scheduled to be hosted by DHCP agent 36d27813-c368-4fd7-ae26-0f662e0a96fd with binding_index 1 {{(pid=91687) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 20 04:39:44.035690 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.base_scheduler [None req-7b162d93-730e-4fea-8ab0-5922ed5f521e admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-790910-4-iscsi, 439c30e4-64e4-4fad-ba5c-27e2f7cc6f73) {{(pid=91687) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:39:44.044545 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7b162d93-730e-4fea-8ab0-5922ed5f521e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:39:44.045159 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-7b162d93-730e-4fea-8ab0-5922ed5f521e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for subnet, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:44.047053 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8d163251-7282-446b-80ec-356c5dc636ec None None] Network 439c30e4-64e4-4fad-ba5c-27e2f7cc6f73 requested from dv-cinder-790910-4-iscsi {{(pid=91688) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 04:39:44.066099 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-7b162d93-730e-4fea-8ab0-5922ed5f521e admin admin] 10.222.0.71 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 846 time: 0.5740771
May 20 04:39:44.236510 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7a32bdfb-56e4-4e85-94b9-b37946f31d14 None None] Network 439c30e4-64e4-4fad-ba5c-27e2f7cc6f73 requested from dv-cinder-790910-4-iscsi {{(pid=91688) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 20 04:39:46.112864 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b0bb817-2822-4d9a-b990-9564bfab3756 req-ece12114-2c36-4111-b462-821ce82136ee tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:39:46.114294 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-9b0bb817-2822-4d9a-b990-9564bfab3756 req-ece12114-2c36-4111-b462-821ce82136ee tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] 10.222.0.71 "GET /v2.0/networks?id=439c30e4-64e4-4fad-ba5c-27e2f7cc6f73 HTTP/1.1" status: 200  len: 809 time: 0.1510522
May 20 04:39:46.129883 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-9b0bb817-2822-4d9a-b990-9564bfab3756 req-ac538ff9-21aa-462b-a36a-61e60ae7f147 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] 10.222.0.71 "GET /v2.0/quotas/f3a37dbbd12f4a47b4b2af3f8af3b4a8 HTTP/1.1" status: 200  len: 375 time: 0.0097225
May 20 04:39:46.179217 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-9b0bb817-2822-4d9a-b990-9564bfab3756 req-38363cfd-6b3a-42b4-a82e-dfd2629b6314 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] 10.222.0.71 "GET /v2.0/ports?tenant_id=f3a37dbbd12f4a47b4b2af3f8af3b4a8&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0437582
May 20 04:39:46.366453 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-9b0bb817-2822-4d9a-b990-9564bfab3756 req-ba1b4a1d-729c-41bd-bec3-1121dffebad8 service neutron] 10.222.0.71 "GET /v2.0/networks/439c30e4-64e4-4fad-ba5c-27e2f7cc6f73?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1770656
May 20 04:39:46.515370 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-9b0bb817-2822-4d9a-b990-9564bfab3756 req-daa08365-ffad-4750-867c-c17421dfab9b service neutron] 10.222.0.71 "GET /v2.0/networks/439c30e4-64e4-4fad-ba5c-27e2f7cc6f73?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1400259
May 20 04:39:46.698993 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-f507eeaa-b7ec-4b57-87e7-d1ca0418f4cd req-fdcbcfe9-a401-4b1d-8f09-0fe312149ff0 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] 10.222.0.71 "GET /v2.0/ports?device_id=3be06649-c43e-4156-8e5a-5fc1e2faf48f HTTP/1.1" status: 200  len: 210 time: 0.0467982
May 20 04:39:47.858646 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-d5a0dd06-0c49-4069-892b-f7ec15f04305 req-8712799f-e4bc-493d-ba2a-94e49b97cf6b tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] 10.222.0.71 "GET /v2.0/ports?device_id=3be06649-c43e-4156-8e5a-5fc1e2faf48f HTTP/1.1" status: 200  len: 210 time: 0.0512631
May 20 04:39:48.012490 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b0bb817-2822-4d9a-b990-9564bfab3756 req-a2a39a80-97fb-49b9-8ceb-59c78061c943 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:39:48.013428 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-9b0bb817-2822-4d9a-b990-9564bfab3756 req-a2a39a80-97fb-49b9-8ceb-59c78061c943 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Synchronizing usage tracker for tenant:f3a37dbbd12f4a47b4b2af3f8af3b4a8 on resource:network {{(pid=91687) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:39:48.032433 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-9b0bb817-2822-4d9a-b990-9564bfab3756 req-a2a39a80-97fb-49b9-8ceb-59c78061c943 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Unset dirty status for tenant:f3a37dbbd12f4a47b4b2af3f8af3b4a8 on resource:network {{(pid=91687) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:39:48.033700 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9b0bb817-2822-4d9a-b990-9564bfab3756 req-a2a39a80-97fb-49b9-8ceb-59c78061c943 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] 10.222.0.82 "GET /v2.0/networks?id=439c30e4-64e4-4fad-ba5c-27e2f7cc6f73 HTTP/1.1" status: 200  len: 809 time: 0.1820006
May 20 04:39:48.047575 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [req-9b0bb817-2822-4d9a-b990-9564bfab3756 req-ae841f64-20f2-48fa-b0fd-60b615a138fb tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Request body: {'port': {'device_id': '3be06649-c43e-4156-8e5a-5fc1e2faf48f', 'network_id': '439c30e4-64e4-4fad-ba5c-27e2f7cc6f73', 'admin_state_up': True, 'tenant_id': 'f3a37dbbd12f4a47b4b2af3f8af3b4a8'}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:39:48.183720 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [req-9b0bb817-2822-4d9a-b990-9564bfab3756 req-ae841f64-20f2-48fa-b0fd-60b615a138fb tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:39:48.187692 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-9b0bb817-2822-4d9a-b990-9564bfab3756 req-ae841f64-20f2-48fa-b0fd-60b615a138fb tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Usage tracker for resource:port and tenant:f3a37dbbd12f4a47b4b2af3f8af3b4a8 is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:39:48.190538 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-9b0bb817-2822-4d9a-b990-9564bfab3756 req-ae841f64-20f2-48fa-b0fd-60b615a138fb tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Quota usage for port was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:39:48.196311 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [req-9b0bb817-2822-4d9a-b990-9564bfab3756 req-ae841f64-20f2-48fa-b0fd-60b615a138fb tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:39:48.207431 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-9b0bb817-2822-4d9a-b990-9564bfab3756 req-ae841f64-20f2-48fa-b0fd-60b615a138fb tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Made reservation on behalf of f3a37dbbd12f4a47b4b2af3f8af3b4a8 for: {'port': 1} {{(pid=91687) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 04:39:48.211314 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-9b0bb817-2822-4d9a-b990-9564bfab3756 req-ae841f64-20f2-48fa-b0fd-60b615a138fb tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:48.377337 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.db_base_plugin_common [req-9b0bb817-2822-4d9a-b990-9564bfab3756 req-ae841f64-20f2-48fa-b0fd-60b615a138fb tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Allocated IP 172.20.0.9 (439c30e4-64e4-4fad-ba5c-27e2f7cc6f73/e1bc1877-ef70-4bcb-81ae-889142326e0a/7c96d9de-2844-4624-b3e7-bdd91d6957c4) {{(pid=91687) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 04:39:48.597713 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-9b0bb817-2822-4d9a-b990-9564bfab3756 req-ae841f64-20f2-48fa-b0fd-60b615a138fb tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Notify callbacks [] for port, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:48.630203 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-9b0bb817-2822-4d9a-b990-9564bfab3756 req-ae841f64-20f2-48fa-b0fd-60b615a138fb tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8782892106231', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4162192'] for port, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:48.635908 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-75db2a80-6ab3-47d6-96a0-80f240e9f630 tempest-TestVolumeBootPattern-908968191 tempest-TestVolumeBootPattern-908968191-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:39:48.705343 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-9b0bb817-2822-4d9a-b990-9564bfab3756 req-ae841f64-20f2-48fa-b0fd-60b615a138fb tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Network 439c30e4-64e4-4fad-ba5c-27e2f7cc6f73 is already hosted by enough agents. {{(pid=91687) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:39:48.708481 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.base_scheduler [req-9b0bb817-2822-4d9a-b990-9564bfab3756 req-ae841f64-20f2-48fa-b0fd-60b615a138fb tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Resources bound (agent type, host, resource id):  {{(pid=91687) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:39:48.712471 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.l3_dvrscheduler_db [req-9b0bb817-2822-4d9a-b990-9564bfab3756 req-ae841f64-20f2-48fa-b0fd-60b615a138fb tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Received port after_create {{(pid=91687) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 04:39:48.743019 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae841f64-20f2-48fa-b0fd-60b615a138fb tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Pushing event updated for resources: {'Port': ['ID=7c96d9de-2844-4624-b3e7-bdd91d6957c4,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:39:48.749780 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-ae841f64-20f2-48fa-b0fd-60b615a138fb tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:39:48.783410 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b0bb817-2822-4d9a-b990-9564bfab3756 req-ae841f64-20f2-48fa-b0fd-60b615a138fb tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:39:48.783994 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-9b0bb817-2822-4d9a-b990-9564bfab3756 req-ae841f64-20f2-48fa-b0fd-60b615a138fb tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for port, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:48.804178 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9b0bb817-2822-4d9a-b990-9564bfab3756 req-ae841f64-20f2-48fa-b0fd-60b615a138fb tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 0.7607434
May 20 04:39:48.817241 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [req-9b0bb817-2822-4d9a-b990-9564bfab3756 req-ccf8e315-2d76-4069-8624-a8ecd2f02a5c service neutron] Request body: {'port': {'device_id': '3be06649-c43e-4156-8e5a-5fc1e2faf48f', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79091'}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:39:48.936918 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-9b0bb817-2822-4d9a-b990-9564bfab3756 req-ccf8e315-2d76-4069-8624-a8ecd2f02a5c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:49.371980 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-954be17a-58e5-4702-a5c1-9ce3d8f1454d req-a57c36b7-3a87-4ce6-a74b-ac06c79c33b8 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:39:49.372751 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-954be17a-58e5-4702-a5c1-9ce3d8f1454d req-a57c36b7-3a87-4ce6-a74b-ac06c79c33b8 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Synchronizing usage tracker for tenant:f3a37dbbd12f4a47b4b2af3f8af3b4a8 on resource:port {{(pid=91687) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:39:49.447148 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-954be17a-58e5-4702-a5c1-9ce3d8f1454d req-a57c36b7-3a87-4ce6-a74b-ac06c79c33b8 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Unset dirty status for tenant:f3a37dbbd12f4a47b4b2af3f8af3b4a8 on resource:port {{(pid=91687) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:39:49.448285 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-954be17a-58e5-4702-a5c1-9ce3d8f1454d req-a57c36b7-3a87-4ce6-a74b-ac06c79c33b8 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] 10.222.0.71 "GET /v2.0/ports?device_id=3be06649-c43e-4156-8e5a-5fc1e2faf48f HTTP/1.1" status: 200  len: 931 time: 0.2468193
May 20 04:39:49.456948 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.notifiers.nova [req-9b0bb817-2822-4d9a-b990-9564bfab3756 req-ccf8e315-2d76-4069-8624-a8ecd2f02a5c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 7c96d9de-2844-4624-b3e7-bdd91d6957c4 {{(pid=91687) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 04:39:49.476845 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-9b0bb817-2822-4d9a-b990-9564bfab3756 req-ccf8e315-2d76-4069-8624-a8ecd2f02a5c service neutron] Notify callbacks [] for port, precommit_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:49.505819 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.provisioning_blocks [req-9b0bb817-2822-4d9a-b990-9564bfab3756 req-ccf8e315-2d76-4069-8624-a8ecd2f02a5c service neutron] Transition to ACTIVE for port object 7c96d9de-2844-4624-b3e7-bdd91d6957c4 will not be triggered until provisioned by entity L2. {{(pid=91687) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:39:49.513023 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-9b0bb817-2822-4d9a-b990-9564bfab3756 req-ccf8e315-2d76-4069-8624-a8ecd2f02a5c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4162185'] for port, after_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:49.519383 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-246ff940-c941-4029-b89c-00e3e5568c6a service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:39:49.551280 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-954be17a-58e5-4702-a5c1-9ce3d8f1454d req-f9c76c49-e627-43bd-a51f-54dd8bef46aa tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Synchronizing usage tracker for tenant:f3a37dbbd12f4a47b4b2af3f8af3b4a8 on resource:security_group {{(pid=91687) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:39:49.658147 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ccf8e315-2d76-4069-8624-a8ecd2f02a5c service neutron] Pushing event updated for resources: {'Port': ['ID=7c96d9de-2844-4624-b3e7-bdd91d6957c4,revision_number=2']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:39:49.683991 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-ccf8e315-2d76-4069-8624-a8ecd2f02a5c service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.165s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:39:49.689292 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-954be17a-58e5-4702-a5c1-9ce3d8f1454d req-f9c76c49-e627-43bd-a51f-54dd8bef46aa tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Unset dirty status for tenant:f3a37dbbd12f4a47b4b2af3f8af3b4a8 on resource:security_group {{(pid=91687) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:39:49.690431 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-954be17a-58e5-4702-a5c1-9ce3d8f1454d req-f9c76c49-e627-43bd-a51f-54dd8bef46aa tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] 10.222.0.71 "GET /v2.0/security-groups?id=5a039d5b-d82a-40db-9670-415e39480580&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2357888
May 20 04:39:49.780395 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.managers [req-9b0bb817-2822-4d9a-b990-9564bfab3756 req-ccf8e315-2d76-4069-8624-a8ecd2f02a5c service neutron] Attempting to bind port 7c96d9de-2844-4624-b3e7-bdd91d6957c4 on host hv-cinder-79091 for vnic_type normal with profile  {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 04:39:49.780797 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.managers [req-9b0bb817-2822-4d9a-b990-9564bfab3756 req-ccf8e315-2d76-4069-8624-a8ecd2f02a5c service neutron] Attempting to bind port 7c96d9de-2844-4624-b3e7-bdd91d6957c4 by drivers openvswitch,hyperv on host hv-cinder-79091 at level 0 using segments [{'id': '75b33f0b-1fb8-48aa-9ed6-4cd40fd1599c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 864, 'network_id': '439c30e4-64e4-4fad-ba5c-27e2f7cc6f73'}] {{(pid=91687) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 04:39:49.781204 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9b0bb817-2822-4d9a-b990-9564bfab3756 req-ccf8e315-2d76-4069-8624-a8ecd2f02a5c service neutron] Attempting to bind port 7c96d9de-2844-4624-b3e7-bdd91d6957c4 on network 439c30e4-64e4-4fad-ba5c-27e2f7cc6f73 {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:39:49.786553 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9b0bb817-2822-4d9a-b990-9564bfab3756 req-ccf8e315-2d76-4069-8624-a8ecd2f02a5c service neutron] Port 7c96d9de-2844-4624-b3e7-bdd91d6957c4 on network 439c30e4-64e4-4fad-ba5c-27e2f7cc6f73 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79091 {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 20 04:39:49.786871 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9b0bb817-2822-4d9a-b990-9564bfab3756 req-ccf8e315-2d76-4069-8624-a8ecd2f02a5c service neutron] Attempting to bind port 7c96d9de-2844-4624-b3e7-bdd91d6957c4 on network 439c30e4-64e4-4fad-ba5c-27e2f7cc6f73 {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:39:49.792181 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9b0bb817-2822-4d9a-b990-9564bfab3756 req-ccf8e315-2d76-4069-8624-a8ecd2f02a5c service neutron] Checking agent: {'id': '7cc947fd-92eb-4d43-ad6b-ea002afff217', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79091', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 4, 19, 34), 'started_at': datetime.datetime(2021, 5, 20, 4, 19, 34), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 4, 39, 37), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 04:39:49.792516 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9b0bb817-2822-4d9a-b990-9564bfab3756 req-ccf8e315-2d76-4069-8624-a8ecd2f02a5c service neutron] Checking segment: {'id': '75b33f0b-1fb8-48aa-9ed6-4cd40fd1599c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 864, 'network_id': '439c30e4-64e4-4fad-ba5c-27e2f7cc6f73'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91687) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:39:49.792929 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9b0bb817-2822-4d9a-b990-9564bfab3756 req-ccf8e315-2d76-4069-8624-a8ecd2f02a5c service neutron] Bound using segment: {'id': '75b33f0b-1fb8-48aa-9ed6-4cd40fd1599c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 864, 'network_id': '439c30e4-64e4-4fad-ba5c-27e2f7cc6f73'} {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 04:39:49.793360 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.managers [req-9b0bb817-2822-4d9a-b990-9564bfab3756 req-ccf8e315-2d76-4069-8624-a8ecd2f02a5c service neutron] Bound port: 7c96d9de-2844-4624-b3e7-bdd91d6957c4, host: hv-cinder-79091, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '75b33f0b-1fb8-48aa-9ed6-4cd40fd1599c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 864, 'network_id': '439c30e4-64e4-4fad-ba5c-27e2f7cc6f73'}}] {{(pid=91687) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 04:39:49.793713 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-9b0bb817-2822-4d9a-b990-9564bfab3756 req-ccf8e315-2d76-4069-8624-a8ecd2f02a5c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:49.883292 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [req-9b0bb817-2822-4d9a-b990-9564bfab3756 req-ccf8e315-2d76-4069-8624-a8ecd2f02a5c service neutron] For port 7c96d9de-2844-4624-b3e7-bdd91d6957c4, host hv-cinder-79091, cleared binding levels {{(pid=91687) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 04:39:49.886411 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [req-9b0bb817-2822-4d9a-b990-9564bfab3756 req-ccf8e315-2d76-4069-8624-a8ecd2f02a5c service neutron] For port 7c96d9de-2844-4624-b3e7-bdd91d6957c4, host hv-cinder-79091, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=7c96d9de-2844-4624-b3e7-bdd91d6957c4,segment=NetworkSegment(75b33f0b-1fb8-48aa-9ed6-4cd40fd1599c),segment_id=75b33f0b-1fb8-48aa-9ed6-4cd40fd1599c)] {{(pid=91687) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 04:39:49.891464 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-9b0bb817-2822-4d9a-b990-9564bfab3756 req-ccf8e315-2d76-4069-8624-a8ecd2f02a5c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4162185'] for port, after_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:49.895265 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-22b33920-f54b-4197-b9cd-b8704c544c56 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:39:49.955669 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b0bb817-2822-4d9a-b990-9564bfab3756 req-ccf8e315-2d76-4069-8624-a8ecd2f02a5c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:39:49.956277 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-9b0bb817-2822-4d9a-b990-9564bfab3756 req-ccf8e315-2d76-4069-8624-a8ecd2f02a5c service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for port, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:49.957670 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9b0bb817-2822-4d9a-b990-9564bfab3756 req-ccf8e315-2d76-4069-8624-a8ecd2f02a5c service neutron] 10.222.0.82 "PUT /v2.0/ports/7c96d9de-2844-4624-b3e7-bdd91d6957c4 HTTP/1.1" status: 200  len: 1093 time: 1.1457770
May 20 04:39:49.958186 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3be06649-c43e-4156-8e5a-5fc1e2faf48f', 'tag': '7c96d9de-2844-4624-b3e7-bdd91d6957c4'}] {{(pid=91687) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:39:49.977751 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ccf8e315-2d76-4069-8624-a8ecd2f02a5c service neutron] Pushing event updated for resources: {'Port': ['ID=7c96d9de-2844-4624-b3e7-bdd91d6957c4,revision_number=3']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:39:49.981376 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-ccf8e315-2d76-4069-8624-a8ecd2f02a5c service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:39:50.034226 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '3be06649-c43e-4156-8e5a-5fc1e2faf48f', 'tag': '7c96d9de-2844-4624-b3e7-bdd91d6957c4', 'status': 'completed', 'code': 200}
May 20 04:39:50.075788 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b0bb817-2822-4d9a-b990-9564bfab3756 req-9ab9e4da-a374-4e75-869f-7bb8648b5849 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:39:50.077376 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9b0bb817-2822-4d9a-b990-9564bfab3756 req-9ab9e4da-a374-4e75-869f-7bb8648b5849 service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=f3a37dbbd12f4a47b4b2af3f8af3b4a8&device_id=3be06649-c43e-4156-8e5a-5fc1e2faf48f HTTP/1.1" status: 200  len: 1096 time: 0.0762455
May 20 04:39:50.148215 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9b0bb817-2822-4d9a-b990-9564bfab3756 req-ebc123b9-7f90-4980-8e11-71dc984ee360 service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=7c96d9de-2844-4624-b3e7-bdd91d6957c4 HTTP/1.1" status: 200  len: 217 time: 0.0632298
May 20 04:39:50.224410 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b0bb817-2822-4d9a-b990-9564bfab3756 req-3cd86d76-3750-4fdc-a0af-af39cc00a87d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:39:50.225769 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9b0bb817-2822-4d9a-b990-9564bfab3756 req-3cd86d76-3750-4fdc-a0af-af39cc00a87d service neutron] 10.222.0.82 "GET /v2.0/subnets?id=e1bc1877-ef70-4bcb-81ae-889142326e0a HTTP/1.1" status: 200  len: 849 time: 0.0713682
May 20 04:39:50.273049 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9b0bb817-2822-4d9a-b990-9564bfab3756 req-6acfe344-3a28-4117-a833-3ac40a14c7e0 service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=439c30e4-64e4-4fad-ba5c-27e2f7cc6f73&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0404332
May 20 04:39:50.417183 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9b0bb817-2822-4d9a-b990-9564bfab3756 req-9544e17a-1722-444e-9a4c-d40cca78dcc3 service neutron] 10.222.0.82 "GET /v2.0/networks/439c30e4-64e4-4fad-ba5c-27e2f7cc6f73?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1374898
May 20 04:39:50.549493 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9b0bb817-2822-4d9a-b990-9564bfab3756 req-bd4a1664-afeb-49ed-8753-939430a0fe2b service neutron] 10.222.0.82 "GET /v2.0/networks/439c30e4-64e4-4fad-ba5c-27e2f7cc6f73?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1258743
May 20 04:39:50.677681 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67c270cb-4a59-4939-bc51-8931e89a2962 req-6cf5c478-371e-4cfd-be8d-15a960b02bcd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:39:50.679165 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-67c270cb-4a59-4939-bc51-8931e89a2962 req-6cf5c478-371e-4cfd-be8d-15a960b02bcd service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=f3a37dbbd12f4a47b4b2af3f8af3b4a8&device_id=3be06649-c43e-4156-8e5a-5fc1e2faf48f HTTP/1.1" status: 200  len: 1096 time: 0.0783627
May 20 04:39:50.850868 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67c270cb-4a59-4939-bc51-8931e89a2962 req-f8491907-e566-4339-82e4-bdd53dc5b99d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:39:50.852221 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-67c270cb-4a59-4939-bc51-8931e89a2962 req-f8491907-e566-4339-82e4-bdd53dc5b99d service neutron] 10.222.0.82 "GET /v2.0/networks?id=439c30e4-64e4-4fad-ba5c-27e2f7cc6f73 HTTP/1.1" status: 200  len: 910 time: 0.1665406
May 20 04:39:51.031416 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-67c270cb-4a59-4939-bc51-8931e89a2962 req-205dfdf3-2b3d-4d64-98e7-074d6308571f service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=7c96d9de-2844-4624-b3e7-bdd91d6957c4 HTTP/1.1" status: 200  len: 217 time: 0.1691773
May 20 04:39:51.109195 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db67b392-6c01-4769-986a-c4adf2fa568e req-728216f1-5288-4b19-850e-057e83d85c9f tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:39:51.110626 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-db67b392-6c01-4769-986a-c4adf2fa568e req-728216f1-5288-4b19-850e-057e83d85c9f tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] 10.222.0.71 "GET /v2.0/ports?device_id=3be06649-c43e-4156-8e5a-5fc1e2faf48f HTTP/1.1" status: 200  len: 943 time: 0.3138759
May 20 04:39:51.112124 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67c270cb-4a59-4939-bc51-8931e89a2962 req-c0e4af4b-47b3-4e7b-9621-6c47d49a3cf0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:39:51.113399 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-67c270cb-4a59-4939-bc51-8931e89a2962 req-c0e4af4b-47b3-4e7b-9621-6c47d49a3cf0 service neutron] 10.222.0.82 "GET /v2.0/subnets?id=e1bc1877-ef70-4bcb-81ae-889142326e0a HTTP/1.1" status: 200  len: 849 time: 0.0747447
May 20 04:39:51.181604 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-67c270cb-4a59-4939-bc51-8931e89a2962 req-3ca1b114-5fc0-4dc6-adb4-7b377312c7db service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=439c30e4-64e4-4fad-ba5c-27e2f7cc6f73&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0518146
May 20 04:39:51.212683 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-db67b392-6c01-4769-986a-c4adf2fa568e req-f83d98ce-5eab-4ea5-9988-e8c3d7ebdd70 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] 10.222.0.71 "GET /v2.0/security-groups?id=5a039d5b-d82a-40db-9670-415e39480580&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0961230
May 20 04:39:51.322822 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-67c270cb-4a59-4939-bc51-8931e89a2962 req-81365d47-cbb0-4675-b2eb-1380a82bf9dc service neutron] 10.222.0.82 "GET /v2.0/networks/439c30e4-64e4-4fad-ba5c-27e2f7cc6f73?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1332808
May 20 04:39:51.457256 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-67c270cb-4a59-4939-bc51-8931e89a2962 req-62ac2bd1-b8f5-4f68-8f7c-0ed982dd91fb service neutron] 10.222.0.82 "GET /v2.0/networks/439c30e4-64e4-4fad-ba5c-27e2f7cc6f73?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1274874
May 20 04:39:52.417916 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17a84a4c-af30-4ca3-83c4-f6bd6b08bd82 req-ab106fa4-79b1-466c-9504-e181113a2f85 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:39:52.419442 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-17a84a4c-af30-4ca3-83c4-f6bd6b08bd82 req-ab106fa4-79b1-466c-9504-e181113a2f85 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] 10.222.0.71 "GET /v2.0/ports?device_id=3be06649-c43e-4156-8e5a-5fc1e2faf48f HTTP/1.1" status: 200  len: 943 time: 0.0919712
May 20 04:39:52.466786 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-17a84a4c-af30-4ca3-83c4-f6bd6b08bd82 req-24e79806-6bb0-4055-b7e9-3bdd18506618 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] 10.222.0.71 "GET /v2.0/security-groups?id=5a039d5b-d82a-40db-9670-415e39480580&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0414214
May 20 04:39:53.663712 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a3b9e34-0798-45a8-89d5-dc2fbe50cdef req-f17a8a70-805a-4996-9949-e6adbb8597ee tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:39:53.665123 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-0a3b9e34-0798-45a8-89d5-dc2fbe50cdef req-f17a8a70-805a-4996-9949-e6adbb8597ee tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] 10.222.0.71 "GET /v2.0/ports?device_id=3be06649-c43e-4156-8e5a-5fc1e2faf48f HTTP/1.1" status: 200  len: 943 time: 0.0874221
May 20 04:39:53.717423 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-0a3b9e34-0798-45a8-89d5-dc2fbe50cdef req-7df4b619-e572-4667-89cd-02394fb62013 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] 10.222.0.71 "GET /v2.0/security-groups?id=5a039d5b-d82a-40db-9670-415e39480580&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0463297
May 20 04:39:54.419646 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 7c96d9de-2844-4624-b3e7-bdd91d6957c4 details requested by agent hyperv_hv-cinder-79091 with host hv-cinder-79091 {{(pid=91688) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 20 04:39:54.602910 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port 7c96d9de-2844-4624-b3e7-bdd91d6957c4, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=7c96d9de-2844-4624-b3e7-bdd91d6957c4,segment=NetworkSegment(75b33f0b-1fb8-48aa-9ed6-4cd40fd1599c),segment_id=75b33f0b-1fb8-48aa-9ed6-4cd40fd1599c)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:39:54.617662 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Returning: {'device': '7c96d9de-2844-4624-b3e7-bdd91d6957c4', 'network_id': '439c30e4-64e4-4fad-ba5c-27e2f7cc6f73', 'port_id': '7c96d9de-2844-4624-b3e7-bdd91d6957c4', 'mac_address': 'fa:16:3e:d8:f3:7f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 864, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'e1bc1877-ef70-4bcb-81ae-889142326e0a', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91688) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 20 04:39:54.679863 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:54.697094 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.notifiers.nova [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 7c96d9de-2844-4624-b3e7-bdd91d6957c4 {{(pid=91688) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 04:39:54.713787 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port 7c96d9de-2844-4624-b3e7-bdd91d6957c4, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=7c96d9de-2844-4624-b3e7-bdd91d6957c4,segment=NetworkSegment(75b33f0b-1fb8-48aa-9ed6-4cd40fd1599c),segment_id=75b33f0b-1fb8-48aa-9ed6-4cd40fd1599c)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:39:54.718325 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:54.721387 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:39:54.790606 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Pushing event updated for resources: {'Port': ['ID=7c96d9de-2844-4624-b3e7-bdd91d6957c4,revision_number=4']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:39:54.793936 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:39:54.916220 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7422715-68e9-4fde-8905-c9957530d9e1 req-cbb5fd03-4dee-417b-8bf4-040731ce0293 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:39:54.917919 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-f7422715-68e9-4fde-8905-c9957530d9e1 req-cbb5fd03-4dee-417b-8bf4-040731ce0293 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] 10.222.0.71 "GET /v2.0/ports?device_id=3be06649-c43e-4156-8e5a-5fc1e2faf48f HTTP/1.1" status: 200  len: 944 time: 0.0926976
May 20 04:39:54.963022 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-f7422715-68e9-4fde-8905-c9957530d9e1 req-95aaf972-4d19-42e0-99f2-f6360f101558 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] 10.222.0.71 "GET /v2.0/security-groups?id=5a039d5b-d82a-40db-9670-415e39480580&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0383215
May 20 04:39:55.008184 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] get_ports_and_sgs() called for port_ids ['7c96d9de-2844-4624-b3e7-bdd91d6957c4'] {{(pid=91688) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 04:39:56.169413 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81f23747-a12b-45e4-9b99-9354cedfba6a req-d677d2d7-860f-49b0-9d36-b5f815c590bc tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:39:56.170832 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-81f23747-a12b-45e4-9b99-9354cedfba6a req-d677d2d7-860f-49b0-9d36-b5f815c590bc tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] 10.222.0.71 "GET /v2.0/ports?device_id=3be06649-c43e-4156-8e5a-5fc1e2faf48f HTTP/1.1" status: 200  len: 944 time: 0.0869524
May 20 04:39:56.228812 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-81f23747-a12b-45e4-9b99-9354cedfba6a req-4f484085-502b-4364-b7c9-88c5857402d8 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] 10.222.0.71 "GET /v2.0/security-groups?id=5a039d5b-d82a-40db-9670-415e39480580&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0489407
May 20 04:39:56.435174 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 7c96d9de-2844-4624-b3e7-bdd91d6957c4 up at agent hyperv_hv-cinder-79091 {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:39:56.511400 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Provisioning for port 7c96d9de-2844-4624-b3e7-bdd91d6957c4 completed by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:39:56.518043 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Provisioning complete for port 7c96d9de-2844-4624-b3e7-bdd91d6957c4 triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:39:56.518589 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:56.635378 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:56.663274 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3be06649-c43e-4156-8e5a-5fc1e2faf48f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7c96d9de-2844-4624-b3e7-bdd91d6957c4'}] {{(pid=91688) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:39:56.673234 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port 7c96d9de-2844-4624-b3e7-bdd91d6957c4, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=7c96d9de-2844-4624-b3e7-bdd91d6957c4,segment=NetworkSegment(75b33f0b-1fb8-48aa-9ed6-4cd40fd1599c),segment_id=75b33f0b-1fb8-48aa-9ed6-4cd40fd1599c)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:39:56.678810 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:56.680769 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:39:56.748171 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Pushing event updated for resources: {'Port': ['ID=7c96d9de-2844-4624-b3e7-bdd91d6957c4,revision_number=5']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:39:56.751327 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:39:56.834486 dv-cinder-790910-4-iscsi neutron-server[91688]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3be06649-c43e-4156-8e5a-5fc1e2faf48f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7c96d9de-2844-4624-b3e7-bdd91d6957c4', 'code': 200}
May 20 04:39:57.078150 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f9c7d0f-c8e5-4591-a76f-9ab3e548abca req-82d52a50-e051-44a0-a74a-6130e7af1281 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:39:57.079512 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9f9c7d0f-c8e5-4591-a76f-9ab3e548abca req-82d52a50-e051-44a0-a74a-6130e7af1281 service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=3be06649-c43e-4156-8e5a-5fc1e2faf48f HTTP/1.1" status: 200  len: 1098 time: 0.0774622
May 20 04:39:57.120582 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-9f9c7d0f-c8e5-4591-a76f-9ab3e548abca req-9128e434-62e2-49df-9482-5860eca0644c service neutron] 10.222.0.82 "GET /v2.0/security-groups?id=5a039d5b-d82a-40db-9670-415e39480580&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0337393
May 20 04:39:57.427261 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33a89ede-724d-4e0e-aa04-2472efb51e28 req-94cacac2-0aa8-4681-b477-dde0e65ac73a tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:39:57.428698 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-33a89ede-724d-4e0e-aa04-2472efb51e28 req-94cacac2-0aa8-4681-b477-dde0e65ac73a tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] 10.222.0.71 "GET /v2.0/ports?device_id=3be06649-c43e-4156-8e5a-5fc1e2faf48f HTTP/1.1" status: 200  len: 945 time: 0.0896842
May 20 04:39:57.485788 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-33a89ede-724d-4e0e-aa04-2472efb51e28 req-38dd1172-0323-48b8-9042-895d4e89938d tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] 10.222.0.71 "GET /v2.0/security-groups?id=5a039d5b-d82a-40db-9670-415e39480580&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0487676
May 20 04:39:58.705435 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee559206-efe5-49dd-9ff7-e933a8931002 req-7bb512ff-0969-463a-8a21-d9eca4967549 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:39:58.706880 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-ee559206-efe5-49dd-9ff7-e933a8931002 req-7bb512ff-0969-463a-8a21-d9eca4967549 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] 10.222.0.71 "GET /v2.0/ports?device_id=3be06649-c43e-4156-8e5a-5fc1e2faf48f HTTP/1.1" status: 200  len: 945 time: 0.0952044
May 20 04:39:58.756377 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-ee559206-efe5-49dd-9ff7-e933a8931002 req-803b1a1f-62f9-45d5-9104-ae61e36a1cf3 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] 10.222.0.71 "GET /v2.0/security-groups?id=5a039d5b-d82a-40db-9670-415e39480580&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0432384
May 20 04:39:58.955925 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.agents_db [None req-92d61f12-17bc-4bf9-9eab-8a69b8c6da2f None None] Agent healthcheck: found 6 active agents {{(pid=91689) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 04:39:59.820746 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61fb0657-ca08-4b08-885b-5f5901c67a87 req-1647d97e-fb8e-41f6-a1ae-aa24dfb7bc45 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:39:59.822183 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-61fb0657-ca08-4b08-885b-5f5901c67a87 req-1647d97e-fb8e-41f6-a1ae-aa24dfb7bc45 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] 10.222.0.71 "GET /v2.0/ports?device_id=3be06649-c43e-4156-8e5a-5fc1e2faf48f HTTP/1.1" status: 200  len: 945 time: 0.0940847
May 20 04:39:59.871501 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-c9cd0ad2-5db3-4f76-a171-0e23b85834c0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:39:59.872390 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-61fb0657-ca08-4b08-885b-5f5901c67a87 req-052d2856-08a6-43af-8e03-980bf381dae3 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] 10.222.0.71 "GET /v2.0/security-groups?id=5a039d5b-d82a-40db-9670-415e39480580&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0410497
May 20 04:40:01.074604 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94aee989-84e1-4d1b-af78-7dcc7987eb55 req-a985f42d-3465-4ced-86fd-78e3f80ba40f tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:40:01.076031 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-94aee989-84e1-4d1b-af78-7dcc7987eb55 req-a985f42d-3465-4ced-86fd-78e3f80ba40f tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] 10.222.0.71 "GET /v2.0/ports?device_id=3be06649-c43e-4156-8e5a-5fc1e2faf48f HTTP/1.1" status: 200  len: 945 time: 0.0918298
May 20 04:40:01.134431 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-94aee989-84e1-4d1b-af78-7dcc7987eb55 req-2eb533c0-c399-4d5a-ad9d-6f59243f2b48 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] 10.222.0.71 "GET /v2.0/security-groups?id=5a039d5b-d82a-40db-9670-415e39480580&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0523765
May 20 04:40:01.301393 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de84745a-083a-4a82-9d84-ff6ec981499b req-9610d41a-f175-4457-b65f-80488fd16f47 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:40:01.302936 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-de84745a-083a-4a82-9d84-ff6ec981499b req-9610d41a-f175-4457-b65f-80488fd16f47 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] 10.222.0.82 "GET /v2.0/ports?device_id=3be06649-c43e-4156-8e5a-5fc1e2faf48f HTTP/1.1" status: 200  len: 945 time: 0.1076367
May 20 04:40:01.463432 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [req-de84745a-083a-4a82-9d84-ff6ec981499b req-0c3d701c-2240-4ffb-84b2-f939d27aa3d6 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Deleting port 7c96d9de-2844-4624-b3e7-bdd91d6957c4 {{(pid=91687) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 04:40:01.463690 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-de84745a-083a-4a82-9d84-ff6ec981499b req-0c3d701c-2240-4ffb-84b2-f939d27aa3d6 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8782892520551'] for port, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:40:01.611172 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [req-de84745a-083a-4a82-9d84-ff6ec981499b req-0c3d701c-2240-4ffb-84b2-f939d27aa3d6 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] For port 7c96d9de-2844-4624-b3e7-bdd91d6957c4, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=7c96d9de-2844-4624-b3e7-bdd91d6957c4,segment=NetworkSegment(75b33f0b-1fb8-48aa-9ed6-4cd40fd1599c),segment_id=75b33f0b-1fb8-48aa-9ed6-4cd40fd1599c)] {{(pid=91687) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:40:01.611490 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-de84745a-083a-4a82-9d84-ff6ec981499b req-0c3d701c-2240-4ffb-84b2-f939d27aa3d6 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1718922'] for port, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:40:01.738355 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [req-de84745a-083a-4a82-9d84-ff6ec981499b req-0c3d701c-2240-4ffb-84b2-f939d27aa3d6 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Calling delete_port for 7c96d9de-2844-4624-b3e7-bdd91d6957c4 owned by compute:nova {{(pid=91687) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 04:40:01.848881 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-de84745a-083a-4a82-9d84-ff6ec981499b req-0c3d701c-2240-4ffb-84b2-f939d27aa3d6 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8782892522936', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8782892108804', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4162192'] for port, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:40:01.854898 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-d7951ee4-82af-4f84-bffc-a49032236fb9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:40:01.862385 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] get_ports_and_sgs() called for port_ids ['7c96d9de-2844-4624-b3e7-bdd91d6957c4'] {{(pid=91688) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 04:40:01.898977 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c3d701c-2240-4ffb-84b2-f939d27aa3d6 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Pushing event deleted for resources: {'Port': ['ID=7c96d9de-2844-4624-b3e7-bdd91d6957c4,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:40:01.902523 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-0c3d701c-2240-4ffb-84b2-f939d27aa3d6 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:40:02.070362 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.l3_dvrscheduler_db [req-de84745a-083a-4a82-9d84-ff6ec981499b req-0c3d701c-2240-4ffb-84b2-f939d27aa3d6 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] No DVR routers for this DVR port 7c96d9de-2844-4624-b3e7-bdd91d6957c4 on host hv-cinder-79091 {{(pid=91687) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 04:40:02.073211 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-de84745a-083a-4a82-9d84-ff6ec981499b req-0c3d701c-2240-4ffb-84b2-f939d27aa3d6 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for port, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:40:02.075718 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3be06649-c43e-4156-8e5a-5fc1e2faf48f', 'name': 'network-vif-deleted', 'tag': '7c96d9de-2844-4624-b3e7-bdd91d6957c4'}] {{(pid=91687) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:40:02.092915 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-de84745a-083a-4a82-9d84-ff6ec981499b req-0c3d701c-2240-4ffb-84b2-f939d27aa3d6 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] 10.222.0.82 "DELETE /v2.0/ports/7c96d9de-2844-4624-b3e7-bdd91d6957c4 HTTP/1.1" status: 204  len: 173 time: 0.7843165
May 20 04:40:02.122306 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3be06649-c43e-4156-8e5a-5fc1e2faf48f', 'name': 'network-vif-deleted', 'tag': '7c96d9de-2844-4624-b3e7-bdd91d6957c4', 'status': 'completed', 'code': 200}
May 20 04:40:02.304573 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-59eb7f63-4267-4036-8d5c-5c452a788845 req-99642dab-0f65-4f07-b03f-d78c5576d896 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Synchronizing usage tracker for tenant:f3a37dbbd12f4a47b4b2af3f8af3b4a8 on resource:port {{(pid=91687) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:40:02.322551 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-59eb7f63-4267-4036-8d5c-5c452a788845 req-99642dab-0f65-4f07-b03f-d78c5576d896 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Unset dirty status for tenant:f3a37dbbd12f4a47b4b2af3f8af3b4a8 on resource:port {{(pid=91687) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:40:02.323915 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-59eb7f63-4267-4036-8d5c-5c452a788845 req-99642dab-0f65-4f07-b03f-d78c5576d896 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] 10.222.0.71 "GET /v2.0/ports?device_id=3be06649-c43e-4156-8e5a-5fc1e2faf48f HTTP/1.1" status: 200  len: 210 time: 0.0612149
May 20 04:40:02.589985 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:40:02.762602 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-466fc5b3-7e54-4260-9d47-12c4ea5f3a44 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:40:03.412939 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ea4803bd-878f-47d5-9084-1ec41953c9db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:40:03.773703 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76761c74-e60d-4690-ab02-685c72629c5f req-efa6d68c-41d3-494f-9c0c-27f450f8df30 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:40:03.775142 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-76761c74-e60d-4690-ab02-685c72629c5f req-efa6d68c-41d3-494f-9c0c-27f450f8df30 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] 10.222.0.71 "GET /v2.0/networks?id=439c30e4-64e4-4fad-ba5c-27e2f7cc6f73 HTTP/1.1" status: 200  len: 809 time: 0.1636903
May 20 04:40:03.791825 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-76761c74-e60d-4690-ab02-685c72629c5f req-b4a8816f-4655-42e2-ba36-ffdec63ba3de tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] 10.222.0.71 "GET /v2.0/quotas/f3a37dbbd12f4a47b4b2af3f8af3b4a8 HTTP/1.1" status: 200  len: 375 time: 0.0094044
May 20 04:40:03.841491 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-76761c74-e60d-4690-ab02-685c72629c5f req-444ef1da-4927-4cdd-83d4-a830735c4a4e tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] 10.222.0.71 "GET /v2.0/ports?tenant_id=f3a37dbbd12f4a47b4b2af3f8af3b4a8&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0424705
May 20 04:40:04.030292 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-76761c74-e60d-4690-ab02-685c72629c5f req-ae3f8cfd-e196-4b3f-8433-5a7b8fe517b8 service neutron] 10.222.0.71 "GET /v2.0/networks/439c30e4-64e4-4fad-ba5c-27e2f7cc6f73?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1783578
May 20 04:40:04.160474 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-76761c74-e60d-4690-ab02-685c72629c5f req-9719c954-c972-4066-8455-a14ec2611491 service neutron] 10.222.0.71 "GET /v2.0/networks/439c30e4-64e4-4fad-ba5c-27e2f7cc6f73?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1241572
May 20 04:40:04.342496 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-7382bcf2-4051-4957-93df-2b9eeba6b89a req-d7900d1c-9aa9-49ae-993c-39bfd0714589 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] 10.222.0.71 "GET /v2.0/ports?device_id=3810a963-aa0a-4bb1-81b6-bb89d8dce44a HTTP/1.1" status: 200  len: 210 time: 0.0420513
May 20 04:40:04.465779 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 7c96d9de-2844-4624-b3e7-bdd91d6957c4 no longer exists at agent hyperv_hv-cinder-79091 {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 04:40:04.499485 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] No Port match for: 7c96d9de-2844-4624-b3e7-bdd91d6957c4 {{(pid=91688) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 04:40:04.499844 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 7c96d9de-2844-4624-b3e7-bdd91d6957c4 not bound to the agent host hv-cinder-79091 {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 04:40:05.260556 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f21320cc-6a25-4ec1-8a32-8b119b35fd55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:40:05.408195 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76761c74-e60d-4690-ab02-685c72629c5f req-84e83ca6-f782-4dcf-b6e7-b0bd6e7cb270 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:40:05.411749 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-76761c74-e60d-4690-ab02-685c72629c5f req-84e83ca6-f782-4dcf-b6e7-b0bd6e7cb270 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] 10.222.0.82 "GET /v2.0/networks?id=439c30e4-64e4-4fad-ba5c-27e2f7cc6f73 HTTP/1.1" status: 200  len: 809 time: 0.1596479
May 20 04:40:05.424457 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [req-76761c74-e60d-4690-ab02-685c72629c5f req-caf647ed-61b9-49d7-94de-0f58d98df9d9 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Request body: {'port': {'device_id': '3810a963-aa0a-4bb1-81b6-bb89d8dce44a', 'network_id': '439c30e4-64e4-4fad-ba5c-27e2f7cc6f73', 'admin_state_up': True, 'tenant_id': 'f3a37dbbd12f4a47b4b2af3f8af3b4a8'}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:40:05.547662 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-46dd3212-d504-4c36-bc8f-9d51b32382ee req-ef2ccfd6-a6fc-4c15-98a9-ea032ff89760 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] 10.222.0.71 "GET /v2.0/ports?device_id=3810a963-aa0a-4bb1-81b6-bb89d8dce44a HTTP/1.1" status: 200  len: 210 time: 0.0925891
May 20 04:40:05.614524 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [req-76761c74-e60d-4690-ab02-685c72629c5f req-caf647ed-61b9-49d7-94de-0f58d98df9d9 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:40:05.630388 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [req-76761c74-e60d-4690-ab02-685c72629c5f req-caf647ed-61b9-49d7-94de-0f58d98df9d9 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:40:05.644149 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-76761c74-e60d-4690-ab02-685c72629c5f req-caf647ed-61b9-49d7-94de-0f58d98df9d9 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Made reservation on behalf of f3a37dbbd12f4a47b4b2af3f8af3b4a8 for: {'port': 1} {{(pid=91687) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 20 04:40:05.648118 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-76761c74-e60d-4690-ab02-685c72629c5f req-caf647ed-61b9-49d7-94de-0f58d98df9d9 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:40:05.809854 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.db_base_plugin_common [req-76761c74-e60d-4690-ab02-685c72629c5f req-caf647ed-61b9-49d7-94de-0f58d98df9d9 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Allocated IP 172.20.0.5 (439c30e4-64e4-4fad-ba5c-27e2f7cc6f73/e1bc1877-ef70-4bcb-81ae-889142326e0a/8e15c073-3ae7-4e51-928a-cc317c9ae137) {{(pid=91687) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 20 04:40:06.024913 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-76761c74-e60d-4690-ab02-685c72629c5f req-caf647ed-61b9-49d7-94de-0f58d98df9d9 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Notify callbacks [] for port, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:40:06.057271 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-76761c74-e60d-4690-ab02-685c72629c5f req-caf647ed-61b9-49d7-94de-0f58d98df9d9 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8782892106231', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4162192'] for port, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:40:06.063339 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-8b250284-4f36-4ea6-a205-08a908caa952 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:40:06.125896 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-76761c74-e60d-4690-ab02-685c72629c5f req-caf647ed-61b9-49d7-94de-0f58d98df9d9 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Network 439c30e4-64e4-4fad-ba5c-27e2f7cc6f73 is already hosted by enough agents. {{(pid=91687) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 20 04:40:06.129374 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.scheduler.base_scheduler [req-76761c74-e60d-4690-ab02-685c72629c5f req-caf647ed-61b9-49d7-94de-0f58d98df9d9 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Resources bound (agent type, host, resource id):  {{(pid=91687) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 20 04:40:06.133331 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.l3_dvrscheduler_db [req-76761c74-e60d-4690-ab02-685c72629c5f req-caf647ed-61b9-49d7-94de-0f58d98df9d9 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Received port after_create {{(pid=91687) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 20 04:40:06.182907 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-caf647ed-61b9-49d7-94de-0f58d98df9d9 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Pushing event updated for resources: {'Port': ['ID=8e15c073-3ae7-4e51-928a-cc317c9ae137,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:40:06.187405 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-caf647ed-61b9-49d7-94de-0f58d98df9d9 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:40:06.205646 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76761c74-e60d-4690-ab02-685c72629c5f req-caf647ed-61b9-49d7-94de-0f58d98df9d9 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:40:06.206225 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-76761c74-e60d-4690-ab02-685c72629c5f req-caf647ed-61b9-49d7-94de-0f58d98df9d9 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for port, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:40:06.231447 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-76761c74-e60d-4690-ab02-685c72629c5f req-caf647ed-61b9-49d7-94de-0f58d98df9d9 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] 10.222.0.82 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 0.8110211
May 20 04:40:06.242996 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.v2.base [req-76761c74-e60d-4690-ab02-685c72629c5f req-3d96343a-4bd1-4bd0-b669-e445774f40e1 service neutron] Request body: {'port': {'device_id': '3810a963-aa0a-4bb1-81b6-bb89d8dce44a', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79091'}} {{(pid=91687) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 20 04:40:06.356361 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-76761c74-e60d-4690-ab02-685c72629c5f req-3d96343a-4bd1-4bd0-b669-e445774f40e1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:40:06.683646 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:40:06.809519 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.notifiers.nova [req-76761c74-e60d-4690-ab02-685c72629c5f req-3d96343a-4bd1-4bd0-b669-e445774f40e1 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 8e15c073-3ae7-4e51-928a-cc317c9ae137 {{(pid=91687) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 04:40:06.817681 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-76761c74-e60d-4690-ab02-685c72629c5f req-3d96343a-4bd1-4bd0-b669-e445774f40e1 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:40:06.831942 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.provisioning_blocks [req-76761c74-e60d-4690-ab02-685c72629c5f req-3d96343a-4bd1-4bd0-b669-e445774f40e1 service neutron] Transition to ACTIVE for port object 8e15c073-3ae7-4e51-928a-cc317c9ae137 will not be triggered until provisioned by entity L2. {{(pid=91687) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 20 04:40:06.836210 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-76761c74-e60d-4690-ab02-685c72629c5f req-3d96343a-4bd1-4bd0-b669-e445774f40e1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4162185'] for port, after_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:40:06.840778 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-e885970a-bd07-490e-acbf-45a3a8301eed admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:40:06.851048 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c48e8710-70f8-4abb-becd-e3a1b297ffa2 req-97111055-42d2-4a5d-83b3-b3ea49d76a44 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:40:06.852554 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-c48e8710-70f8-4abb-becd-e3a1b297ffa2 req-97111055-42d2-4a5d-83b3-b3ea49d76a44 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] 10.222.0.71 "GET /v2.0/ports?device_id=3810a963-aa0a-4bb1-81b6-bb89d8dce44a HTTP/1.1" status: 200  len: 931 time: 0.1879580
May 20 04:40:06.901499 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-c48e8710-70f8-4abb-becd-e3a1b297ffa2 req-5e71c7e9-c5c0-41fe-8bf4-d9e235516a71 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] 10.222.0.71 "GET /v2.0/security-groups?id=5a039d5b-d82a-40db-9670-415e39480580&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0427823
May 20 04:40:06.990810 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d96343a-4bd1-4bd0-b669-e445774f40e1 service neutron] Pushing event updated for resources: {'Port': ['ID=8e15c073-3ae7-4e51-928a-cc317c9ae137,revision_number=2']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:40:06.998409 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-3d96343a-4bd1-4bd0-b669-e445774f40e1 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.157s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:40:07.089038 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.managers [req-76761c74-e60d-4690-ab02-685c72629c5f req-3d96343a-4bd1-4bd0-b669-e445774f40e1 service neutron] Attempting to bind port 8e15c073-3ae7-4e51-928a-cc317c9ae137 on host hv-cinder-79091 for vnic_type normal with profile  {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 20 04:40:07.089375 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.managers [req-76761c74-e60d-4690-ab02-685c72629c5f req-3d96343a-4bd1-4bd0-b669-e445774f40e1 service neutron] Attempting to bind port 8e15c073-3ae7-4e51-928a-cc317c9ae137 by drivers openvswitch,hyperv on host hv-cinder-79091 at level 0 using segments [{'id': '75b33f0b-1fb8-48aa-9ed6-4cd40fd1599c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 864, 'network_id': '439c30e4-64e4-4fad-ba5c-27e2f7cc6f73'}] {{(pid=91687) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 20 04:40:07.089699 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-76761c74-e60d-4690-ab02-685c72629c5f req-3d96343a-4bd1-4bd0-b669-e445774f40e1 service neutron] Attempting to bind port 8e15c073-3ae7-4e51-928a-cc317c9ae137 on network 439c30e4-64e4-4fad-ba5c-27e2f7cc6f73 {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:40:07.094757 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-76761c74-e60d-4690-ab02-685c72629c5f req-3d96343a-4bd1-4bd0-b669-e445774f40e1 service neutron] Port 8e15c073-3ae7-4e51-928a-cc317c9ae137 on network 439c30e4-64e4-4fad-ba5c-27e2f7cc6f73 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79091 {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 20 04:40:07.095085 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-76761c74-e60d-4690-ab02-685c72629c5f req-3d96343a-4bd1-4bd0-b669-e445774f40e1 service neutron] Attempting to bind port 8e15c073-3ae7-4e51-928a-cc317c9ae137 on network 439c30e4-64e4-4fad-ba5c-27e2f7cc6f73 {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 20 04:40:07.100490 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-76761c74-e60d-4690-ab02-685c72629c5f req-3d96343a-4bd1-4bd0-b669-e445774f40e1 service neutron] Checking agent: {'id': '7cc947fd-92eb-4d43-ad6b-ea002afff217', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79091', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 20, 4, 19, 34), 'started_at': datetime.datetime(2021, 5, 20, 4, 19, 34), 'heartbeat_timestamp': datetime.datetime(2021, 5, 20, 4, 40, 7), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 20 04:40:07.100828 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-76761c74-e60d-4690-ab02-685c72629c5f req-3d96343a-4bd1-4bd0-b669-e445774f40e1 service neutron] Checking segment: {'id': '75b33f0b-1fb8-48aa-9ed6-4cd40fd1599c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 864, 'network_id': '439c30e4-64e4-4fad-ba5c-27e2f7cc6f73'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91687) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 20 04:40:07.101287 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-76761c74-e60d-4690-ab02-685c72629c5f req-3d96343a-4bd1-4bd0-b669-e445774f40e1 service neutron] Bound using segment: {'id': '75b33f0b-1fb8-48aa-9ed6-4cd40fd1599c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 864, 'network_id': '439c30e4-64e4-4fad-ba5c-27e2f7cc6f73'} {{(pid=91687) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 20 04:40:07.101707 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.managers [req-76761c74-e60d-4690-ab02-685c72629c5f req-3d96343a-4bd1-4bd0-b669-e445774f40e1 service neutron] Bound port: 8e15c073-3ae7-4e51-928a-cc317c9ae137, host: hv-cinder-79091, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '75b33f0b-1fb8-48aa-9ed6-4cd40fd1599c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 864, 'network_id': '439c30e4-64e4-4fad-ba5c-27e2f7cc6f73'}}] {{(pid=91687) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 20 04:40:07.102054 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-76761c74-e60d-4690-ab02-685c72629c5f req-3d96343a-4bd1-4bd0-b669-e445774f40e1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:40:07.191504 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [req-76761c74-e60d-4690-ab02-685c72629c5f req-3d96343a-4bd1-4bd0-b669-e445774f40e1 service neutron] For port 8e15c073-3ae7-4e51-928a-cc317c9ae137, host hv-cinder-79091, cleared binding levels {{(pid=91687) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 20 04:40:07.195496 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [req-76761c74-e60d-4690-ab02-685c72629c5f req-3d96343a-4bd1-4bd0-b669-e445774f40e1 service neutron] For port 8e15c073-3ae7-4e51-928a-cc317c9ae137, host hv-cinder-79091, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=8e15c073-3ae7-4e51-928a-cc317c9ae137,segment=NetworkSegment(75b33f0b-1fb8-48aa-9ed6-4cd40fd1599c),segment_id=75b33f0b-1fb8-48aa-9ed6-4cd40fd1599c)] {{(pid=91687) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 20 04:40:07.201676 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-76761c74-e60d-4690-ab02-685c72629c5f req-3d96343a-4bd1-4bd0-b669-e445774f40e1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4162185'] for port, after_update {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:40:07.205854 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-0dc520e1-68c6-4fe8-80dd-3e2ca9c23840 tempest-AttachVolumeTestJSON-1287954909 tempest-AttachVolumeTestJSON-1287954909-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:40:07.269055 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76761c74-e60d-4690-ab02-685c72629c5f req-3d96343a-4bd1-4bd0-b669-e445774f40e1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:40:07.269657 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-76761c74-e60d-4690-ab02-685c72629c5f req-3d96343a-4bd1-4bd0-b669-e445774f40e1 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for port, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:40:07.271394 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-76761c74-e60d-4690-ab02-685c72629c5f req-3d96343a-4bd1-4bd0-b669-e445774f40e1 service neutron] 10.222.0.82 "PUT /v2.0/ports/8e15c073-3ae7-4e51-928a-cc317c9ae137 HTTP/1.1" status: 200  len: 1093 time: 1.0326080
May 20 04:40:07.271922 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3810a963-aa0a-4bb1-81b6-bb89d8dce44a', 'tag': '8e15c073-3ae7-4e51-928a-cc317c9ae137'}] {{(pid=91687) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:40:07.294727 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d96343a-4bd1-4bd0-b669-e445774f40e1 service neutron] Pushing event updated for resources: {'Port': ['ID=8e15c073-3ae7-4e51-928a-cc317c9ae137,revision_number=3']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:40:07.297783 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-3d96343a-4bd1-4bd0-b669-e445774f40e1 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:40:07.350842 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '3810a963-aa0a-4bb1-81b6-bb89d8dce44a', 'tag': '8e15c073-3ae7-4e51-928a-cc317c9ae137', 'status': 'completed', 'code': 200}
May 20 04:40:07.392398 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76761c74-e60d-4690-ab02-685c72629c5f req-5ff12092-eff8-46c1-9278-4452283a51bd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:40:07.393895 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-76761c74-e60d-4690-ab02-685c72629c5f req-5ff12092-eff8-46c1-9278-4452283a51bd service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=f3a37dbbd12f4a47b4b2af3f8af3b4a8&device_id=3810a963-aa0a-4bb1-81b6-bb89d8dce44a HTTP/1.1" status: 200  len: 1096 time: 0.0753870
May 20 04:40:07.464549 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-76761c74-e60d-4690-ab02-685c72629c5f req-4f34e63a-8d45-42c7-a090-ff78f89b1308 service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=8e15c073-3ae7-4e51-928a-cc317c9ae137 HTTP/1.1" status: 200  len: 217 time: 0.0621362
May 20 04:40:07.527852 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76761c74-e60d-4690-ab02-685c72629c5f req-751b48fa-5eaf-4f9e-b357-ebfb06eee46f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:40:07.529194 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-76761c74-e60d-4690-ab02-685c72629c5f req-751b48fa-5eaf-4f9e-b357-ebfb06eee46f service neutron] 10.222.0.82 "GET /v2.0/subnets?id=e1bc1877-ef70-4bcb-81ae-889142326e0a HTTP/1.1" status: 200  len: 849 time: 0.0591314
May 20 04:40:07.575542 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-76761c74-e60d-4690-ab02-685c72629c5f req-6c6fccf0-fa53-4afc-986a-a65100ac126f service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=439c30e4-64e4-4fad-ba5c-27e2f7cc6f73&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0400577
May 20 04:40:07.706007 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-76761c74-e60d-4690-ab02-685c72629c5f req-9f34f4be-5096-4e28-aaf5-bc3a04b8c592 service neutron] 10.222.0.82 "GET /v2.0/networks/439c30e4-64e4-4fad-ba5c-27e2f7cc6f73?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1242292
May 20 04:40:07.838800 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-76761c74-e60d-4690-ab02-685c72629c5f req-3bd4d033-db76-4396-98d7-51fbd84682cf service neutron] 10.222.0.82 "GET /v2.0/networks/439c30e4-64e4-4fad-ba5c-27e2f7cc6f73?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1255534
May 20 04:40:07.962056 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75a51334-bb4a-46ed-853c-e8429baf2ecf req-8feb0e53-0bab-4ec8-a474-c03f628b728f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:40:07.963570 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-75a51334-bb4a-46ed-853c-e8429baf2ecf req-8feb0e53-0bab-4ec8-a474-c03f628b728f service neutron] 10.222.0.82 "GET /v2.0/ports?tenant_id=f3a37dbbd12f4a47b4b2af3f8af3b4a8&device_id=3810a963-aa0a-4bb1-81b6-bb89d8dce44a HTTP/1.1" status: 200  len: 1096 time: 0.0772235
May 20 04:40:08.094474 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f194916-d0eb-4e2a-af94-28df73d0b5a1 req-4b891b43-bc69-441d-9038-a95e5d762c48 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:40:08.095810 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-1f194916-d0eb-4e2a-af94-28df73d0b5a1 req-4b891b43-bc69-441d-9038-a95e5d762c48 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] 10.222.0.71 "GET /v2.0/ports?device_id=3810a963-aa0a-4bb1-81b6-bb89d8dce44a HTTP/1.1" status: 200  len: 943 time: 0.0851316
May 20 04:40:08.098908 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75a51334-bb4a-46ed-853c-e8429baf2ecf req-acae75f5-fd2b-47e8-98b7-1762ff042fc2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:40:08.100375 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-75a51334-bb4a-46ed-853c-e8429baf2ecf req-acae75f5-fd2b-47e8-98b7-1762ff042fc2 service neutron] 10.222.0.82 "GET /v2.0/networks?id=439c30e4-64e4-4fad-ba5c-27e2f7cc6f73 HTTP/1.1" status: 200  len: 910 time: 0.1302052
May 20 04:40:08.144997 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-1f194916-d0eb-4e2a-af94-28df73d0b5a1 req-3c66b348-014f-4ca8-a620-6361ca9b67bb tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] 10.222.0.71 "GET /v2.0/security-groups?id=5a039d5b-d82a-40db-9670-415e39480580&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0429757
May 20 04:40:08.166643 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-75a51334-bb4a-46ed-853c-e8429baf2ecf req-a96a35ca-0748-41ca-b160-61757b042881 service neutron] 10.222.0.82 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=8e15c073-3ae7-4e51-928a-cc317c9ae137 HTTP/1.1" status: 200  len: 217 time: 0.0593312
May 20 04:40:08.327589 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75a51334-bb4a-46ed-853c-e8429baf2ecf req-56869d40-2654-4ae4-bd1d-a43207331ba6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:40:08.329863 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-75a51334-bb4a-46ed-853c-e8429baf2ecf req-56869d40-2654-4ae4-bd1d-a43207331ba6 service neutron] 10.222.0.82 "GET /v2.0/subnets?id=e1bc1877-ef70-4bcb-81ae-889142326e0a HTTP/1.1" status: 200  len: 849 time: 0.1569998
May 20 04:40:08.377369 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-75a51334-bb4a-46ed-853c-e8429baf2ecf req-b7fdcf2e-b926-46a0-9cf3-cc40e5bf8dd4 service neutron] 10.222.0.82 "GET /v2.0/ports?network_id=439c30e4-64e4-4fad-ba5c-27e2f7cc6f73&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0407379
May 20 04:40:08.513772 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-75a51334-bb4a-46ed-853c-e8429baf2ecf req-e9010e65-39e8-4bc8-9207-4ceefb745841 service neutron] 10.222.0.82 "GET /v2.0/networks/439c30e4-64e4-4fad-ba5c-27e2f7cc6f73?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1280673
May 20 04:40:08.650355 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-75a51334-bb4a-46ed-853c-e8429baf2ecf req-deeaa0cc-26f8-43d4-895d-e7242e3743bd service neutron] 10.222.0.82 "GET /v2.0/networks/439c30e4-64e4-4fad-ba5c-27e2f7cc6f73?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1295903
May 20 04:40:09.347564 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7709aa01-4df8-426d-8fd8-43fc5dce2c96 req-fadef4e1-e951-42d5-9786-a7ef3c62471a tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:40:09.348253 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-7709aa01-4df8-426d-8fd8-43fc5dce2c96 req-fadef4e1-e951-42d5-9786-a7ef3c62471a tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Synchronizing usage tracker for tenant:f3a37dbbd12f4a47b4b2af3f8af3b4a8 on resource:port {{(pid=91687) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:40:09.367245 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-7709aa01-4df8-426d-8fd8-43fc5dce2c96 req-fadef4e1-e951-42d5-9786-a7ef3c62471a tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Unset dirty status for tenant:f3a37dbbd12f4a47b4b2af3f8af3b4a8 on resource:port {{(pid=91687) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:40:09.368437 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-7709aa01-4df8-426d-8fd8-43fc5dce2c96 req-fadef4e1-e951-42d5-9786-a7ef3c62471a tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] 10.222.0.71 "GET /v2.0/ports?device_id=3810a963-aa0a-4bb1-81b6-bb89d8dce44a HTTP/1.1" status: 200  len: 943 time: 0.1116550
May 20 04:40:09.417867 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-7709aa01-4df8-426d-8fd8-43fc5dce2c96 req-43c6826b-6bc0-40c3-8d2f-3a7771b50b16 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] 10.222.0.71 "GET /v2.0/security-groups?id=5a039d5b-d82a-40db-9670-415e39480580&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0394807
May 20 04:40:10.499816 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 8e15c073-3ae7-4e51-928a-cc317c9ae137 details requested by agent hyperv_hv-cinder-79091 with host hv-cinder-79091 {{(pid=91688) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 20 04:40:10.621165 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44081749-669a-4751-8638-4b2bc141aa46 req-908515f9-63d4-41e6-a37c-86fe6037d129 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:40:10.622708 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-44081749-669a-4751-8638-4b2bc141aa46 req-908515f9-63d4-41e6-a37c-86fe6037d129 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] 10.222.0.71 "GET /v2.0/ports?device_id=3810a963-aa0a-4bb1-81b6-bb89d8dce44a HTTP/1.1" status: 200  len: 943 time: 0.0828321
May 20 04:40:10.647034 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port 8e15c073-3ae7-4e51-928a-cc317c9ae137, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=8e15c073-3ae7-4e51-928a-cc317c9ae137,segment=NetworkSegment(75b33f0b-1fb8-48aa-9ed6-4cd40fd1599c),segment_id=75b33f0b-1fb8-48aa-9ed6-4cd40fd1599c)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:40:10.660972 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Returning: {'device': '8e15c073-3ae7-4e51-928a-cc317c9ae137', 'network_id': '439c30e4-64e4-4fad-ba5c-27e2f7cc6f73', 'port_id': '8e15c073-3ae7-4e51-928a-cc317c9ae137', 'mac_address': 'fa:16:3e:0a:9a:1e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 864, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'e1bc1877-ef70-4bcb-81ae-889142326e0a', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91688) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 20 04:40:10.668622 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-44081749-669a-4751-8638-4b2bc141aa46 req-86977dd3-2dd7-41a6-af30-706693df02d6 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] 10.222.0.71 "GET /v2.0/security-groups?id=5a039d5b-d82a-40db-9670-415e39480580&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0401156
May 20 04:40:10.718752 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:40:10.735931 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.notifiers.nova [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 8e15c073-3ae7-4e51-928a-cc317c9ae137 {{(pid=91688) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 20 04:40:10.751958 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port 8e15c073-3ae7-4e51-928a-cc317c9ae137, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=8e15c073-3ae7-4e51-928a-cc317c9ae137,segment=NetworkSegment(75b33f0b-1fb8-48aa-9ed6-4cd40fd1599c),segment_id=75b33f0b-1fb8-48aa-9ed6-4cd40fd1599c)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:40:10.758426 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:40:10.761241 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-b7d99886-d264-484f-b440-21221f3fd5d2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:40:10.840725 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Pushing event updated for resources: {'Port': ['ID=8e15c073-3ae7-4e51-928a-cc317c9ae137,revision_number=4']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:40:10.843847 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:40:11.108968 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] get_ports_and_sgs() called for port_ids ['8e15c073-3ae7-4e51-928a-cc317c9ae137'] {{(pid=91688) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 04:40:11.864935 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b263048-f05f-4743-9904-0ffa6179cfe6 req-5473b6ba-128c-4163-b4a4-f73b3314406a tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:40:11.866452 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-1b263048-f05f-4743-9904-0ffa6179cfe6 req-5473b6ba-128c-4163-b4a4-f73b3314406a tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] 10.222.0.71 "GET /v2.0/ports?device_id=3810a963-aa0a-4bb1-81b6-bb89d8dce44a HTTP/1.1" status: 200  len: 944 time: 0.0896387
May 20 04:40:11.916311 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-1b263048-f05f-4743-9904-0ffa6179cfe6 req-f259aba1-6e4a-48b9-ab50-9dbf05b8887e tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] 10.222.0.71 "GET /v2.0/security-groups?id=5a039d5b-d82a-40db-9670-415e39480580&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0438793
May 20 04:40:12.514238 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 8e15c073-3ae7-4e51-928a-cc317c9ae137 up at agent hyperv_hv-cinder-79091 {{(pid=91688) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 20 04:40:12.594739 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Provisioning for port 8e15c073-3ae7-4e51-928a-cc317c9ae137 completed by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 20 04:40:12.599701 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.db.provisioning_blocks [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Provisioning complete for port 8e15c073-3ae7-4e51-928a-cc317c9ae137 triggered by entity L2. {{(pid=91688) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 20 04:40:12.600080 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1491351'] for port, provisioning_complete {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:40:12.730873 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-578121'] for port, before_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:40:12.758290 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3810a963-aa0a-4bb1-81b6-bb89d8dce44a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8e15c073-3ae7-4e51-928a-cc317c9ae137'}] {{(pid=91688) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:40:12.770903 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] For port 8e15c073-3ae7-4e51-928a-cc317c9ae137, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=8e15c073-3ae7-4e51-928a-cc317c9ae137,segment=NetworkSegment(75b33f0b-1fb8-48aa-9ed6-4cd40fd1599c),segment_id=75b33f0b-1fb8-48aa-9ed6-4cd40fd1599c)] {{(pid=91688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:40:12.775823 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8782892522927', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8782892108813', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8782892108858'] for port, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:40:12.777693 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:40:12.806600 dv-cinder-790910-4-iscsi neutron-server[91688]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3810a963-aa0a-4bb1-81b6-bb89d8dce44a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8e15c073-3ae7-4e51-928a-cc317c9ae137', 'code': 200}
May 20 04:40:12.846829 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Pushing event updated for resources: {'Port': ['ID=8e15c073-3ae7-4e51-928a-cc317c9ae137,revision_number=5']} {{(pid=91688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:40:12.850101 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG oslo_concurrency.lockutils [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=91688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:40:13.082147 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e08cf709-cd28-4617-8500-560cff6be140 req-30b31991-8ad0-46fe-ab5d-33e3a410c6ac service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:40:13.083496 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-e08cf709-cd28-4617-8500-560cff6be140 req-30b31991-8ad0-46fe-ab5d-33e3a410c6ac service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=3810a963-aa0a-4bb1-81b6-bb89d8dce44a HTTP/1.1" status: 200  len: 1098 time: 0.1190522
May 20 04:40:13.133122 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-e08cf709-cd28-4617-8500-560cff6be140 req-11bc162d-1026-4220-ba7c-56a44900bcf7 service neutron] 10.222.0.82 "GET /v2.0/security-groups?id=5a039d5b-d82a-40db-9670-415e39480580&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0421844
May 20 04:40:13.144445 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-350bd9d2-4a21-49ab-8ad3-d2d291f767d5 req-84ce8325-3655-4c78-8935-0f1b5cc0ff85 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:40:13.146295 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-350bd9d2-4a21-49ab-8ad3-d2d291f767d5 req-84ce8325-3655-4c78-8935-0f1b5cc0ff85 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] 10.222.0.71 "GET /v2.0/ports?device_id=3810a963-aa0a-4bb1-81b6-bb89d8dce44a HTTP/1.1" status: 200  len: 945 time: 0.1220872
May 20 04:40:13.193204 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-350bd9d2-4a21-49ab-8ad3-d2d291f767d5 req-f7a4545f-1fcd-4377-b152-897444183cdd tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] 10.222.0.71 "GET /v2.0/security-groups?id=5a039d5b-d82a-40db-9670-415e39480580&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0382297
May 20 04:40:14.388973 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-133310a6-ff8c-41f1-a5ef-a71f31d80fea req-3981d115-13d5-4ecc-8f6a-924528c8d0ae tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:40:14.391205 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-133310a6-ff8c-41f1-a5ef-a71f31d80fea req-3981d115-13d5-4ecc-8f6a-924528c8d0ae tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] 10.222.0.71 "GET /v2.0/ports?device_id=3810a963-aa0a-4bb1-81b6-bb89d8dce44a HTTP/1.1" status: 200  len: 945 time: 0.0876479
May 20 04:40:14.451255 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-133310a6-ff8c-41f1-a5ef-a71f31d80fea req-2e2a5aab-8219-46d7-b472-fe3331e2b9d7 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] 10.222.0.71 "GET /v2.0/security-groups?id=5a039d5b-d82a-40db-9670-415e39480580&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0512872
May 20 04:40:15.585172 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c9be4af-fddb-4a08-be4b-f88297d429c8 req-e30cf9b5-7bf3-4a38-acd4-1b6549fb5e92 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91686) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:40:15.586625 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-6c9be4af-fddb-4a08-be4b-f88297d429c8 req-e30cf9b5-7bf3-4a38-acd4-1b6549fb5e92 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] 10.222.0.71 "GET /v2.0/ports?device_id=3810a963-aa0a-4bb1-81b6-bb89d8dce44a HTTP/1.1" status: 200  len: 945 time: 0.0899940
May 20 04:40:15.633671 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [req-6c9be4af-fddb-4a08-be4b-f88297d429c8 req-fae38658-2761-4d6b-8c05-c01eac7d0664 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] 10.222.0.71 "GET /v2.0/security-groups?id=5a039d5b-d82a-40db-9670-415e39480580&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0408127
May 20 04:40:16.837939 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4086ca32-677e-4e9e-bebb-3792fd493753 req-f7ce9644-f127-4769-8b7e-55d0812b4c30 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:40:16.839361 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4086ca32-677e-4e9e-bebb-3792fd493753 req-f7ce9644-f127-4769-8b7e-55d0812b4c30 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] 10.222.0.71 "GET /v2.0/ports?device_id=3810a963-aa0a-4bb1-81b6-bb89d8dce44a HTTP/1.1" status: 200  len: 945 time: 0.0918059
May 20 04:40:16.930759 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-4086ca32-677e-4e9e-bebb-3792fd493753 req-5335165e-caee-4bae-ba7f-9d65bbe89f63 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] 10.222.0.71 "GET /v2.0/security-groups?id=5a039d5b-d82a-40db-9670-415e39480580&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0581241
May 20 04:40:16.953997 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80de5f65-7b9d-4f84-bafd-386127edb2fa req-f9c09362-738e-4c1b-88ef-2b558ec3f1ab tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91687) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 20 04:40:16.955431 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-80de5f65-7b9d-4f84-bafd-386127edb2fa req-f9c09362-738e-4c1b-88ef-2b558ec3f1ab tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] 10.222.0.82 "GET /v2.0/ports?device_id=3810a963-aa0a-4bb1-81b6-bb89d8dce44a HTTP/1.1" status: 200  len: 945 time: 0.1152108
May 20 04:40:17.104919 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [req-80de5f65-7b9d-4f84-bafd-386127edb2fa req-d9aea373-ec35-4ac3-a7bc-31cdd57ed290 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Deleting port 8e15c073-3ae7-4e51-928a-cc317c9ae137 {{(pid=91687) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 20 04:40:17.105266 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-80de5f65-7b9d-4f84-bafd-386127edb2fa req-d9aea373-ec35-4ac3-a7bc-31cdd57ed290 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8782892520551'] for port, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:40:17.241444 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.db [req-80de5f65-7b9d-4f84-bafd-386127edb2fa req-d9aea373-ec35-4ac3-a7bc-31cdd57ed290 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] For port 8e15c073-3ae7-4e51-928a-cc317c9ae137, host hv-cinder-79091, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79091',level=0,port_id=8e15c073-3ae7-4e51-928a-cc317c9ae137,segment=NetworkSegment(75b33f0b-1fb8-48aa-9ed6-4cd40fd1599c),segment_id=75b33f0b-1fb8-48aa-9ed6-4cd40fd1599c)] {{(pid=91687) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 20 04:40:17.241798 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-80de5f65-7b9d-4f84-bafd-386127edb2fa req-d9aea373-ec35-4ac3-a7bc-31cdd57ed290 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1718922'] for port, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:40:17.366022 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.plugin [req-80de5f65-7b9d-4f84-bafd-386127edb2fa req-d9aea373-ec35-4ac3-a7bc-31cdd57ed290 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Calling delete_port for 8e15c073-3ae7-4e51-928a-cc317c9ae137 owned by compute:nova {{(pid=91687) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 20 04:40:17.482176 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-80de5f65-7b9d-4f84-bafd-386127edb2fa req-d9aea373-ec35-4ac3-a7bc-31cdd57ed290 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-577714', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1874001', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8782892522936', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8782892108804', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4162192'] for port, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:40:17.487868 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-4c5769b0-9f98-4a84-8344-951b55f2edaa admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:40:17.494318 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.db [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] get_ports_and_sgs() called for port_ids ['8e15c073-3ae7-4e51-928a-cc317c9ae137'] {{(pid=91688) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 20 04:40:17.534840 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9aea373-ec35-4ac3-a7bc-31cdd57ed290 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Pushing event deleted for resources: {'Port': ['ID=8e15c073-3ae7-4e51-928a-cc317c9ae137,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:40:17.577352 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9aea373-ec35-4ac3-a7bc-31cdd57ed290 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:40:17.577825 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9aea373-ec35-4ac3-a7bc-31cdd57ed290 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:40:17.578088 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9aea373-ec35-4ac3-a7bc-31cdd57ed290 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:40:17.578422 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9aea373-ec35-4ac3-a7bc-31cdd57ed290 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:40:17.578765 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9aea373-ec35-4ac3-a7bc-31cdd57ed290 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:40:17.579114 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9aea373-ec35-4ac3-a7bc-31cdd57ed290 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:40:17.579463 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9aea373-ec35-4ac3-a7bc-31cdd57ed290 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:40:17.579804 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9aea373-ec35-4ac3-a7bc-31cdd57ed290 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:40:17.580162 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9aea373-ec35-4ac3-a7bc-31cdd57ed290 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:40:17.580473 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9aea373-ec35-4ac3-a7bc-31cdd57ed290 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:40:17.580810 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9aea373-ec35-4ac3-a7bc-31cdd57ed290 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:40:17.581179 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9aea373-ec35-4ac3-a7bc-31cdd57ed290 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91687) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:40:17.610501 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-d9aea373-ec35-4ac3-a7bc-31cdd57ed290 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.123s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:40:17.713827 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.l3_dvrscheduler_db [req-80de5f65-7b9d-4f84-bafd-386127edb2fa req-d9aea373-ec35-4ac3-a7bc-31cdd57ed290 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] No DVR routers for this DVR port 8e15c073-3ae7-4e51-928a-cc317c9ae137 on host hv-cinder-79091 {{(pid=91687) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 20 04:40:17.716770 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [req-80de5f65-7b9d-4f84-bafd-386127edb2fa req-d9aea373-ec35-4ac3-a7bc-31cdd57ed290 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-5087'] for port, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:40:17.719450 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3810a963-aa0a-4bb1-81b6-bb89d8dce44a', 'name': 'network-vif-deleted', 'tag': '8e15c073-3ae7-4e51-928a-cc317c9ae137'}] {{(pid=91687) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 20 04:40:17.736974 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-80de5f65-7b9d-4f84-bafd-386127edb2fa req-d9aea373-ec35-4ac3-a7bc-31cdd57ed290 tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] 10.222.0.82 "DELETE /v2.0/ports/8e15c073-3ae7-4e51-928a-cc317c9ae137 HTTP/1.1" status: 204  len: 173 time: 0.7759917
May 20 04:40:17.765441 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3810a963-aa0a-4bb1-81b6-bb89d8dce44a', 'name': 'network-vif-deleted', 'tag': '8e15c073-3ae7-4e51-928a-cc317c9ae137', 'status': 'completed', 'code': 200}
May 20 04:40:18.095025 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-da15f8e2-55df-46f4-be14-46e1589c5f07 req-16624b33-7be4-4614-8b92-c7a14bf3dbfd tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Synchronizing usage tracker for tenant:f3a37dbbd12f4a47b4b2af3f8af3b4a8 on resource:port {{(pid=91687) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 20 04:40:18.114552 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [req-da15f8e2-55df-46f4-be14-46e1589c5f07 req-16624b33-7be4-4614-8b92-c7a14bf3dbfd tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] Unset dirty status for tenant:f3a37dbbd12f4a47b4b2af3f8af3b4a8 on resource:port {{(pid=91687) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 20 04:40:18.116083 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [req-da15f8e2-55df-46f4-be14-46e1589c5f07 req-16624b33-7be4-4614-8b92-c7a14bf3dbfd tempest-VolumesActionsTest-346861894 tempest-VolumesActionsTest-346861894-project] 10.222.0.71 "GET /v2.0/ports?device_id=3810a963-aa0a-4bb1-81b6-bb89d8dce44a HTTP/1.1" status: 200  len: 210 time: 0.0661705
May 20 04:40:20.565630 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 8e15c073-3ae7-4e51-928a-cc317c9ae137 no longer exists at agent hyperv_hv-cinder-79091 {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 20 04:40:20.605158 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.plugin [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] No Port match for: 8e15c073-3ae7-4e51-928a-cc317c9ae137 {{(pid=91688) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 20 04:40:20.605518 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron.plugins.ml2.rpc [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Device 8e15c073-3ae7-4e51-928a-cc317c9ae137 not bound to the agent host hv-cinder-79091 {{(pid=91688) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 20 04:40:29.871496 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-cf5f3695-b680-4945-b711-7e1015cf27ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:40:32.602899 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:40:32.771210 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-d348bc8e-359f-4050-b4d7-e9f481f16082 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:40:33.415936 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ea4803bd-878f-47d5-9084-1ec41953c9db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:40:35.265135 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f21320cc-6a25-4ec1-8a32-8b119b35fd55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:40:35.959203 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.agents_db [None req-92d61f12-17bc-4bf9-9eab-8a69b8c6da2f None None] Agent healthcheck: found 6 active agents {{(pid=91689) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 04:40:36.688279 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:40:42.021216 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 48142) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:40:42.082490 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.db_base_plugin_v2 [None req-fa358332-c735-4ab1-af5d-c28abcc93c38 admin admin] Deleting subnet e1bc1877-ef70-4bcb-81ae-889142326e0a {{(pid=91687) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 20 04:40:42.085576 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-fa358332-c735-4ab1-af5d-c28abcc93c38 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:40:42.136881 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-fa358332-c735-4ab1-af5d-c28abcc93c38 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-936634'] for subnet, precommit_delete_associations {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:40:42.191951 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-fa358332-c735-4ab1-af5d-c28abcc93c38 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1504133'] for subnet, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:40:42.445274 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-fa358332-c735-4ab1-af5d-c28abcc93c38 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1504178', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-255887', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1781377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-4160847', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-692244'] for subnet, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:40:42.449102 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:40:42.482682 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa358332-c735-4ab1-af5d-c28abcc93c38 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=e1bc1877-ef70-4bcb-81ae-889142326e0a,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:40:42.485561 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-fa358332-c735-4ab1-af5d-c28abcc93c38 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:40:42.486600 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-fa358332-c735-4ab1-af5d-c28abcc93c38 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for subnet, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:40:42.493266 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-fa358332-c735-4ab1-af5d-c28abcc93c38 admin admin] 10.222.0.71 "DELETE /v2.0/subnets/e1bc1877-ef70-4bcb-81ae-889142326e0a HTTP/1.1" status: 204  len: 168 time: 0.4709487
May 20 04:40:42.495893 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 48146) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:40:42.601579 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-58a3a0e9-d7d6-4a14-b8aa-d67d91f33c89 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-593149'] for network, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:40:42.726529 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-58a3a0e9-d7d6-4a14-b8aa-d67d91f33c89 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1505550', 'neutron.services.segments.db._delete_segments_for_network-8782892550274'] for network, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:40:42.739554 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.services.segments.db [None req-58a3a0e9-d7d6-4a14-b8aa-d67d91f33c89 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fced105a910>,) {'filters': {'network_id': ['439c30e4-64e4-4fad-ba5c-27e2f7cc6f73']}} {{(pid=91687) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:40:42.751600 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.services.segments.db [None req-58a3a0e9-d7d6-4a14-b8aa-d67d91f33c89 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fced105a910>, '75b33f0b-1fb8-48aa-9ed6-4cd40fd1599c') {'for_net_delete': True} {{(pid=91687) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:40:42.751905 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.services.segments.db [None req-58a3a0e9-d7d6-4a14-b8aa-d67d91f33c89 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fced105a910>, '75b33f0b-1fb8-48aa-9ed6-4cd40fd1599c') {} {{(pid=91687) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 20 04:40:42.763288 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-58a3a0e9-d7d6-4a14-b8aa-d67d91f33c89 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8782892560523', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-936621'] for segment, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:40:42.781777 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-58a3a0e9-d7d6-4a14-b8aa-d67d91f33c89 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1501910'] for segment, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:40:42.788735 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-58a3a0e9-d7d6-4a14-b8aa-d67d91f33c89 admin admin] Releasing vlan 864 on physical network physnet1 to pool {{(pid=91687) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 20 04:40:42.789142 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-58a3a0e9-d7d6-4a14-b8aa-d67d91f33c89 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1501910', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-4162285'] for segment, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:40:42.806172 dv-cinder-790910-4-iscsi neutron-server[91687]: Traceback (most recent call last):
May 20 04:40:42.806172 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 20 04:40:42.806172 dv-cinder-790910-4-iscsi neutron-server[91687]:     timer()
May 20 04:40:42.806172 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 20 04:40:42.806172 dv-cinder-790910-4-iscsi neutron-server[91687]:     cb(*args, **kw)
May 20 04:40:42.806172 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 20 04:40:42.806172 dv-cinder-790910-4-iscsi neutron-server[91687]:     return func(*args, **kwargs)
May 20 04:40:42.806172 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 20 04:40:42.806172 dv-cinder-790910-4-iscsi neutron-server[91687]:     self._notify()
May 20 04:40:42.806172 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 20 04:40:42.806172 dv-cinder-790910-4-iscsi neutron-server[91687]:     self.callback(batched_events)
May 20 04:40:42.806172 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 20 04:40:42.806172 dv-cinder-790910-4-iscsi neutron-server[91687]:     event.method(event)
May 20 04:40:42.806172 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 20 04:40:42.806172 dv-cinder-790910-4-iscsi neutron-server[91687]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 20 04:40:42.806172 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 20 04:40:42.806172 dv-cinder-790910-4-iscsi neutron-server[91687]:     aggregate_uuid = self.p_client.list_aggregates(
May 20 04:40:42.806172 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 20 04:40:42.806172 dv-cinder-790910-4-iscsi neutron-server[91687]:     return f(self, *a, **k)
May 20 04:40:42.806172 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 20 04:40:42.806172 dv-cinder-790910-4-iscsi neutron-server[91687]:     return self._get(url).json()
May 20 04:40:42.806172 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 20 04:40:42.806172 dv-cinder-790910-4-iscsi neutron-server[91687]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 20 04:40:42.806172 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 20 04:40:42.806172 dv-cinder-790910-4-iscsi neutron-server[91687]:     return self.request(url, 'GET', **kwargs)
May 20 04:40:42.806172 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 20 04:40:42.806172 dv-cinder-790910-4-iscsi neutron-server[91687]:     base_url = self.get_endpoint(auth, allow=allow,
May 20 04:40:42.806172 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 20 04:40:42.806172 dv-cinder-790910-4-iscsi neutron-server[91687]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 20 04:40:42.806172 dv-cinder-790910-4-iscsi neutron-server[91687]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 20 04:40:42.806172 dv-cinder-790910-4-iscsi neutron-server[91687]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 20 04:40:42.806172 dv-cinder-790910-4-iscsi neutron-server[91687]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 20 04:40:42.886017 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-58a3a0e9-d7d6-4a14-b8aa-d67d91f33c89 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1505543', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1590664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1781430', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1713996'] for network, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:40:42.893419 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-58a3a0e9-d7d6-4a14-b8aa-d67d91f33c89 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1781395'] for network, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:40:42.896314 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-c2f8eb3b-01a5-4ba1-9ca1-aea6d105f7d1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:40:42.918138 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58a3a0e9-d7d6-4a14-b8aa-d67d91f33c89 admin admin] Pushing event deleted for resources: {'Network': ['ID=439c30e4-64e4-4fad-ba5c-27e2f7cc6f73,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:40:42.920707 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-58a3a0e9-d7d6-4a14-b8aa-d67d91f33c89 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:40:42.930111 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-58a3a0e9-d7d6-4a14-b8aa-d67d91f33c89 admin admin] 10.222.0.71 "DELETE /v2.0/networks/439c30e4-64e4-4fad-ba5c-27e2f7cc6f73 HTTP/1.1" status: 204  len: 168 time: 0.4332283
May 20 04:40:43.050152 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 48152) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:40:43.105133 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-47a9e89b-83ba-4739-91c4-3b99dac0dc70 admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=f3a37dbbd12f4a47b4b2af3f8af3b4a8&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0536904
May 20 04:40:43.108638 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 48156) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:40:43.167384 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-14bcd21c-1300-425e-9d54-cc0ecfeadf86 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:40:43.194349 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-14bcd21c-1300-425e-9d54-cc0ecfeadf86 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:40:43.254212 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-14bcd21c-1300-425e-9d54-cc0ecfeadf86 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:40:43.258018 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-76e933c8-9c75-4f29-ad25-3157e33e88b0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:40:43.272173 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14bcd21c-1300-425e-9d54-cc0ecfeadf86 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5a039d5b-d82a-40db-9670-415e39480580,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:40:43.282038 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14bcd21c-1300-425e-9d54-cc0ecfeadf86 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:40:43.282418 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14bcd21c-1300-425e-9d54-cc0ecfeadf86 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:40:43.282829 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14bcd21c-1300-425e-9d54-cc0ecfeadf86 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:40:43.283191 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14bcd21c-1300-425e-9d54-cc0ecfeadf86 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:40:43.283549 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14bcd21c-1300-425e-9d54-cc0ecfeadf86 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:40:43.283905 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14bcd21c-1300-425e-9d54-cc0ecfeadf86 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:40:43.284257 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14bcd21c-1300-425e-9d54-cc0ecfeadf86 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:40:43.284607 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14bcd21c-1300-425e-9d54-cc0ecfeadf86 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:40:43.284982 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14bcd21c-1300-425e-9d54-cc0ecfeadf86 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:40:43.285338 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14bcd21c-1300-425e-9d54-cc0ecfeadf86 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:40:43.285686 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14bcd21c-1300-425e-9d54-cc0ecfeadf86 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:40:43.286032 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14bcd21c-1300-425e-9d54-cc0ecfeadf86 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790910-4-iscsi {{(pid=91686) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 20 04:40:43.290233 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-14bcd21c-1300-425e-9d54-cc0ecfeadf86 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:40:43.295956 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-14bcd21c-1300-425e-9d54-cc0ecfeadf86 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:40:43.297112 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-14bcd21c-1300-425e-9d54-cc0ecfeadf86 admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/5a039d5b-d82a-40db-9670-415e39480580 HTTP/1.1" status: 204  len: 168 time: 0.1875541
May 20 04:40:47.483604 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 48202) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:40:47.609622 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-67535bf3-ec46-4eb2-acf2-11775a6cffe7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:40:47.628383 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-67535bf3-ec46-4eb2-acf2-11775a6cffe7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:40:47.632831 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-67535bf3-ec46-4eb2-acf2-11775a6cffe7 admin admin] Usage tracker for resource:security_group_rule and tenant:59601f0fdd6f4a0882796465f276b3c8 is out of sync, need to count used quota {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:40:47.635954 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.quota.resource [None req-67535bf3-ec46-4eb2-acf2-11775a6cffe7 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91687) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:40:47.642462 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.db.quota.driver [None req-67535bf3-ec46-4eb2-acf2-11775a6cffe7 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91687) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:40:47.727092 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-67535bf3-ec46-4eb2-acf2-11775a6cffe7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:40:47.732553 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-67535bf3-ec46-4eb2-acf2-11775a6cffe7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:40:47.739572 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-84150793-6a5a-4e05-a139-1f6db11742fd tempest-TestShelveInstance-1419961867 tempest-TestShelveInstance-1419961867-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:40:47.780005 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-67535bf3-ec46-4eb2-acf2-11775a6cffe7 admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=59601f0fdd6f4a0882796465f276b3c8&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2952201
May 20 04:40:47.780985 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67535bf3-ec46-4eb2-acf2-11775a6cffe7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d6a33886-e4fe-4fba-bbc3-232f3643d2c2,revision_number=1']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:40:47.782972 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 48208) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:40:47.784262 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-67535bf3-ec46-4eb2-acf2-11775a6cffe7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:40:47.848984 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-322b393e-7064-4b91-bc99-bc507ccb0d48 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:40:47.879523 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-322b393e-7064-4b91-bc99-bc507ccb0d48 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:40:47.935329 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-322b393e-7064-4b91-bc99-bc507ccb0d48 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:40:47.939058 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-55712edb-9ee6-4b04-8721-d7ef68cd3b24 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:40:47.950228 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-322b393e-7064-4b91-bc99-bc507ccb0d48 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d6a33886-e4fe-4fba-bbc3-232f3643d2c2,revision_number=None']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:40:47.953585 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-322b393e-7064-4b91-bc99-bc507ccb0d48 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:40:47.956660 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-322b393e-7064-4b91-bc99-bc507ccb0d48 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:40:47.957805 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-322b393e-7064-4b91-bc99-bc507ccb0d48 admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/d6a33886-e4fe-4fba-bbc3-232f3643d2c2 HTTP/1.1" status: 204  len: 168 time: 0.1737766
May 20 04:40:57.816173 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [-] (91686) accepted ('10.222.0.71', 48284) {{(pid=91686) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:40:57.936872 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-61c9e75f-35a7-4dc2-be16-ee4b81b02984 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:40:57.952232 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-61c9e75f-35a7-4dc2-be16-ee4b81b02984 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 20 04:40:57.956522 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-61c9e75f-35a7-4dc2-be16-ee4b81b02984 admin admin] Usage tracker for resource:security_group_rule and tenant:35805ffca3a34baab1da4c615f826913 is out of sync, need to count used quota {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 20 04:40:57.959615 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.quota.resource [None req-61c9e75f-35a7-4dc2-be16-ee4b81b02984 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91686) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 20 04:40:57.965951 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.db.quota.driver [None req-61c9e75f-35a7-4dc2-be16-ee4b81b02984 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91686) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 20 04:40:58.054556 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-61c9e75f-35a7-4dc2-be16-ee4b81b02984 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:40:58.060258 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron_lib.callbacks.manager [None req-61c9e75f-35a7-4dc2-be16-ee4b81b02984 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_create {{(pid=91686) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:40:58.067130 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-2f94c9a8-736b-4659-b1a5-3697f84a5da0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:40:58.107088 dv-cinder-790910-4-iscsi neutron-server[91686]: INFO neutron.wsgi [None req-61c9e75f-35a7-4dc2-be16-ee4b81b02984 admin admin] 10.222.0.71 "GET /v2.0/security-groups?tenant_id=35805ffca3a34baab1da4c615f826913&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2898469
May 20 04:40:58.107982 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61c9e75f-35a7-4dc2-be16-ee4b81b02984 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=44daab55-8f34-4739-9b9e-c6ddce0b3d81,revision_number=1']} {{(pid=91686) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:40:58.110147 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.wsgi [-] (91687) accepted ('10.222.0.71', 48290) {{(pid=91687) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 20 04:40:58.111182 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG oslo_concurrency.lockutils [None req-61c9e75f-35a7-4dc2-be16-ee4b81b02984 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=91686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:40:58.171084 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-986bcd68-0262-467d-9784-2a7e0a7849f9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:40:58.196603 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-986bcd68-0262-467d-9784-2a7e0a7849f9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:40:58.254973 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-986bcd68-0262-467d-9784-2a7e0a7849f9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1590648'] for security_group, after_delete {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:40:58.258867 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-03e2bdfb-49e1-48e0-83a6-a3f4f453f7f5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 20 04:40:58.271797 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-986bcd68-0262-467d-9784-2a7e0a7849f9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=44daab55-8f34-4739-9b9e-c6ddce0b3d81,revision_number=None']} {{(pid=91687) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 20 04:40:58.274434 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG oslo_concurrency.lockutils [None req-986bcd68-0262-467d-9784-2a7e0a7849f9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=91687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 20 04:40:58.282207 dv-cinder-790910-4-iscsi neutron-server[91687]: DEBUG neutron_lib.callbacks.manager [None req-986bcd68-0262-467d-9784-2a7e0a7849f9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91687) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:40:58.283341 dv-cinder-790910-4-iscsi neutron-server[91687]: INFO neutron.wsgi [None req-986bcd68-0262-467d-9784-2a7e0a7849f9 admin admin] 10.222.0.71 "DELETE /v2.0/security-groups/44daab55-8f34-4739-9b9e-c6ddce0b3d81 HTTP/1.1" status: 204  len: 168 time: 0.1721251
May 20 04:40:59.867790 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f8079e54-847f-4439-8735-9f4baf4d90d7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:41:02.605854 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:41:02.776841 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-7c1e6570-47b7-4185-84ba-c8f17e6d9847 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:41:03.417451 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ea4803bd-878f-47d5-9084-1ec41953c9db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:41:05.272435 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f21320cc-6a25-4ec1-8a32-8b119b35fd55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:41:06.703026 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:41:12.958627 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.agents_db [None req-92d61f12-17bc-4bf9-9eab-8a69b8c6da2f None None] Agent healthcheck: found 6 active agents {{(pid=91689) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 04:41:29.877268 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-633e582d-46f0-4aab-b704-7eb7e776ea8b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:41:32.608528 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:41:32.778588 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-72dad0d3-4b0f-4215-a574-28fd1ad521dd None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:41:33.429572 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ea4803bd-878f-47d5-9084-1ec41953c9db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:41:35.274659 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f21320cc-6a25-4ec1-8a32-8b119b35fd55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:41:36.708714 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:41:49.961722 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.agents_db [None req-92d61f12-17bc-4bf9-9eab-8a69b8c6da2f None None] Agent healthcheck: found 6 active agents {{(pid=91689) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 04:41:59.876849 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-aa4cce53-8f65-4c60-ae88-38bd0078ece0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:42:02.616872 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:42:02.780229 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-a2a33330-d65a-4492-ad4b-d8de2b0633ce None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:42:03.428933 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ea4803bd-878f-47d5-9084-1ec41953c9db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:42:05.282346 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f21320cc-6a25-4ec1-8a32-8b119b35fd55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:42:06.703918 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:42:26.962409 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.agents_db [None req-92d61f12-17bc-4bf9-9eab-8a69b8c6da2f None None] Agent healthcheck: found 6 active agents {{(pid=91689) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 04:42:29.884303 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-df9a6c85-dbd9-4239-beef-cf37baa82e2e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:42:32.612202 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:42:32.773533 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-09ba4340-f43b-4366-9129-15d747a904c3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:42:33.429563 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ea4803bd-878f-47d5-9084-1ec41953c9db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:42:35.285556 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f21320cc-6a25-4ec1-8a32-8b119b35fd55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:42:36.709922 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:42:59.887518 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-fb99e43f-db4b-44dd-841f-c8494d5db301 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:43:02.619343 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:43:02.779406 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-164ce7f8-087c-40e2-b799-3a87c06da0f7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:43:03.434136 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ea4803bd-878f-47d5-9084-1ec41953c9db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:43:03.961219 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.agents_db [None req-92d61f12-17bc-4bf9-9eab-8a69b8c6da2f None None] Agent healthcheck: found 6 active agents {{(pid=91689) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 04:43:05.294455 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f21320cc-6a25-4ec1-8a32-8b119b35fd55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:43:06.722957 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:43:29.892982 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-b7acd262-4405-45a5-ba09-d83fdcc61141 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:43:32.613971 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:43:32.780645 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-91a837b8-5ec8-4dd4-b6cb-1bc0124c1ac1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:43:33.434462 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ea4803bd-878f-47d5-9084-1ec41953c9db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:43:35.296584 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f21320cc-6a25-4ec1-8a32-8b119b35fd55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:43:36.714808 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:43:40.963272 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.agents_db [None req-92d61f12-17bc-4bf9-9eab-8a69b8c6da2f None None] Agent healthcheck: found 6 active agents {{(pid=91689) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 04:43:59.885886 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-6f589247-c333-4e57-82dd-0b185be1550d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:44:02.617491 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:44:02.777146 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-8982755b-1aaf-40fb-a02f-211b159c3044 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:44:03.437553 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ea4803bd-878f-47d5-9084-1ec41953c9db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:44:05.301366 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f21320cc-6a25-4ec1-8a32-8b119b35fd55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:44:06.722673 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:44:17.967897 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.agents_db [None req-92d61f12-17bc-4bf9-9eab-8a69b8c6da2f None None] Agent healthcheck: found 6 active agents {{(pid=91689) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 04:44:29.893713 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-4c31730c-5b69-4035-a975-97a2b5a1c302 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:44:32.625299 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:44:32.778422 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-87a318eb-a36e-4768-8da2-24196454af0d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:44:33.445073 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ea4803bd-878f-47d5-9084-1ec41953c9db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:44:35.308093 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f21320cc-6a25-4ec1-8a32-8b119b35fd55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:44:36.733533 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:44:53.323086 dv-cinder-790910-4-iscsi neutron-server[91686]: DEBUG neutron.wsgi [req-9e548b17-3291-4c96-8c8d-9e4af70c2833 req-d939b767-2a48-4d32-8518-dee707a0d649 service neutron] (91686) timed out ('10.222.0.71', 45360) {{(pid=91686) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}}
May 20 04:44:54.972039 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.agents_db [None req-92d61f12-17bc-4bf9-9eab-8a69b8c6da2f None None] Agent healthcheck: found 6 active agents {{(pid=91689) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 04:44:59.889821 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ba060cf9-b46c-4a3d-a4b6-97b9e974c031 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:45:02.617700 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:45:02.777680 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-394be458-3eb3-4261-acba-fc2ed65f36b8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:45:03.450314 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ea4803bd-878f-47d5-9084-1ec41953c9db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:45:05.313841 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f21320cc-6a25-4ec1-8a32-8b119b35fd55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:45:06.748301 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:45:29.882389 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-99729d99-7c2c-406d-8f4c-520774ad18f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:45:31.975544 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.agents_db [None req-92d61f12-17bc-4bf9-9eab-8a69b8c6da2f None None] Agent healthcheck: found 6 active agents {{(pid=91689) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}
May 20 04:45:32.625541 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:45:32.782062 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-51f78590-ac37-489e-acf4-23f3fe5f34e0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:45:33.450099 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ea4803bd-878f-47d5-9084-1ec41953c9db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:45:35.313592 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f21320cc-6a25-4ec1-8a32-8b119b35fd55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:45:36.749046 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:45:59.882108 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-141e4541-8a0e-4e21-84f8-4809a0377e16 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:46:02.615811 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-632671ad-ea92-4ad9-be2a-f52ce4609990 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:46:02.784132 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-74f67464-176e-4ab6-998f-636cb0a7ab3b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:46:03.454902 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-ea4803bd-878f-47d5-9084-1ec41953c9db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:46:05.313179 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-f21320cc-6a25-4ec1-8a32-8b119b35fd55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:46:06.750673 dv-cinder-790910-4-iscsi neutron-server[91688]: DEBUG neutron_lib.callbacks.manager [None req-1eedbfa7-e1e2-4eac-9d1d-97966fac4797 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8782892553692', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1491396'] for agent, after_update {{(pid=91688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 20 04:46:08.974582 dv-cinder-790910-4-iscsi neutron-server[91689]: DEBUG neutron.db.agents_db [None req-92d61f12-17bc-4bf9-9eab-8a69b8c6da2f None None] Agent healthcheck: found 6 active agents {{(pid=91689) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:325}}